-- Logs begin at Thu 2022-06-23 15:00:24 UTC, end at Thu 2022-06-23 16:11:12 UTC. -- Jun 23 15:36:26.164906 dv-cinder-835384-9-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 23 15:36:26.174398 dv-cinder-835384-9-smb devstack@keystone.service[91816]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 23 15:36:26.176940 dv-cinder-835384-9-smb devstack@keystone.service[91816]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 15:36:26 2022] *** Jun 23 15:36:26.176940 dv-cinder-835384-9-smb devstack@keystone.service[91816]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 15:36:26.176940 dv-cinder-835384-9-smb devstack@keystone.service[91816]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 15:36:26.176940 dv-cinder-835384-9-smb devstack@keystone.service[91816]: nodename: dv-cinder-835384-9-smb Jun 23 15:36:26.176940 dv-cinder-835384-9-smb devstack@keystone.service[91816]: machine: x86_64 Jun 23 15:36:26.176940 dv-cinder-835384-9-smb devstack@keystone.service[91816]: clock source: unix Jun 23 15:36:26.176940 dv-cinder-835384-9-smb devstack@keystone.service[91816]: pcre jit disabled Jun 23 15:36:26.176940 dv-cinder-835384-9-smb devstack@keystone.service[91816]: detected number of CPU cores: 4 Jun 23 15:36:26.176940 dv-cinder-835384-9-smb devstack@keystone.service[91816]: current working directory: / Jun 23 15:36:26.176940 dv-cinder-835384-9-smb devstack@keystone.service[91816]: detected binary path: /usr/bin/uwsgi-core Jun 23 15:36:26.176940 dv-cinder-835384-9-smb devstack@keystone.service[91816]: your processes number limit is 47680 Jun 23 15:36:26.176940 dv-cinder-835384-9-smb devstack@keystone.service[91816]: your memory page size is 4096 bytes Jun 23 15:36:26.176940 dv-cinder-835384-9-smb devstack@keystone.service[91816]: detected max file descriptor number: 2048 Jun 23 15:36:26.177612 dv-cinder-835384-9-smb devstack@keystone.service[91816]: lock engine: pthread robust mutexes Jun 23 15:36:26.177612 dv-cinder-835384-9-smb devstack@keystone.service[91816]: thunder lock: enabled Jun 23 15:36:26.177612 dv-cinder-835384-9-smb devstack@keystone.service[91816]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 23 15:36:26.177612 dv-cinder-835384-9-smb devstack@keystone.service[91816]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 15:36:26.220976 dv-cinder-835384-9-smb devstack@keystone.service[91816]: Python main interpreter initialized at 0x559d4cb119c0 Jun 23 15:36:26.220976 dv-cinder-835384-9-smb devstack@keystone.service[91816]: python threads support enabled Jun 23 15:36:26.220976 dv-cinder-835384-9-smb devstack@keystone.service[91816]: your server socket listen backlog is limited to 100 connections Jun 23 15:36:26.220976 dv-cinder-835384-9-smb devstack@keystone.service[91816]: your mercy for graceful operations on workers is 90 seconds Jun 23 15:36:26.221381 dv-cinder-835384-9-smb devstack@keystone.service[91816]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 15:36:26.221460 dv-cinder-835384-9-smb devstack@keystone.service[91816]: *** Operational MODE: preforking *** Jun 23 15:36:26.221700 dv-cinder-835384-9-smb devstack@keystone.service[91816]: *** uWSGI is running in multiple interpreter mode *** Jun 23 15:36:26.221700 dv-cinder-835384-9-smb devstack@keystone.service[91816]: spawned uWSGI master process (pid: 91816) Jun 23 15:36:26.221945 dv-cinder-835384-9-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 23 15:36:26.223090 dv-cinder-835384-9-smb devstack@keystone.service[91816]: spawned uWSGI worker 1 (pid: 91827, cores: 1) Jun 23 15:36:26.223090 dv-cinder-835384-9-smb devstack@keystone.service[91816]: spawned uWSGI worker 2 (pid: 91828, cores: 1) Jun 23 15:36:26.223090 dv-cinder-835384-9-smb devstack@keystone.service[91816]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 15:36:31.655357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 15:36:31.655357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: from cryptography.utils import int_from_bytes Jun 23 15:36:31.656155 dv-cinder-835384-9-smb devstack@keystone.service[91828]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 15:36:31.656155 dv-cinder-835384-9-smb devstack@keystone.service[91828]: from cryptography.utils import int_from_bytes Jun 23 15:36:31.656287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 15:36:31.656287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: from cryptography.utils import int_from_bytes Jun 23 15:36:31.656287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 15:36:31.656287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: from cryptography.utils import int_from_bytes Jun 23 15:36:31.707031 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 15:36:31.707252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 15:36:31.707343 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 15:36:31.707434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] command line args: [] {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 15:36:31.707540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 15:36:31.707659 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 15:36:31.707792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] command line args: [] {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 15:36:31.707882 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ================================================================================ {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 15:36:31.708008 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 15:36:31.708093 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] admin_token = **** {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.708193 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ================================================================================ {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 15:36:31.708313 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] config_dir = [] {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.708459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] admin_token = **** {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.708547 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.708678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] config_source = [] {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.708764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] config_dir = [] {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.708859 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] debug = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.708946 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.709046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] config_source = [] {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.709122 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.709353 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] debug = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.709482 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.709609 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.709609 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.709783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.709899 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.710010 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.710123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.710218 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.710317 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] list_limit = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.710415 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.710519 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] log_config_append = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.710611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] list_limit = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.710709 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.710807 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] log_config_append = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.710899 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] log_dir = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.711001 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.711099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] log_file = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.711192 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] log_dir = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.711294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.711393 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] log_file = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.711490 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.711589 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.711710 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.711827 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.711909 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.712027 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.712100 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.712220 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.712318 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.712442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.712526 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.712645 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.712718 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.712817 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.712891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.713012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.713093 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.713280 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.713401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.713518 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.713591 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.713703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.713822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.713977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.714060 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.714232 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.714312 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.714481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.714759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.714883 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.714964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] publish_errors = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.715165 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.715299 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.715398 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.715506 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] publish_errors = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.715587 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.715699 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.715792 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.715915 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.716028 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.716126 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.716262 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] standard_threads = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.716339 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.716493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.716594 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.716737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.716897 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] standard_threads = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.716990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.717061 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] use_journal = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.717127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.717234 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] use_json = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.717387 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.717474 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] use_stderr = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.718136 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.718269 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] use_syslog = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.718393 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] use_journal = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.718490 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.718604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] use_json = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.718736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.718814 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] use_stderr = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.718814 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] use_syslog = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.718926 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.719116 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:36:31.719256 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.719390 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.719530 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.719615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.719786 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.719917 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.720053 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.720174 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.720292 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.720415 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.720538 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.720666 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.720793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.720913 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.721032 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.721161 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.721290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.721414 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.721540 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.721675 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.721806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.721806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.721998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.722073 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.722202 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.722277 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.722352 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.722471 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.722544 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.722677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.722831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.722932 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.723017 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.723178 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.723265 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.723415 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.723499 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.723667 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.723744 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.723928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.724004 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.724187 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.724278 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.724418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.724493 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.724650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.724732 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.724883 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.724990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.725114 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.725242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.725348 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.725478 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.725597 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.725711 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.725844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.726004 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.726090 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.726247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.726388 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.726504 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.726583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.726761 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.726850 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.726994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.727081 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.727293 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.727389 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.727513 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.727594 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.727672 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.727755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.727896 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.727986 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.728124 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.728207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.728361 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.728531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.728606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.728675 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.728811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.728894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.729047 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.729132 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.729276 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.729352 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.729507 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.729584 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.729740 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.729823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.729976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.730063 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.730220 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.730296 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.730483 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.730616 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.730746 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.730872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.730951 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.731057 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.731289 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.731433 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.731561 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.731685 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.731808 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.731944 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.732098 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.732240 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.732240 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.732424 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.732483 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.732595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.732668 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.732790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.732865 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.732978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.732978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.733157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.733231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.733297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.733423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.733498 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.733620 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.733694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.733898 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.733992 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.734110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.734225 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.734358 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.734435 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.734593 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.734672 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.734850 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.735333 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.735419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.735419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.735595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.735708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.735787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.735895 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.735978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.736084 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.736159 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.736229 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.736371 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.736463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.736618 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.736736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.736858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.736935 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.737095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.737183 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.737332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.737409 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.737578 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.737656 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.737815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.737925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.738073 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.738150 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.738317 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.738394 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.738556 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.738636 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.738794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.738875 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.739033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.739109 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.739274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.739351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.739511 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.739587 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.739746 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.739863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.740014 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.740087 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.740198 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.740281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.740428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.740510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.740656 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.740743 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.740889 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.740967 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.741117 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.741193 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.741356 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.741438 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.741595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.741680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.741834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.741941 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.742105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.742186 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.742316 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.742401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.742549 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.742658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.742792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.742899 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.743029 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.743138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] auth.external = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.743290 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.743374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.743529 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.743657 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.743789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.743891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.744053 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.744128 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] auth.password = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.744296 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.744402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] auth.token = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.744532 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] auth.external = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.744610 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.744766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.744847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.745020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.745096 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.745255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.745347 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.745501 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.745579 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] auth.password = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.745747 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.745823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] auth.token = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.746002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.746090 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.746239 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] credential.caching = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.746317 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.746485 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.746561 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.746718 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.746806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.746968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.747046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.747202 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.747278 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.747435 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.747518 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.747666 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.747742 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] credential.caching = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.747927 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.748003 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.748180 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.748264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.748417 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.748494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.748688 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.748765 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.748950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.749035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.749198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.749318 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.749444 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.749522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.749684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.749770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.749951 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.750034 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.750185 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] federation.caching = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.750261 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.750422 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.750513 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.750668 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.750754 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.750946 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.751037 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.751145 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.751233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.751393 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.751471 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.751627 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.751705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] federation.caching = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.751883 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.752051 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.752145 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.752222 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.752356 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.752439 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.752593 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.752683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.752840 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.752935 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.753084 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] identity.caching = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.753164 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.753334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.753424 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.753587 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.753693 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.753817 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.753966 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.754121 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.754336 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.754468 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.754595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.754721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.754847 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] identity.caching = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.754969 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.755100 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.755224 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.755345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.755471 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.755596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.755735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.755862 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.755985 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.756105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.756230 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.756355 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.756488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.756614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.756735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.756857 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.756983 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.757109 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.757239 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.757366 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.757502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.757626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.757747 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.757923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.758017 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.758091 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.758162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.758231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.758300 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.758369 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.758447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.758523 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.758595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.758712 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.758796 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.758868 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.758945 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.759108 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.759186 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.759350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.759427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.759579 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.759669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.759825 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.759903 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.760071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.760148 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.760306 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.760391 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.760548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.760632 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.760795 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.760897 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.761023 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.761118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.761259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.761364 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.761473 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.761550 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.761716 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.761828 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.761969 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.762051 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.762210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.762288 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.762445 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.762538 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.762682 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.762777 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.762928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.763007 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.763176 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.763266 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.763408 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.763531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.763634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.763718 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.763874 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.763970 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.764113 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.764192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.764921 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.765002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.765187 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.765289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.765451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.765536 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.765687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.user = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.765767 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.765947 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.766132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.766233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.766358 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.766439 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.766509 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.766654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.766754 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.766889 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.766973 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.767131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.767219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.767366 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.user = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.767485 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.767588 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.767667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.767824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.767911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.768059 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.768149 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.768339 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.768423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.768574 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.768653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.768821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.768902 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.769066 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.769145 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.769310 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.769394 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.769558 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.769655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.769805 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.769901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.770061 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.770153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.770325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.770405 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.770577 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.770659 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.770815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.770893 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.771051 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.771150 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.771288 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.771370 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.771539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.771631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.771802 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.771924 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.771998 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.772068 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.772243 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.772328 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.772463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.772546 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.772709 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.772789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.772946 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.773031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.773182 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.773263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.773419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.773532 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.773647 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.774060 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.774224 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.774320 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.774465 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.774577 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.774689 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.774767 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.774929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] resource.caching = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.775011 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.775183 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.775267 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.775436 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.775530 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.775669 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.775757 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.775919 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.775998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.776185 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.776277 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.776393 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.776478 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.776637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] resource.caching = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.776742 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.776871 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.776949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.777110 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.777204 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.777343 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] role.caching = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.777510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.777595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] role.driver = sql {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.777667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.777821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.777929 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.778068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.778150 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.778315 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.778399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.778558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.778652 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.778812 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.778933 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.779033 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] role.caching = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.779161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.779274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.779355 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] role.driver = sql {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.779505 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.779590 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.779753 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.779830 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.780540 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.780769 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.780864 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.781062 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.781187 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.781293 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.781369 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.781543 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.781624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.781813 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.781974 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.782168 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.782250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.782439 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.782538 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.782681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.782812 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.782928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.783008 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.783179 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.783335 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.783414 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.783666 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.783767 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.783923 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.784162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.784248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.784395 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.784628 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.784865 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.784953 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.785111 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.785189 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.785365 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.785589 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.785678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.785836 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.786095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.786175 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.786325 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.786560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] token.caching = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.786649 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.786803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.787012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.787089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.787273 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.787456 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.787543 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.787759 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.787836 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.787996 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.788073 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.788237 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.788323 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.788479 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.788557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.788749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.788972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.789143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.789256 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.789402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.789487 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.789724 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.789924 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.790018 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.790152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.790226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.790395 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.790462 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.790687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.790802 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.790933 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.791050 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] database.connection = **** {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.791207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.791289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.791421 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] token.caching = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.791496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.791709 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.791789 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.791960 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.792173 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.792283 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.792426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.792506 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.792657 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.792766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.792893 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.793027 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.793137 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.793286 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.793364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.793612 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.793694 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.793838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.793928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.794104 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.794241 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.794340 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.794614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.794697 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.794808 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.794881 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.795048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.795154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.795295 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.795399 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.795457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 15:36:31.795708 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.796046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.796534 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.796654 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.797016 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] database.connection = **** {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.797358 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.797611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.797832 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.798239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.798517 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.798802 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.799048 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.799321 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.799548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.799784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.800034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.800276 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.800582 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.800779 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.801009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.801243 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.801498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.801726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:36:31.801930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91827) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 15:36:31.826048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:31.826276 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:31.826424 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:31.828352 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:31.828583 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:31.828809 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:31.835535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:31.837377 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:31.864110 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:31.864443 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:31.865709 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:31.865954 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.009470 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.011340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.058322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.058553 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.059354 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.059595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.122978 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.123232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.123370 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.123498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.123649 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.123782 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.123906 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.124030 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.124152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.124289 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.124429 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.124558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.149007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.149227 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.149356 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.149498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.149625 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.149748 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.149892 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.150017 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.150150 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.150276 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.150410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.150535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.150659 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.150781 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.162202 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.162364 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.175809 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.176067 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.176242 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.176395 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.176531 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.176683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.176816 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.176945 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.177081 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.177209 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.177335 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91828) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.177462 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.177462 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.177701 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91827) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 15:36:32.194666 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.194871 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 15:36:32.195017 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.195149 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 15:36:32.195276 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.195419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 15:36:32.195547 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.195674 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.195802 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 15:36:32.195929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.196054 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.196188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.196315 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.196454 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.196588 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.196766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.207197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.207472 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.207645 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.207826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.208012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.208203 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.208424 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.208424 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.216251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.216606 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.220171 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.220454 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.220626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.220787 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.220919 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.221089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.221295 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.221477 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.221661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.221974 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.222164 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.222367 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.222560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.222664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.222865 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.223046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.223236 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.223440 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.223631 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.223820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.224004 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.224004 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.249928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.250296 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.251582 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.251796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.251998 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.252218 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.257156 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.257433 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.257662 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.257893 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.258091 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.258312 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.265225 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.265454 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.265601 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.265735 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.269997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.270178 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.270309 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.270451 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.270577 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.270720 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.270851 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.270981 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.271111 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.271242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.271372 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.271509 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.271648 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.271778 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.271926 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.272056 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.291419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.291600 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.291729 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.291882 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.297005 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.297165 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.300703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.300837 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.301104 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.301233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.306108 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.306246 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.309673 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.309808 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.313369 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.313512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.313676 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.313804 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.313989 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.314118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.314254 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.314384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.314508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.314637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.314768 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.314898 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.333769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.334069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.334337 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.334611 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.334737 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.335009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.335279 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.335551 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.342992 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.343947 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.344684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.344958 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.345647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.345946 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.348161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.348440 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.348721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.349001 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.349127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.349339 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.349474 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.349646 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.349960 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.350250 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.363026 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.363305 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.363595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.363873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.364047 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.364329 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.364619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.364902 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.365527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.365818 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.366136 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.366599 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.366894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.367195 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.383992 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.384905 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.387312 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.388195 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.390775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.391532 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.392487 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.393247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.394192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.394468 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.394753 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.394897 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.395171 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.395448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.402482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.403211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.404070 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.404816 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.407822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.408111 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.408498 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.408577 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.408774 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.408855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.409214 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.409511 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.417843 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.418151 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.418428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.418567 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.418852 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.419131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.426768 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91828) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.427045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.427319 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.427495 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91827) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 15:36:32.427579 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.427772 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.427854 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.428048 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.428201 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.428322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.428492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.428594 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.428763 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.428978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.429068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.429254 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.429345 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.429533 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.429660 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.429801 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.429905 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.430095 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.430176 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.430368 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.430448 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91828) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.430648 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.430923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.431192 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91827) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 15:36:32.469547 dv-cinder-835384-9-smb devstack@keystone.service[91828]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559d4cb119c0 pid: 91828 (default app) Jun 23 15:36:32.469997 dv-cinder-835384-9-smb devstack@keystone.service[91827]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559d4cb119c0 pid: 91827 (default app) Jun 23 15:36:32.473011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec11dd9-4d5f-4c69-a83c-71caf6615a84 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:32.473305 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec11dd9-4d5f-4c69-a83c-71caf6615a84 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:32.473583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec11dd9-4d5f-4c69-a83c-71caf6615a84 None None] PATH_INFO: `/v3` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:32.477836 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Thu Jun 23 15:36:32 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:36:40.249595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10908e86-0118-4832-9feb-b53a67459a0d None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:40.250236 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10908e86-0118-4832-9feb-b53a67459a0d None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:40.250236 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10908e86-0118-4832-9feb-b53a67459a0d None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:40.254449 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:36:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:36:40.259986 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e9dc4-b830-4842-89a2-81c9afc2fd81 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:40.260451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e9dc4-b830-4842-89a2-81c9afc2fd81 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:40.260545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e9dc4-b830-4842-89a2-81c9afc2fd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:40.330219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: INFO dbcounter [None req-9f0e9dc4-b830-4842-89a2-81c9afc2fd81 None None] Registered counter for database keystone Jun 23 15:36:40.351457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG oslo_db.sqlalchemy.engines [None req-9f0e9dc4-b830-4842-89a2-81c9afc2fd81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91828) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 15:36:40.357636 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writer thread running {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 15:36:40.536383 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG passlib.handlers.bcrypt [None req-9f0e9dc4-b830-4842-89a2-81c9afc2fd81 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91828) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 15:36:40.536721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG passlib.handlers.bcrypt [None req-9f0e9dc4-b830-4842-89a2-81c9afc2fd81 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91828) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 15:36:40.591266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-9f0e9dc4-b830-4842-89a2-81c9afc2fd81 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:36:40.592893 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-9f0e9dc4-b830-4842-89a2-81c9afc2fd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:36:40.714516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:36:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 23 15:36:40.860345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10908e86-0118-4832-9feb-b53a67459a0d None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:40.929751 dv-cinder-835384-9-smb devstack@keystone.service[91827]: INFO dbcounter [None req-10908e86-0118-4832-9feb-b53a67459a0d None None] Registered counter for database keystone Jun 23 15:36:40.949709 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG oslo_db.sqlalchemy.engines [None req-10908e86-0118-4832-9feb-b53a67459a0d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91827) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 15:36:40.956035 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writer thread running {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 15:36:41.076180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10908e86-0118-4832-9feb-b53a67459a0d None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:41.081191 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7bc59-b5a0-4567-90f7-0ed94868c9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:41.081877 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7bc59-b5a0-4567-90f7-0ed94868c9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:41.082170 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7bc59-b5a0-4567-90f7-0ed94868c9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:41.082487 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7bc59-b5a0-4567-90f7-0ed94868c9e7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:41.091398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7bc59-b5a0-4567-90f7-0ed94868c9e7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:41.143899 dv-cinder-835384-9-smb devstack@keystone.service[91827]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9be7bc59-b5a0-4567-90f7-0ed94868c9e7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 15:36:41.144158 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7bc59-b5a0-4567-90f7-0ed94868c9e7 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:41.154814 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Thu Jun 23 15:36:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 15:36:41.160759 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e9dc4-b830-4842-89a2-81c9afc2fd81 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:41.175350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e9dc4-b830-4842-89a2-81c9afc2fd81 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:41.179827 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd775d9-3112-4225-b671-62acc774a8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:41.180945 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd775d9-3112-4225-b671-62acc774a8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:41.181228 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd775d9-3112-4225-b671-62acc774a8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:41.181505 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd775d9-3112-4225-b671-62acc774a8e6 admin admin] PATH_INFO: `/v3/projects/a90cb52bb0ee4522ac438c1991f3a531` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:41.185626 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd775d9-3112-4225-b671-62acc774a8e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=a90cb52bb0ee4522ac438c1991f3a531)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:41.236346 dv-cinder-835384-9-smb devstack@keystone.service[91828]: WARNING keystone.common.rbac_enforcer.enforcer [None req-acd775d9-3112-4225-b671-62acc774a8e6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 15:36:41.236694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd775d9-3112-4225-b671-62acc774a8e6 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:41.241384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Thu Jun 23 15:36:41 2022] GET /identity/v3/projects/a90cb52bb0ee4522ac438c1991f3a531 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:36:43.240910 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b752aae-e060-4aca-b0f4-b152b4f7c6ba None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:43.241712 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b752aae-e060-4aca-b0f4-b152b4f7c6ba None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:43.241712 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b752aae-e060-4aca-b0f4-b152b4f7c6ba None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:43.245537 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:36:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:36:43.251525 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d71f6-cb54-4742-bcb1-0fbee9d87f18 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:43.251936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d71f6-cb54-4742-bcb1-0fbee9d87f18 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:43.252083 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d71f6-cb54-4742-bcb1-0fbee9d87f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:43.270682 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-166d71f6-cb54-4742-bcb1-0fbee9d87f18 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:36:43.272201 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-166d71f6-cb54-4742-bcb1-0fbee9d87f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:36:43.282051 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:36:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 23 15:36:43.304819 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b752aae-e060-4aca-b0f4-b152b4f7c6ba None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:43.317751 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b752aae-e060-4aca-b0f4-b152b4f7c6ba None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:43.322004 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b8b47-b32c-4f31-bfeb-bf90f4813f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:43.322639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b8b47-b32c-4f31-bfeb-bf90f4813f6c admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:43.322922 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b8b47-b32c-4f31-bfeb-bf90f4813f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:43.323199 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b8b47-b32c-4f31-bfeb-bf90f4813f6c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:43.333441 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b8b47-b32c-4f31-bfeb-bf90f4813f6c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:43.335230 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b8b47-b32c-4f31-bfeb-bf90f4813f6c admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:43.344652 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Thu Jun 23 15:36:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 15:36:43.350447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d71f6-cb54-4742-bcb1-0fbee9d87f18 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:43.360127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d71f6-cb54-4742-bcb1-0fbee9d87f18 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:43.364666 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57301df-f6e8-40ec-94d9-faee68142577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:43.365530 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57301df-f6e8-40ec-94d9-faee68142577 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:43.365815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57301df-f6e8-40ec-94d9-faee68142577 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:43.366125 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57301df-f6e8-40ec-94d9-faee68142577 admin admin] PATH_INFO: `/v3/users/25bea438d9bc4701a8ff368969074002` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:43.367526 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57301df-f6e8-40ec-94d9-faee68142577 admin admin] RBAC: Authorizing `identity:get_user(user_id=25bea438d9bc4701a8ff368969074002)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:43.369332 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57301df-f6e8-40ec-94d9-faee68142577 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:43.370938 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Thu Jun 23 15:36:43 2022] GET /identity/v3/users/25bea438d9bc4701a8ff368969074002 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:36:45.465616 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfe49f-8dc2-46bf-8ed2-925f239e7601 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:45.466202 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfe49f-8dc2-46bf-8ed2-925f239e7601 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:45.466202 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfe49f-8dc2-46bf-8ed2-925f239e7601 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:45.468138 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:36:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:36:45.473489 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717313fc-808a-410c-9f98-d0c7b9491cbd None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:45.473930 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717313fc-808a-410c-9f98-d0c7b9491cbd None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:45.474101 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717313fc-808a-410c-9f98-d0c7b9491cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:45.482328 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6d206-392c-426e-ad26-a3977f27d4c7 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:45.482619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6d206-392c-426e-ad26-a3977f27d4c7 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:45.482926 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c6d206-392c-426e-ad26-a3977f27d4c7 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:45.484229 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:36:45.489036 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b6b6f-3b98-486d-88fd-73c9343be6d8 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:45.489321 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b6b6f-3b98-486d-88fd-73c9343be6d8 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:45.489600 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b6b6f-3b98-486d-88fd-73c9343be6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:45.490349 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-717313fc-808a-410c-9f98-d0c7b9491cbd None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:36:45.491526 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-717313fc-808a-410c-9f98-d0c7b9491cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:36:45.528335 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG passlib.handlers.bcrypt [None req-440b6b6f-3b98-486d-88fd-73c9343be6d8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=91827) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 15:36:45.528756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG passlib.handlers.bcrypt [None req-440b6b6f-3b98-486d-88fd-73c9343be6d8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91827) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 15:36:45.574458 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:36:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:36:45.574596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-440b6b6f-3b98-486d-88fd-73c9343be6d8 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:36:45.576151 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-440b6b6f-3b98-486d-88fd-73c9343be6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:36:45.598218 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717313fc-808a-410c-9f98-d0c7b9491cbd None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:45.621044 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:45.673906 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:36:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 15:36:45.696934 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b6b6f-3b98-486d-88fd-73c9343be6d8 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:45.700856 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717313fc-808a-410c-9f98-d0c7b9491cbd None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:45.734226 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b91e8-1daf-483d-b622-292155af7672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:45.734944 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b91e8-1daf-483d-b622-292155af7672 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:45.735234 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b91e8-1daf-483d-b622-292155af7672 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:45.735512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b91e8-1daf-483d-b622-292155af7672 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:45.746395 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b91e8-1daf-483d-b622-292155af7672 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:36:45.758447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-df8b91e8-1daf-483d-b622-292155af7672 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:36:45.758447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:36:45.758447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:36:45.758447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:36:45.758447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:36:45.758447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:36:45.758447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:36:45.758447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:36:45.758447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:36:45.758447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:36:45.758447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:36:45.758447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:36:45.758447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:36:45.758447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:36:45.758447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:36:45.758447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:36:45.759364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:36:45.759364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:36:45.759364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:36:45.759364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:36:45.759364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:36:45.759364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:36:45.759364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:36:45.759364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:36:45.759364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:36:45.759364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:36:45.759364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:36:45.759364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:36:45.759364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:36:45.759364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:36:45.759364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:36:45.759364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:36:45.760159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:36:45.760159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:36:45.760159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:36:45.760159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:36:45.760159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:36:45.760159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:36:45.760159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:36:45.760159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:36:45.760159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:36:45.760159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:36:45.760159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:36:45.760159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:36:45.760159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:36:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:36:45.766042 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b91e8-1daf-483d-b622-292155af7672 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:45.797507 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b6b6f-3b98-486d-88fd-73c9343be6d8 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:45.799896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:45.837669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388087f-e298-426a-bbd8-6bd8d38abe78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:45.838584 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388087f-e298-426a-bbd8-6bd8d38abe78 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:45.838876 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388087f-e298-426a-bbd8-6bd8d38abe78 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:45.839159 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388087f-e298-426a-bbd8-6bd8d38abe78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:45.846923 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:45.865252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b91e8-1daf-483d-b622-292155af7672 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:45.898533 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ced15-5b26-40af-8774-0faba8b8728e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:45.899448 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ced15-5b26-40af-8774-0faba8b8728e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:45.899737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ced15-5b26-40af-8774-0faba8b8728e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:45.900016 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ced15-5b26-40af-8774-0faba8b8728e None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:45.900768 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ced15-5b26-40af-8774-0faba8b8728e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:36:45.901082 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ced15-5b26-40af-8774-0faba8b8728e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:45.902501 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ced15-5b26-40af-8774-0faba8b8728e None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:45.905905 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388087f-e298-426a-bbd8-6bd8d38abe78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:45.907389 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388087f-e298-426a-bbd8-6bd8d38abe78 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:45.913911 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 8/15] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:36:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:36:45.919323 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ced15-5b26-40af-8774-0faba8b8728e None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:46.006758 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 8/16] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:36:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 15:36:46.012405 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388087f-e298-426a-bbd8-6bd8d38abe78 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:46.015221 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:46.022588 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ced15-5b26-40af-8774-0faba8b8728e None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:46.055963 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bf118-58db-4a19-8e94-cdde8850420c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:46.056827 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bf118-58db-4a19-8e94-cdde8850420c None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:46.057108 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bf118-58db-4a19-8e94-cdde8850420c None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:46.057380 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bf118-58db-4a19-8e94-cdde8850420c None admin] PATH_INFO: `/v3/users/25bea438d9bc4701a8ff368969074002` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:46.058592 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bf118-58db-4a19-8e94-cdde8850420c None admin] RBAC: Authorizing `identity:get_user(user_id=25bea438d9bc4701a8ff368969074002)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:46.060040 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bf118-58db-4a19-8e94-cdde8850420c None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:46.062554 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 9/17] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:36:45 2022] GET /identity/v3/users/25bea438d9bc4701a8ff368969074002 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:36:46.068031 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bf118-58db-4a19-8e94-cdde8850420c None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:46.082631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:46.111885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388087f-e298-426a-bbd8-6bd8d38abe78 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:46.145509 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52058a-ad1a-4350-8890-1d1abe7cabfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:46.146338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52058a-ad1a-4350-8890-1d1abe7cabfe None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:46.146630 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52058a-ad1a-4350-8890-1d1abe7cabfe None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:46.146912 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52058a-ad1a-4350-8890-1d1abe7cabfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:46.166314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bf118-58db-4a19-8e94-cdde8850420c None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:46.167252 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe52058a-ad1a-4350-8890-1d1abe7cabfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:46.168767 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe52058a-ad1a-4350-8890-1d1abe7cabfe None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:46.189009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-fe52058a-ad1a-4350-8890-1d1abe7cabfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:36:46.189009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:36:46.189009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:36:46.189009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:36:46.189009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:36:46.189009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:36:46.189009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:36:46.189009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:36:46.189009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:36:46.189009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:36:46.189009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:36:46.189009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:36:46.189009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:36:46.189009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:36:46.189009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:36:46.189961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:36:46.189961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:36:46.189961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:36:46.189961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:36:46.189961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:36:46.189961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:36:46.189961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:36:46.189961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:36:46.189961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:36:46.189961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:36:46.189961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:36:46.189961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:36:46.189961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:36:46.189961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:36:46.189961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:36:46.189961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:36:46.189961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:36:46.190740 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:36:46.190740 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:36:46.190740 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:36:46.190740 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:36:46.190740 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 9/18] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:36:46.195931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52058a-ad1a-4350-8890-1d1abe7cabfe None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:46.200845 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70338fc9-9b11-49c6-8ba8-b4ff581eb56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:46.202183 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70338fc9-9b11-49c6-8ba8-b4ff581eb56a None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:46.202469 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70338fc9-9b11-49c6-8ba8-b4ff581eb56a None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:46.202743 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70338fc9-9b11-49c6-8ba8-b4ff581eb56a None admin] PATH_INFO: `/v3/domains/default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:46.203917 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70338fc9-9b11-49c6-8ba8-b4ff581eb56a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:46.205352 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70338fc9-9b11-49c6-8ba8-b4ff581eb56a None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:46.207058 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 10/19] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:36:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:36:46.212481 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70338fc9-9b11-49c6-8ba8-b4ff581eb56a None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:46.253067 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:46.297027 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:46.297320 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52058a-ad1a-4350-8890-1d1abe7cabfe None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:46.316981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70338fc9-9b11-49c6-8ba8-b4ff581eb56a None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:46.330988 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ab11b-e350-47e7-a73e-226985f0014b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:46.331651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ab11b-e350-47e7-a73e-226985f0014b None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:46.331938 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ab11b-e350-47e7-a73e-226985f0014b None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:46.332215 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ab11b-e350-47e7-a73e-226985f0014b None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:46.332967 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ab11b-e350-47e7-a73e-226985f0014b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:36:46.333278 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ab11b-e350-47e7-a73e-226985f0014b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:46.334695 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ab11b-e350-47e7-a73e-226985f0014b None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:46.350426 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70b95e-4748-490d-977a-d031ae399e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:46.351083 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70b95e-4748-490d-977a-d031ae399e87 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:46.351365 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70b95e-4748-490d-977a-d031ae399e87 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:46.351640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70b95e-4748-490d-977a-d031ae399e87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:46.352363 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 10/20] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:36:46.352476 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70b95e-4748-490d-977a-d031ae399e87 None admin] RBAC: Adding query filter params (role.id=abdc0e0957534149b3653eaa33cbd054, scope.domain.id=default, user.id=25bea438d9bc4701a8ff368969074002) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:36:46.352776 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70b95e-4748-490d-977a-d031ae399e87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:46.354227 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70b95e-4748-490d-977a-d031ae399e87 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:46.362160 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 11/21] 10.222.0.15 () {56 vars in 1322 bytes} [Thu Jun 23 15:36:46 2022] GET /identity/v3/role_assignments?user.id=25bea438d9bc4701a8ff368969074002&scope.domain.id=default&role.id=abdc0e0957534149b3653eaa33cbd054 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:36:48.792619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f475f2-f011-4bc7-86ac-4a098eef5aeb None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:48.793123 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f475f2-f011-4bc7-86ac-4a098eef5aeb None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:48.793194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f475f2-f011-4bc7-86ac-4a098eef5aeb None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:48.794728 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 11/22] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:36:48.800603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661821ec-c03f-4875-a6b9-d398e690f53c None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:48.801455 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661821ec-c03f-4875-a6b9-d398e690f53c None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:48.801995 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661821ec-c03f-4875-a6b9-d398e690f53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:48.827506 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-661821ec-c03f-4875-a6b9-d398e690f53c None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:36:48.829032 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-661821ec-c03f-4875-a6b9-d398e690f53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:36:48.920656 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 12/23] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:36:48.966130 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f475f2-f011-4bc7-86ac-4a098eef5aeb None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:49.006692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ae747-540d-49bf-aab3-fd9e42d1ed1d None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:49.007319 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ae747-540d-49bf-aab3-fd9e42d1ed1d None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:49.007824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ae747-540d-49bf-aab3-fd9e42d1ed1d None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:49.009675 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:36:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:36:49.015864 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea5656-3fc6-430e-8124-4da783cf4273 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:49.016428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea5656-3fc6-430e-8124-4da783cf4273 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:49.016924 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea5656-3fc6-430e-8124-4da783cf4273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:49.050435 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-36ea5656-3fc6-430e-8124-4da783cf4273 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:36:49.052099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-36ea5656-3fc6-430e-8124-4da783cf4273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:36:49.145748 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 14/25] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:36:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 15:36:49.147654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cf1aa-ea52-4892-a631-afab95fdbfe8 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:49.148091 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cf1aa-ea52-4892-a631-afab95fdbfe8 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:49.148535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cf1aa-ea52-4892-a631-afab95fdbfe8 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:49.148780 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f475f2-f011-4bc7-86ac-4a098eef5aeb None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:49.150299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 15/26] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:36:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:36:49.151695 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc333d-39bf-497f-aad9-b58fba164bd3 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:49.151995 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc333d-39bf-497f-aad9-b58fba164bd3 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:49.152281 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc333d-39bf-497f-aad9-b58fba164bd3 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:49.154693 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 16/27] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:36:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:36:49.160178 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4437f47-f9e8-4e85-9a21-0d470a990b00 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:49.160178 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4437f47-f9e8-4e85-9a21-0d470a990b00 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:49.160178 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4437f47-f9e8-4e85-9a21-0d470a990b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:49.162942 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:49.175060 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:49.176805 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-f4437f47-f9e8-4e85-9a21-0d470a990b00 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:36:49.178431 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-f4437f47-f9e8-4e85-9a21-0d470a990b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:36:49.196918 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4da79-2c76-4492-bfd7-c2bd607b5ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:49.198060 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4da79-2c76-4492-bfd7-c2bd607b5ace None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:49.198538 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4da79-2c76-4492-bfd7-c2bd607b5ace None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:49.199114 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4da79-2c76-4492-bfd7-c2bd607b5ace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:49.211744 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4da79-2c76-4492-bfd7-c2bd607b5ace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:49.213605 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de4da79-2c76-4492-bfd7-c2bd607b5ace None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:49.232775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-5de4da79-2c76-4492-bfd7-c2bd607b5ace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:36:49.232775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:36:49.232775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:36:49.232775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:36:49.232775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:36:49.232775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:36:49.232775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:36:49.232775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:36:49.232775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:36:49.232775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:36:49.232775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:36:49.232775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:36:49.232775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:36:49.232775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:36:49.232775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:36:49.233626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:36:49.233626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:36:49.233626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:36:49.233626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:36:49.233626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:36:49.233626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:36:49.233626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:36:49.233626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:36:49.233626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:36:49.233626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:36:49.233626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:36:49.233626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:36:49.233626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:36:49.233626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:36:49.233626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:36:49.233626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:36:49.233626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:36:49.234794 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:36:49.234794 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:36:49.234794 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:36:49.234794 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:36:49.236531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 12/28] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:36:49.238013 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be9512-2e2d-4842-af56-66a636dd0917 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:49.238497 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be9512-2e2d-4842-af56-66a636dd0917 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:49.238976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be9512-2e2d-4842-af56-66a636dd0917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:49.258002 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-f5be9512-2e2d-4842-af56-66a636dd0917 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:36:49.259548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-f5be9512-2e2d-4842-af56-66a636dd0917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:36:49.260398 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 17/29] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:36:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:36:49.261130 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4437f47-f9e8-4e85-9a21-0d470a990b00 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:49.343536 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 13/30] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:36:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:36:49.344554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be9512-2e2d-4842-af56-66a636dd0917 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:49.387629 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4437f47-f9e8-4e85-9a21-0d470a990b00 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:49.430910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da5f3f-780c-4bad-86e0-50402fdc7586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:49.431965 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da5f3f-780c-4bad-86e0-50402fdc7586 None admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:49.432565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da5f3f-780c-4bad-86e0-50402fdc7586 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:49.433047 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da5f3f-780c-4bad-86e0-50402fdc7586 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:49.434142 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da5f3f-780c-4bad-86e0-50402fdc7586 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:49.435950 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da5f3f-780c-4bad-86e0-50402fdc7586 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:49.439384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:49.476985 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:49.481311 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be9512-2e2d-4842-af56-66a636dd0917 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:49.519778 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c6291-3be9-4f9b-9817-db5d4799725f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:49.520454 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c6291-3be9-4f9b-9817-db5d4799725f None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:49.520745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c6291-3be9-4f9b-9817-db5d4799725f None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:49.521030 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c6291-3be9-4f9b-9817-db5d4799725f None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:49.521757 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c6291-3be9-4f9b-9817-db5d4799725f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:36:49.522147 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c6291-3be9-4f9b-9817-db5d4799725f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:49.523601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c6291-3be9-4f9b-9817-db5d4799725f None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:49.536950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 14/31] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:36:49.537876 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c6291-3be9-4f9b-9817-db5d4799725f None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:49.569763 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 18/32] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Jun 23 15:36:49 2022] POST /identity/v3/roles => generated 219 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:36:49.571086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da5f3f-780c-4bad-86e0-50402fdc7586 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:49.686682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c6291-3be9-4f9b-9817-db5d4799725f None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:49.727484 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37e38c-1b6d-4f69-a65c-6ab8038f1296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:49.728701 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37e38c-1b6d-4f69-a65c-6ab8038f1296 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:49.729182 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37e38c-1b6d-4f69-a65c-6ab8038f1296 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:49.729647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37e38c-1b6d-4f69-a65c-6ab8038f1296 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:49.744053 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af37e38c-1b6d-4f69-a65c-6ab8038f1296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:36:49.754345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-af37e38c-1b6d-4f69-a65c-6ab8038f1296 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:36:49.754345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:36:49.754345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:36:49.754345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:36:49.754345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:36:49.754345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:36:49.754345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:36:49.754345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:36:49.754345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:36:49.754345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:36:49.754345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:36:49.754345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:36:49.754345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:36:49.754345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:36:49.754345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:36:49.754345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:36:49.755248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:36:49.755248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:36:49.755248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:36:49.755248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:36:49.755248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:36:49.755248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:36:49.755248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:36:49.755248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:36:49.755248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:36:49.755248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:36:49.755248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:36:49.755248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:36:49.755248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:36:49.755248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:36:49.755248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:36:49.755248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:36:49.755978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:36:49.755978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:36:49.755978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:36:49.755978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:36:49.755978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:36:49.755978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:36:49.755978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:36:49.755978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:36:49.755978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:36:49.755978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:36:49.755978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:36:49.755978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:36:49.758765 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 15/33] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:36:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:36:49.759833 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37e38c-1b6d-4f69-a65c-6ab8038f1296 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:49.781478 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:49.818645 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da5f3f-780c-4bad-86e0-50402fdc7586 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:49.859046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f878ef3-6b4a-4db6-89d7-177fa5f4f122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:49.859709 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f878ef3-6b4a-4db6-89d7-177fa5f4f122 None admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:49.859995 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f878ef3-6b4a-4db6-89d7-177fa5f4f122 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:49.860338 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f878ef3-6b4a-4db6-89d7-177fa5f4f122 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:49.861676 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f878ef3-6b4a-4db6-89d7-177fa5f4f122 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:49.863251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f878ef3-6b4a-4db6-89d7-177fa5f4f122 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:49.879451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 19/34] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Jun 23 15:36:49 2022] POST /identity/v3/roles => generated 225 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:36:49.879889 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37e38c-1b6d-4f69-a65c-6ab8038f1296 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:49.880331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f878ef3-6b4a-4db6-89d7-177fa5f4f122 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:49.921344 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72b129-8bc3-4276-8c7d-18bd17fedf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:49.922455 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72b129-8bc3-4276-8c7d-18bd17fedf63 None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:49.922941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72b129-8bc3-4276-8c7d-18bd17fedf63 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:49.923445 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72b129-8bc3-4276-8c7d-18bd17fedf63 None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:49.924642 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72b129-8bc3-4276-8c7d-18bd17fedf63 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:49.926413 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72b129-8bc3-4276-8c7d-18bd17fedf63 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:49.974576 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:50.048448 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f878ef3-6b4a-4db6-89d7-177fa5f4f122 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:50.076076 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 16/35] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 23 15:36:49 2022] POST /identity/v3/projects => generated 301 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:36:50.125420 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd15cc-9690-4814-bc16-b8f8a5dbafdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:50.126159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd15cc-9690-4814-bc16-b8f8a5dbafdd None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:50.126453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd15cc-9690-4814-bc16-b8f8a5dbafdd None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:50.126739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd15cc-9690-4814-bc16-b8f8a5dbafdd None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:50.127518 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd15cc-9690-4814-bc16-b8f8a5dbafdd None admin] RBAC: Adding query filter params (name=admin) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:36:50.127832 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd15cc-9690-4814-bc16-b8f8a5dbafdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:50.129336 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd15cc-9690-4814-bc16-b8f8a5dbafdd None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:50.144043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 20/36] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:36:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:36:50.150235 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72b129-8bc3-4276-8c7d-18bd17fedf63 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:50.250412 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:50.284965 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72b129-8bc3-4276-8c7d-18bd17fedf63 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:50.321210 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf6f6d-2bc0-44e5-86bf-57a9d625e463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:50.322503 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf6f6d-2bc0-44e5-86bf-57a9d625e463 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:50.322940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf6f6d-2bc0-44e5-86bf-57a9d625e463 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:50.323221 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf6f6d-2bc0-44e5-86bf-57a9d625e463 None admin] PATH_INFO: `/v3/users/25bea438d9bc4701a8ff368969074002` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:50.324765 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf6f6d-2bc0-44e5-86bf-57a9d625e463 None admin] RBAC: Authorizing `identity:get_user(user_id=25bea438d9bc4701a8ff368969074002)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:50.326360 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf6f6d-2bc0-44e5-86bf-57a9d625e463 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:50.328905 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 17/37] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:36:50 2022] GET /identity/v3/users/25bea438d9bc4701a8ff368969074002 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:36:50.334068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd15cc-9690-4814-bc16-b8f8a5dbafdd None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:50.427370 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7cc3a-4a6b-4896-88a5-63580236ee14 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:50.427689 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7cc3a-4a6b-4896-88a5-63580236ee14 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:50.427955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7cc3a-4a6b-4896-88a5-63580236ee14 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:50.429583 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 18/38] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:36:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:36:50.436567 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36139e6e-046f-4d60-83e4-ab47f3bc3cd2 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:50.437836 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36139e6e-046f-4d60-83e4-ab47f3bc3cd2 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:50.438361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36139e6e-046f-4d60-83e4-ab47f3bc3cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:50.462868 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd15cc-9690-4814-bc16-b8f8a5dbafdd None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:50.468872 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-36139e6e-046f-4d60-83e4-ab47f3bc3cd2 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:36:50.470570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-36139e6e-046f-4d60-83e4-ab47f3bc3cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:36:50.481563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:50.503953 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1776f15-96db-4e54-8970-e190bca9c3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:50.504691 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1776f15-96db-4e54-8970-e190bca9c3d7 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:50.504981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1776f15-96db-4e54-8970-e190bca9c3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:50.505253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1776f15-96db-4e54-8970-e190bca9c3d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:50.506552 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1776f15-96db-4e54-8970-e190bca9c3d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:50.508025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1776f15-96db-4e54-8970-e190bca9c3d7 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:50.509651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 21/39] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:36:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:36:50.511002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01b670-d39a-4d78-8839-73db1da16cc9 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:50.511446 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01b670-d39a-4d78-8839-73db1da16cc9 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:50.511586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01b670-d39a-4d78-8839-73db1da16cc9 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:50.512988 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 22/40] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:36:50.515305 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01b670-d39a-4d78-8839-73db1da16cc9 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:50.549380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 19/41] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:36:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 15:36:50.550228 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b511f-448f-46e0-8ed9-3005f5834452 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:50.550523 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b511f-448f-46e0-8ed9-3005f5834452 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:50.550802 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b511f-448f-46e0-8ed9-3005f5834452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:50.570118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-ea4b511f-448f-46e0-8ed9-3005f5834452 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:36:50.570548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-ea4b511f-448f-46e0-8ed9-3005f5834452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:36:50.635847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01b670-d39a-4d78-8839-73db1da16cc9 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:50.636279 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:50.644338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 20/42] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:36:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:36:50.644938 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b511f-448f-46e0-8ed9-3005f5834452 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:50.676134 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f027e-7b8d-4356-a3e6-9ad8f51bc7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:50.677056 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f027e-7b8d-4356-a3e6-9ad8f51bc7bf None admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:50.677343 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f027e-7b8d-4356-a3e6-9ad8f51bc7bf None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:50.677633 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f027e-7b8d-4356-a3e6-9ad8f51bc7bf None admin] PATH_INFO: `/v3/domains/default/users/25bea438d9bc4701a8ff368969074002/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:50.679784 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f027e-7b8d-4356-a3e6-9ad8f51bc7bf None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=25bea438d9bc4701a8ff368969074002, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:50.681341 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f027e-7b8d-4356-a3e6-9ad8f51bc7bf None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:50.697808 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 23/43] 10.222.0.15 () {58 vars in 1361 bytes} [Thu Jun 23 15:36:50 2022] PUT /identity/v3/domains/default/users/25bea438d9bc4701a8ff368969074002/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:36:50.699100 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f027e-7b8d-4356-a3e6-9ad8f51bc7bf None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:50.762010 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:50.793409 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b511f-448f-46e0-8ed9-3005f5834452 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:50.846559 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f027e-7b8d-4356-a3e6-9ad8f51bc7bf None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:50.855227 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9df9d8-7c66-49a3-8ed4-6b24737723fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:50.856169 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9df9d8-7c66-49a3-8ed4-6b24737723fa None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:50.856586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9df9d8-7c66-49a3-8ed4-6b24737723fa None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:50.857501 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9df9d8-7c66-49a3-8ed4-6b24737723fa None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:50.859726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9df9d8-7c66-49a3-8ed4-6b24737723fa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:50.861353 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9df9d8-7c66-49a3-8ed4-6b24737723fa None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:50.879609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 21/44] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Jun 23 15:36:50 2022] POST /identity/v3/roles => generated 223 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:36:50.891015 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb65d47-7791-4666-98ef-f0f55da4ec7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:50.891584 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb65d47-7791-4666-98ef-f0f55da4ec7c None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:50.891946 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb65d47-7791-4666-98ef-f0f55da4ec7c None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:50.892322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb65d47-7791-4666-98ef-f0f55da4ec7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:50.893761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb65d47-7791-4666-98ef-f0f55da4ec7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:50.895414 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb65d47-7791-4666-98ef-f0f55da4ec7c None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:50.897493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 24/45] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:36:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:36:50.903692 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9df9d8-7c66-49a3-8ed4-6b24737723fa None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:50.976143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:51.030816 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9df9d8-7c66-49a3-8ed4-6b24737723fa None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:51.070511 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499734e-35ab-44c6-b509-fea4e21e1033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:51.071198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499734e-35ab-44c6-b509-fea4e21e1033 None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:51.071491 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499734e-35ab-44c6-b509-fea4e21e1033 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:51.071776 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499734e-35ab-44c6-b509-fea4e21e1033 None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:51.072522 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499734e-35ab-44c6-b509-fea4e21e1033 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:51.074026 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499734e-35ab-44c6-b509-fea4e21e1033 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:51.102762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 22/46] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 23 15:36:50 2022] POST /identity/v3/projects => generated 312 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:36:52.740247 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ab5a3-65fa-4e3b-ab39-573d55126417 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:52.740759 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ab5a3-65fa-4e3b-ab39-573d55126417 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:52.740933 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ab5a3-65fa-4e3b-ab39-573d55126417 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:52.742349 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 25/47] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:36:52.747559 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2899612-44e4-469d-b0a3-2d2f6f41e73c None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:52.748015 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2899612-44e4-469d-b0a3-2d2f6f41e73c None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:52.748280 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2899612-44e4-469d-b0a3-2d2f6f41e73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:52.772399 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-c2899612-44e4-469d-b0a3-2d2f6f41e73c None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:36:52.773586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-c2899612-44e4-469d-b0a3-2d2f6f41e73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:36:52.841703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 23/48] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:36:52.865271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ab5a3-65fa-4e3b-ab39-573d55126417 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:53.078793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ab5a3-65fa-4e3b-ab39-573d55126417 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:53.092388 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:53.112933 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f27fc14-a29c-4188-993b-725e5ea1ac7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:53.113730 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27fc14-a29c-4188-993b-725e5ea1ac7e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:53.114050 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27fc14-a29c-4188-993b-725e5ea1ac7e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:53.114335 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f27fc14-a29c-4188-993b-725e5ea1ac7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:53.125462 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f27fc14-a29c-4188-993b-725e5ea1ac7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:36:53.133119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-8f27fc14-a29c-4188-993b-725e5ea1ac7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:36:53.133119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:36:53.133119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:36:53.133119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:36:53.133119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:36:53.133119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:36:53.133119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:36:53.133119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:36:53.133119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:36:53.133119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:36:53.133119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:36:53.133119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:36:53.133119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:36:53.133119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:36:53.133119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:36:53.133119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:36:53.134102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:36:53.134102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:36:53.134102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:36:53.134102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:36:53.134102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:36:53.134102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:36:53.134102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:36:53.134102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:36:53.134102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:36:53.134102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:36:53.134102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:36:53.134102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:36:53.134102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:36:53.134102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:36:53.134102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:36:53.134102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:36:53.134838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:36:53.134838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:36:53.134838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:36:53.134838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:36:53.134838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:36:53.134838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:36:53.134838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:36:53.134838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:36:53.134838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:36:53.134838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:36:53.134838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:36:53.134838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:36:53.134838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 26/49] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:36:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:36:53.140922 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2899612-44e4-469d-b0a3-2d2f6f41e73c None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:53.160375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143dc1a-3c3d-4140-aab2-23fd321959c2 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:53.160667 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143dc1a-3c3d-4140-aab2-23fd321959c2 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:53.160949 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143dc1a-3c3d-4140-aab2-23fd321959c2 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:53.162348 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 27/50] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:36:53.167251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd03ac8-ddc7-48b5-8265-e9b1ded778e8 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:53.167546 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd03ac8-ddc7-48b5-8265-e9b1ded778e8 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:53.167830 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd03ac8-ddc7-48b5-8265-e9b1ded778e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:53.183585 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:53.185399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-dcd03ac8-ddc7-48b5-8265-e9b1ded778e8 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:36:53.187499 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-dcd03ac8-ddc7-48b5-8265-e9b1ded778e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:36:53.252619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2899612-44e4-469d-b0a3-2d2f6f41e73c None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:53.258490 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 28/51] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 15:36:53.282587 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd03ac8-ddc7-48b5-8265-e9b1ded778e8 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:53.286605 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e5008-5df6-4e4b-8800-4060ddda44cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:53.287294 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e5008-5df6-4e4b-8800-4060ddda44cc None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:53.287582 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e5008-5df6-4e4b-8800-4060ddda44cc None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:53.287866 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e5008-5df6-4e4b-8800-4060ddda44cc None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:53.288624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e5008-5df6-4e4b-8800-4060ddda44cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:36:53.288937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e5008-5df6-4e4b-8800-4060ddda44cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:53.290374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e5008-5df6-4e4b-8800-4060ddda44cc None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:53.303343 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 24/52] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:36:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:36:53.308613 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e5008-5df6-4e4b-8800-4060ddda44cc None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:53.382232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd03ac8-ddc7-48b5-8265-e9b1ded778e8 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:53.383830 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:53.419255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8cd00-bde8-4d85-8120-fb6e98560793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:53.420077 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8cd00-bde8-4d85-8120-fb6e98560793 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:53.420529 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8cd00-bde8-4d85-8120-fb6e98560793 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:53.420806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8cd00-bde8-4d85-8120-fb6e98560793 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:53.422100 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8cd00-bde8-4d85-8120-fb6e98560793 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:53.423573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8cd00-bde8-4d85-8120-fb6e98560793 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:53.425281 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 29/53] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:36:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:36:53.431094 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8cd00-bde8-4d85-8120-fb6e98560793 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:53.523397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e5008-5df6-4e4b-8800-4060ddda44cc None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:53.525512 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:53.563670 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df682fc3-314c-4fc4-917e-8bfca30c262b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:53.565088 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df682fc3-314c-4fc4-917e-8bfca30c262b None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:53.565500 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df682fc3-314c-4fc4-917e-8bfca30c262b None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:53.566027 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df682fc3-314c-4fc4-917e-8bfca30c262b None admin] PATH_INFO: `/v3/users/25bea438d9bc4701a8ff368969074002` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:53.567057 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8cd00-bde8-4d85-8120-fb6e98560793 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:53.568056 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df682fc3-314c-4fc4-917e-8bfca30c262b None admin] RBAC: Authorizing `identity:get_user(user_id=25bea438d9bc4701a8ff368969074002)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:53.570592 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df682fc3-314c-4fc4-917e-8bfca30c262b None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:53.577572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 25/54] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:36:53 2022] GET /identity/v3/users/25bea438d9bc4701a8ff368969074002 => generated 247 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:36:53.578593 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df682fc3-314c-4fc4-917e-8bfca30c262b None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:53.601490 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8d454-2391-453d-b943-e735edd0a003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:53.602189 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8d454-2391-453d-b943-e735edd0a003 None admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:53.602487 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8d454-2391-453d-b943-e735edd0a003 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:53.602772 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8d454-2391-453d-b943-e735edd0a003 None admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:53.603494 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8d454-2391-453d-b943-e735edd0a003 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:53.604959 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8d454-2391-453d-b943-e735edd0a003 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:53.632014 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 30/55] 10.222.0.15 () {60 vars in 1140 bytes} [Thu Jun 23 15:36:53 2022] POST /identity/v3/projects => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:36:53.684629 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df682fc3-314c-4fc4-917e-8bfca30c262b None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:53.722034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcdeb9-eb11-4cca-abf4-515dc54b65ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:53.722906 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcdeb9-eb11-4cca-abf4-515dc54b65ac None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:53.723203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcdeb9-eb11-4cca-abf4-515dc54b65ac None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:53.723489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcdeb9-eb11-4cca-abf4-515dc54b65ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:53.724731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcdeb9-eb11-4cca-abf4-515dc54b65ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:53.726261 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcdeb9-eb11-4cca-abf4-515dc54b65ac None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:53.727956 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 26/56] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:36:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:36:53.733880 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8d454-2391-453d-b943-e735edd0a003 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:53.765422 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:53.844326 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8d454-2391-453d-b943-e735edd0a003 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:53.877777 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c665cd-85d1-40b5-9440-22f7fc0f20ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:53.878470 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c665cd-85d1-40b5-9440-22f7fc0f20ba None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:53.878758 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c665cd-85d1-40b5-9440-22f7fc0f20ba None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:53.879038 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c665cd-85d1-40b5-9440-22f7fc0f20ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:53.879874 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c665cd-85d1-40b5-9440-22f7fc0f20ba None admin] RBAC: Adding query filter params (role.id=abdc0e0957534149b3653eaa33cbd054, scope.domain.id=default, user.id=25bea438d9bc4701a8ff368969074002) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:36:53.880190 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c665cd-85d1-40b5-9440-22f7fc0f20ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:53.881687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c665cd-85d1-40b5-9440-22f7fc0f20ba None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:53.891283 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 31/57] 10.222.0.15 () {56 vars in 1322 bytes} [Thu Jun 23 15:36:53 2022] GET /identity/v3/role_assignments?user.id=25bea438d9bc4701a8ff368969074002&scope.domain.id=default&role.id=abdc0e0957534149b3653eaa33cbd054 => generated 530 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:36:55.671221 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7202c81-1621-4343-b0f8-7e68794c812f None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:55.671728 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7202c81-1621-4343-b0f8-7e68794c812f None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:55.671812 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7202c81-1621-4343-b0f8-7e68794c812f None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:55.673155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 27/58] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:36:55.678566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851a41e-0e5d-4d1d-95ef-cb6cc9eed5b5 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:55.678972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851a41e-0e5d-4d1d-95ef-cb6cc9eed5b5 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:55.679144 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851a41e-0e5d-4d1d-95ef-cb6cc9eed5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:55.696193 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-2851a41e-0e5d-4d1d-95ef-cb6cc9eed5b5 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:36:55.697405 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-2851a41e-0e5d-4d1d-95ef-cb6cc9eed5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:36:55.767384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 32/59] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:36:55.791785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7202c81-1621-4343-b0f8-7e68794c812f None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:55.832476 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:55.891498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7202c81-1621-4343-b0f8-7e68794c812f None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:55.924012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef86f03-4cd1-4bb8-a81c-29adb70e724e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:55.924795 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef86f03-4cd1-4bb8-a81c-29adb70e724e None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:55.925088 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef86f03-4cd1-4bb8-a81c-29adb70e724e None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:55.925368 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef86f03-4cd1-4bb8-a81c-29adb70e724e None admin] PATH_INFO: `/v3/domains/default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:55.926557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef86f03-4cd1-4bb8-a81c-29adb70e724e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:55.927995 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef86f03-4cd1-4bb8-a81c-29adb70e724e None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:55.929604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 28/60] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:36:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:36:55.935182 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851a41e-0e5d-4d1d-95ef-cb6cc9eed5b5 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:55.952717 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:56.031858 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2851a41e-0e5d-4d1d-95ef-cb6cc9eed5b5 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:56.064630 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ac4c9-ebf6-461a-8f0a-57fc9a15793d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:56.065304 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ac4c9-ebf6-461a-8f0a-57fc9a15793d None admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:56.065588 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ac4c9-ebf6-461a-8f0a-57fc9a15793d None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:56.065888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ac4c9-ebf6-461a-8f0a-57fc9a15793d None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:56.066632 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ac4c9-ebf6-461a-8f0a-57fc9a15793d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:56.068085 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ac4c9-ebf6-461a-8f0a-57fc9a15793d None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:56.096039 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 33/61] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 23 15:36:55 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:36:59.306849 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9534522-958b-40cd-a95e-c517da1920b2 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:59.307878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9534522-958b-40cd-a95e-c517da1920b2 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:59.308486 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9534522-958b-40cd-a95e-c517da1920b2 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:59.310360 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 29/62] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:36:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:36:59.316224 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3debb-2428-44fc-a5a2-f28c4fd06198 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:59.317146 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3debb-2428-44fc-a5a2-f28c4fd06198 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:59.317627 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3debb-2428-44fc-a5a2-f28c4fd06198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:59.343492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-aed3debb-2428-44fc-a5a2-f28c4fd06198 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:36:59.345037 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-aed3debb-2428-44fc-a5a2-f28c4fd06198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:36:59.360068 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83377e4-2540-4051-aa9c-e982544edb9a None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:59.360673 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83377e4-2540-4051-aa9c-e982544edb9a None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:59.361195 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83377e4-2540-4051-aa9c-e982544edb9a None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:59.363097 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 30/63] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:36:59.383483 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a20e8-699b-48ee-8f82-e55f94983454 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:59.384099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a20e8-699b-48ee-8f82-e55f94983454 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:59.384578 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a20e8-699b-48ee-8f82-e55f94983454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:59.418849 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-9a6a20e8-699b-48ee-8f82-e55f94983454 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:36:59.420092 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-9a6a20e8-699b-48ee-8f82-e55f94983454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:36:59.465052 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 34/64] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:36:59.489490 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3debb-2428-44fc-a5a2-f28c4fd06198 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:59.491716 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:59.523839 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 31/65] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 15:36:59.525654 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219885f6-b123-43e7-8c7e-4cada7c250da None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:59.526140 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219885f6-b123-43e7-8c7e-4cada7c250da None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:59.526572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219885f6-b123-43e7-8c7e-4cada7c250da None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:59.527968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 32/66] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:36:59.533555 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdd5ee-0b3b-4812-8703-f1390dd518dd None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:59.534038 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdd5ee-0b3b-4812-8703-f1390dd518dd None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:59.534549 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdd5ee-0b3b-4812-8703-f1390dd518dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:59.552129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-10bdd5ee-0b3b-4812-8703-f1390dd518dd None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:36:59.553644 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-10bdd5ee-0b3b-4812-8703-f1390dd518dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:36:59.585763 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:59.609131 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3debb-2428-44fc-a5a2-f28c4fd06198 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:59.628769 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 33/67] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 15:36:59.633970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bdd5ee-0b3b-4812-8703-f1390dd518dd None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:59.647486 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724c004-d04c-429b-8bd9-bae799c7bcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:59.647486 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724c004-d04c-429b-8bd9-bae799c7bcbd None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:59.647486 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724c004-d04c-429b-8bd9-bae799c7bcbd None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:59.647486 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724c004-d04c-429b-8bd9-bae799c7bcbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:59.661894 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724c004-d04c-429b-8bd9-bae799c7bcbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:36:59.664686 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-d724c004-d04c-429b-8bd9-bae799c7bcbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:36:59.664686 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:36:59.664686 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:36:59.664686 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:36:59.664686 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:36:59.664686 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:36:59.664686 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:36:59.664686 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:36:59.664686 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:36:59.664686 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:36:59.664686 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:36:59.664686 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:36:59.664686 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:36:59.664686 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:36:59.664686 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:36:59.664686 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:36:59.665524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:36:59.665524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:36:59.665524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:36:59.665524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:36:59.665524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:36:59.665524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:36:59.665524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:36:59.665524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:36:59.665524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:36:59.665524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:36:59.665524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:36:59.665524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:36:59.665524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:36:59.665524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:36:59.665524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:36:59.665524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:36:59.666636 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:36:59.666636 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:36:59.666636 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:36:59.666636 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:36:59.666636 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:36:59.666636 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:36:59.666636 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:36:59.666636 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:36:59.666636 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:36:59.666636 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:36:59.666636 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:36:59.666636 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:36:59.666636 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 35/68] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:36:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:36:59.672250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724c004-d04c-429b-8bd9-bae799c7bcbd None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:59.766856 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:59.769596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bdd5ee-0b3b-4812-8703-f1390dd518dd None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:59.795016 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724c004-d04c-429b-8bd9-bae799c7bcbd None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:59.807368 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bf8a9-6915-4b72-83fe-70648524080d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:59.808441 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bf8a9-6915-4b72-83fe-70648524080d None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:59.808984 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bf8a9-6915-4b72-83fe-70648524080d None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:59.808984 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bf8a9-6915-4b72-83fe-70648524080d None admin] PATH_INFO: `/v3/roles/member` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:59.822510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bf8a9-6915-4b72-83fe-70648524080d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:36:59.831143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-564bf8a9-6915-4b72-83fe-70648524080d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:36:59.831143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:36:59.831143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:36:59.831143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:36:59.831143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:36:59.831143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:36:59.831143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:36:59.831143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:36:59.831143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:36:59.831143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:36:59.831143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:36:59.831143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:36:59.831143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:36:59.831143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:36:59.831143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:36:59.831143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:36:59.832035 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:36:59.832035 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:36:59.832035 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:36:59.832035 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:36:59.832035 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:36:59.832035 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:36:59.832035 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:36:59.832035 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:36:59.832035 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:36:59.832035 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:36:59.832035 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:36:59.832035 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:36:59.832035 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:36:59.832035 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:36:59.832035 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:36:59.832035 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:36:59.833449 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:36:59.833449 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:36:59.833449 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:36:59.833449 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:36:59.833449 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:36:59.833449 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:36:59.833449 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:36:59.833449 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:36:59.833449 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:36:59.833449 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:36:59.833449 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:36:59.833449 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:36:59.833449 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:36:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:36:59.833449 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bf8a9-6915-4b72-83fe-70648524080d None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:59.846168 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589aedb-e1ae-4ca1-8c7e-fa8f040efd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:59.846842 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589aedb-e1ae-4ca1-8c7e-fa8f040efd9d None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:59.847127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589aedb-e1ae-4ca1-8c7e-fa8f040efd9d None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:59.847397 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589aedb-e1ae-4ca1-8c7e-fa8f040efd9d None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:59.848158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589aedb-e1ae-4ca1-8c7e-fa8f040efd9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:36:59.848468 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589aedb-e1ae-4ca1-8c7e-fa8f040efd9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:36:59.849899 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589aedb-e1ae-4ca1-8c7e-fa8f040efd9d None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:36:59.859399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 36/70] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:36:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:36:59.861434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68983eb4-40e1-4619-9ea3-241b0340bece None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:59.861732 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68983eb4-40e1-4619-9ea3-241b0340bece None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:59.862039 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68983eb4-40e1-4619-9ea3-241b0340bece None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:59.864073 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 37/71] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:36:59.864827 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68983eb4-40e1-4619-9ea3-241b0340bece None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:36:59.866992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:36:59.953306 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bf8a9-6915-4b72-83fe-70648524080d None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:36:59.994769 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3871c0-7782-4bd4-b3dc-90ac78959247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:36:59.995588 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3871c0-7782-4bd4-b3dc-90ac78959247 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:36:59.995879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3871c0-7782-4bd4-b3dc-90ac78959247 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:36:59.996165 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3871c0-7782-4bd4-b3dc-90ac78959247 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:36:59.996278 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68983eb4-40e1-4619-9ea3-241b0340bece None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:00.011002 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3871c0-7782-4bd4-b3dc-90ac78959247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:00.019570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-0f3871c0-7782-4bd4-b3dc-90ac78959247 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:00.019570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:00.019570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:00.019570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:00.019570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:00.019570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:00.019570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:00.019570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:00.019570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:00.019570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:00.019570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:00.019570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:00.019570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:00.019570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:00.019570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:00.019570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:00.020452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:00.020452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:00.020452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:00.020452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:00.020452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:00.020452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:00.020452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:00.020452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:00.020452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:00.020452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:00.020452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:00.020452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:00.020452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:00.020452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:00.020452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:00.020452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:00.021191 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:00.021191 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:00.021191 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:00.021191 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:00.021191 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:00.021191 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:00.021191 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:00.021191 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:00.021191 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:00.021191 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:00.021191 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:00.021191 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:00.021191 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 35/72] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 23 15:36:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:00.022209 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3871c0-7782-4bd4-b3dc-90ac78959247 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:00.030659 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:00.046407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a008bd6-6778-4b4a-b66f-a2004135d6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:00.047442 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a008bd6-6778-4b4a-b66f-a2004135d6df None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:00.047735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a008bd6-6778-4b4a-b66f-a2004135d6df None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:00.048080 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a008bd6-6778-4b4a-b66f-a2004135d6df None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:00.048855 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a008bd6-6778-4b4a-b66f-a2004135d6df None admin] RBAC: Adding query filter params (name=member) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:00.049168 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a008bd6-6778-4b4a-b66f-a2004135d6df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:00.050610 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a008bd6-6778-4b4a-b66f-a2004135d6df None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:00.060842 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 38/73] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:36:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:00.062337 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72f12b-5685-499f-b571-51ed078860d4 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:00.062629 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72f12b-5685-499f-b571-51ed078860d4 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:00.063083 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72f12b-5685-499f-b571-51ed078860d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:00.090634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-0c72f12b-5685-499f-b571-51ed078860d4 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:00.091788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-0c72f12b-5685-499f-b571-51ed078860d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:00.134038 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:00.154068 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3871c0-7782-4bd4-b3dc-90ac78959247 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:00.164807 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 39/74] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:00.165661 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72f12b-5685-499f-b571-51ed078860d4 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:00.213777 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94700c-4086-46df-b240-40a308860122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:00.214887 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94700c-4086-46df-b240-40a308860122 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:00.215258 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94700c-4086-46df-b240-40a308860122 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:00.215627 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94700c-4086-46df-b240-40a308860122 None admin] PATH_INFO: `/v3/users/25bea438d9bc4701a8ff368969074002` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:00.217080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d94700c-4086-46df-b240-40a308860122 None admin] RBAC: Authorizing `identity:get_user(user_id=25bea438d9bc4701a8ff368969074002)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:00.218795 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d94700c-4086-46df-b240-40a308860122 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:00.220644 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 36/75] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:00 2022] GET /identity/v3/users/25bea438d9bc4701a8ff368969074002 => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:00.222194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c8daf-3f0e-4d80-9fe2-dca34b8932a0 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:00.222567 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c8daf-3f0e-4d80-9fe2-dca34b8932a0 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:00.223007 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c8daf-3f0e-4d80-9fe2-dca34b8932a0 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:00.224494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 37/76] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:00.225394 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c8daf-3f0e-4d80-9fe2-dca34b8932a0 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:00.282127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72f12b-5685-499f-b571-51ed078860d4 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:00.298452 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:00.316693 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe34ae-fbe9-401f-8907-15a42a3a7ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:00.317385 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe34ae-fbe9-401f-8907-15a42a3a7ec7 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:00.317652 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe34ae-fbe9-401f-8907-15a42a3a7ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:00.317961 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe34ae-fbe9-401f-8907-15a42a3a7ec7 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:00.318716 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe34ae-fbe9-401f-8907-15a42a3a7ec7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:00.319029 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe34ae-fbe9-401f-8907-15a42a3a7ec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:00.320422 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe34ae-fbe9-401f-8907-15a42a3a7ec7 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:00.328242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c8daf-3f0e-4d80-9fe2-dca34b8932a0 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:00.328663 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 40/77] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:37:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:00.329075 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe34ae-fbe9-401f-8907-15a42a3a7ec7 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:00.365171 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c2791-6ccd-4333-aa0f-e112163d5a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:00.366004 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c2791-6ccd-4333-aa0f-e112163d5a16 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:00.366298 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c2791-6ccd-4333-aa0f-e112163d5a16 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:00.366582 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c2791-6ccd-4333-aa0f-e112163d5a16 None admin] PATH_INFO: `/v3/users/7fe27f63d24a4cff85a9c0ae32b154cc` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:00.381937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c2791-6ccd-4333-aa0f-e112163d5a16 None admin] RBAC: Authorizing `identity:get_user(user_id=7fe27f63d24a4cff85a9c0ae32b154cc)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:00.383525 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c2791-6ccd-4333-aa0f-e112163d5a16 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:00.385207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 38/78] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:00 2022] GET /identity/v3/users/7fe27f63d24a4cff85a9c0ae32b154cc => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:00.386004 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c2791-6ccd-4333-aa0f-e112163d5a16 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:00.400979 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:00.426536 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe34ae-fbe9-401f-8907-15a42a3a7ec7 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:00.461497 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13849f-5c8c-4020-88f0-b2ba49c5c378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:00.462333 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13849f-5c8c-4020-88f0-b2ba49c5c378 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:00.462625 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13849f-5c8c-4020-88f0-b2ba49c5c378 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:00.462910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13849f-5c8c-4020-88f0-b2ba49c5c378 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:00.472967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13849f-5c8c-4020-88f0-b2ba49c5c378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:00.480654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-1d13849f-5c8c-4020-88f0-b2ba49c5c378 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:00.480654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:00.480654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:00.480654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:00.480654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:00.480654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:00.480654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:00.480654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:00.480654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:00.480654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:00.480654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:00.480654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:00.480654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:00.480654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:00.480654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:00.480654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:00.481492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:00.481492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:00.481492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:00.481492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:00.481492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:00.481492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:00.481492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:00.481492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:00.481492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:00.481492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:00.481492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:00.481492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:00.481492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:00.481492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:00.481492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:00.481492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:00.482265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:00.482265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:00.482265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:00.482265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:00.482265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:00.482265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:00.482265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:00.482265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:00.482265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:00.482265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:00.482265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:00.482265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:00.482265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 41/79] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:00.483591 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0395d9-0992-436b-903a-e481869b6919 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:00.483925 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0395d9-0992-436b-903a-e481869b6919 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:00.484239 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0395d9-0992-436b-903a-e481869b6919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:00.491855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c2791-6ccd-4333-aa0f-e112163d5a16 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:00.504853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-ea0395d9-0992-436b-903a-e481869b6919 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:00.506115 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ea0395d9-0992-436b-903a-e481869b6919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:00.535272 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f15979-40fc-4a1a-9bf0-5a5462f05f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:00.536008 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f15979-40fc-4a1a-9bf0-5a5462f05f16 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:00.536336 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f15979-40fc-4a1a-9bf0-5a5462f05f16 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:00.536642 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f15979-40fc-4a1a-9bf0-5a5462f05f16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:00.546928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:00.591802 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 42/80] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:00.594074 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0395d9-0992-436b-903a-e481869b6919 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:00.627705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f15979-40fc-4a1a-9bf0-5a5462f05f16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:00.629107 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f15979-40fc-4a1a-9bf0-5a5462f05f16 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:00.643704 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:00.708934 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0395d9-0992-436b-903a-e481869b6919 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:00.735566 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 39/81] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:37:00.736199 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f15979-40fc-4a1a-9bf0-5a5462f05f16 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:00.753894 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f197db-4173-46f3-a727-73145a5793dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:00.754790 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f197db-4173-46f3-a727-73145a5793dc None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:00.755068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f197db-4173-46f3-a727-73145a5793dc None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:00.755346 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f197db-4173-46f3-a727-73145a5793dc None admin] PATH_INFO: `/v3/users/7fe27f63d24a4cff85a9c0ae32b154cc` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:00.756579 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f197db-4173-46f3-a727-73145a5793dc None admin] RBAC: Authorizing `identity:get_user(user_id=7fe27f63d24a4cff85a9c0ae32b154cc)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:00.758136 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f197db-4173-46f3-a727-73145a5793dc None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:00.759811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 43/82] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:00 2022] GET /identity/v3/users/7fe27f63d24a4cff85a9c0ae32b154cc => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:00.760593 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f197db-4173-46f3-a727-73145a5793dc None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:00.797493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:00.847404 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f15979-40fc-4a1a-9bf0-5a5462f05f16 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:00.861389 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:00.873825 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f197db-4173-46f3-a727-73145a5793dc None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:00.890046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee168cd-f031-4eae-bd31-3b8255f162e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:00.890744 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee168cd-f031-4eae-bd31-3b8255f162e7 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:00.891038 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee168cd-f031-4eae-bd31-3b8255f162e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:00.891303 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee168cd-f031-4eae-bd31-3b8255f162e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:00.912606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba5282-cd79-4aef-9f93-673368e2dc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:00.913628 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba5282-cd79-4aef-9f93-673368e2dc5c None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:00.914145 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba5282-cd79-4aef-9f93-673368e2dc5c None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:00.914615 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba5282-cd79-4aef-9f93-673368e2dc5c None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:00.915896 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba5282-cd79-4aef-9f93-673368e2dc5c None admin] RBAC: Adding query filter params (name=member) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:00.916335 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba5282-cd79-4aef-9f93-673368e2dc5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:00.918766 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba5282-cd79-4aef-9f93-673368e2dc5c None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:00.930839 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 44/83] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:00.931448 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba5282-cd79-4aef-9f93-673368e2dc5c None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:00.975586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee168cd-f031-4eae-bd31-3b8255f162e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:00.977039 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee168cd-f031-4eae-bd31-3b8255f162e7 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:01.043101 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:01.047824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba5282-cd79-4aef-9f93-673368e2dc5c None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:01.088022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130de58-8c85-4d14-a099-6f417393975f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:01.088841 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130de58-8c85-4d14-a099-6f417393975f None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:01.089135 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130de58-8c85-4d14-a099-6f417393975f None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:01.089424 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7130de58-8c85-4d14-a099-6f417393975f None admin] PATH_INFO: `/v3/domains/default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:01.090665 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130de58-8c85-4d14-a099-6f417393975f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:01.092131 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7130de58-8c85-4d14-a099-6f417393975f None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:01.093784 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 45/84] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:37:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:01.094365 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 40/85] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:37:01.095301 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee168cd-f031-4eae-bd31-3b8255f162e7 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:01.098899 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130de58-8c85-4d14-a099-6f417393975f None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:01.111286 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:01.209280 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7130de58-8c85-4d14-a099-6f417393975f None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:01.211030 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee168cd-f031-4eae-bd31-3b8255f162e7 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:01.245008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d97a6f-4566-4095-97a8-75ce4d83faec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:01.245899 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d97a6f-4566-4095-97a8-75ce4d83faec None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:01.246190 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d97a6f-4566-4095-97a8-75ce4d83faec None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:01.246473 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d97a6f-4566-4095-97a8-75ce4d83faec None admin] PATH_INFO: `/v3/projects/16957e4778784bc187de225af6d1e1db` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:01.247666 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d97a6f-4566-4095-97a8-75ce4d83faec None admin] RBAC: Authorizing `identity:get_project(project_id=16957e4778784bc187de225af6d1e1db)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:01.249707 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d97a6f-4566-4095-97a8-75ce4d83faec None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:01.251443 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 46/86] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:01 2022] GET /identity/v3/projects/16957e4778784bc187de225af6d1e1db => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:01.251977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efdfe5-9f78-477a-9d5c-7d019684f6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:01.252213 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d97a6f-4566-4095-97a8-75ce4d83faec None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:01.252638 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efdfe5-9f78-477a-9d5c-7d019684f6c5 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:01.252935 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efdfe5-9f78-477a-9d5c-7d019684f6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:01.253220 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efdfe5-9f78-477a-9d5c-7d019684f6c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:01.288586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:01.327862 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1efdfe5-9f78-477a-9d5c-7d019684f6c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:01.329354 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1efdfe5-9f78-477a-9d5c-7d019684f6c5 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:01.344576 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:01.368059 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d97a6f-4566-4095-97a8-75ce4d83faec None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:01.404082 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97540bf4-e683-4514-877f-6177ca2c31b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:01.405085 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97540bf4-e683-4514-877f-6177ca2c31b9 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:01.405442 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97540bf4-e683-4514-877f-6177ca2c31b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:01.405817 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97540bf4-e683-4514-877f-6177ca2c31b9 None admin] PATH_INFO: `/v3/users/7fe27f63d24a4cff85a9c0ae32b154cc` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:01.407092 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97540bf4-e683-4514-877f-6177ca2c31b9 None admin] RBAC: Authorizing `identity:get_user(user_id=7fe27f63d24a4cff85a9c0ae32b154cc)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:01.408551 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97540bf4-e683-4514-877f-6177ca2c31b9 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:01.410250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 47/87] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:01 2022] GET /identity/v3/users/7fe27f63d24a4cff85a9c0ae32b154cc => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:01.411099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97540bf4-e683-4514-877f-6177ca2c31b9 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:01.448771 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 41/88] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:37:01.449901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efdfe5-9f78-477a-9d5c-7d019684f6c5 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:01.520793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97540bf4-e683-4514-877f-6177ca2c31b9 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:01.523100 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:01.554445 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efdfe5-9f78-477a-9d5c-7d019684f6c5 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:01.559058 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40a3f8-aa8a-4980-89fe-6655766f0a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:01.559736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40a3f8-aa8a-4980-89fe-6655766f0a00 None admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:01.560124 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40a3f8-aa8a-4980-89fe-6655766f0a00 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:01.560426 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40a3f8-aa8a-4980-89fe-6655766f0a00 None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:01.561683 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40a3f8-aa8a-4980-89fe-6655766f0a00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:01.563176 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40a3f8-aa8a-4980-89fe-6655766f0a00 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:01.571723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:01.591516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 48/89] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 23 15:37:01 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:37:01.591516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40a3f8-aa8a-4980-89fe-6655766f0a00 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:01.605543 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fe21c-8579-4a0d-a83a-803752dc2e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:01.606621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fe21c-8579-4a0d-a83a-803752dc2e4a None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:01.606975 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fe21c-8579-4a0d-a83a-803752dc2e4a None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:01.607261 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fe21c-8579-4a0d-a83a-803752dc2e4a None admin] PATH_INFO: `/v3/projects/16957e4778784bc187de225af6d1e1db` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:01.608648 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7fe21c-8579-4a0d-a83a-803752dc2e4a None admin] RBAC: Authorizing `identity:get_project(project_id=16957e4778784bc187de225af6d1e1db)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:01.610213 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7fe21c-8579-4a0d-a83a-803752dc2e4a None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:01.612081 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 42/90] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:01 2022] GET /identity/v3/projects/16957e4778784bc187de225af6d1e1db => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:01.617980 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fe21c-8579-4a0d-a83a-803752dc2e4a None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:01.724110 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40a3f8-aa8a-4980-89fe-6655766f0a00 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:01.756612 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fe21c-8579-4a0d-a83a-803752dc2e4a None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:01.773840 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a955726-8520-40be-8e63-31b336e9e5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:01.774578 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a955726-8520-40be-8e63-31b336e9e5ce None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:01.775055 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a955726-8520-40be-8e63-31b336e9e5ce None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:01.775381 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a955726-8520-40be-8e63-31b336e9e5ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:01.776249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a955726-8520-40be-8e63-31b336e9e5ce None admin] RBAC: Adding query filter params (role.id=abdc0e0957534149b3653eaa33cbd054, scope.project.id=16957e4778784bc187de225af6d1e1db, user.id=25bea438d9bc4701a8ff368969074002) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:01.776573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a955726-8520-40be-8e63-31b336e9e5ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:01.778125 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a955726-8520-40be-8e63-31b336e9e5ce None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:01.785731 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 49/91] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:37:01 2022] GET /identity/v3/role_assignments?user.id=25bea438d9bc4701a8ff368969074002&scope.project.id=16957e4778784bc187de225af6d1e1db&role.id=abdc0e0957534149b3653eaa33cbd054 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:01.787441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a955726-8520-40be-8e63-31b336e9e5ce None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:01.813757 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b538726-0bfd-4839-a084-9bedb0eed4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:01.814875 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b538726-0bfd-4839-a084-9bedb0eed4e6 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:01.815169 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b538726-0bfd-4839-a084-9bedb0eed4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:01.815456 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b538726-0bfd-4839-a084-9bedb0eed4e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:01.824175 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:01.897423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:01.936928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b538726-0bfd-4839-a084-9bedb0eed4e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:01.938771 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b538726-0bfd-4839-a084-9bedb0eed4e6 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:01.955396 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a955726-8520-40be-8e63-31b336e9e5ce None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:02.000763 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24e8a7-2c28-4cea-bfdb-ec65f87b448d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:02.001752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24e8a7-2c28-4cea-bfdb-ec65f87b448d None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:02.002112 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24e8a7-2c28-4cea-bfdb-ec65f87b448d None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:02.002395 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24e8a7-2c28-4cea-bfdb-ec65f87b448d None admin] PATH_INFO: `/v3/projects/16957e4778784bc187de225af6d1e1db` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:02.004265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24e8a7-2c28-4cea-bfdb-ec65f87b448d None admin] RBAC: Authorizing `identity:get_project(project_id=16957e4778784bc187de225af6d1e1db)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:02.006018 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24e8a7-2c28-4cea-bfdb-ec65f87b448d None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:02.007808 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 50/92] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:01 2022] GET /identity/v3/projects/16957e4778784bc187de225af6d1e1db => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:02.008700 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24e8a7-2c28-4cea-bfdb-ec65f87b448d None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:02.079144 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 43/93] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:37:02.080456 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b538726-0bfd-4839-a084-9bedb0eed4e6 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:02.182285 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:02.206764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b538726-0bfd-4839-a084-9bedb0eed4e6 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:02.252129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f1b40-7bd8-41d5-97db-287ccb89bf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:02.252810 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f1b40-7bd8-41d5-97db-287ccb89bf37 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:02.253105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f1b40-7bd8-41d5-97db-287ccb89bf37 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:02.253387 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f1b40-7bd8-41d5-97db-287ccb89bf37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:02.254275 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f1b40-7bd8-41d5-97db-287ccb89bf37 None admin] RBAC: Adding query filter params (role.id=12fa8f67cf514b1e916afc130f0e6008, scope.project.id=16957e4778784bc187de225af6d1e1db, user.id=7fe27f63d24a4cff85a9c0ae32b154cc) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:02.254592 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f1b40-7bd8-41d5-97db-287ccb89bf37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:02.256046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f1b40-7bd8-41d5-97db-287ccb89bf37 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:02.258426 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:02.273516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24e8a7-2c28-4cea-bfdb-ec65f87b448d None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:02.279891 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 44/94] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:37:02 2022] GET /identity/v3/role_assignments?user.id=7fe27f63d24a4cff85a9c0ae32b154cc&scope.project.id=16957e4778784bc187de225af6d1e1db&role.id=12fa8f67cf514b1e916afc130f0e6008 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:02.280938 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f1b40-7bd8-41d5-97db-287ccb89bf37 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:02.362642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3eb397-f4d7-49cb-a394-a9b513e92f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:02.363257 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3eb397-f4d7-49cb-a394-a9b513e92f5c None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:02.363547 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3eb397-f4d7-49cb-a394-a9b513e92f5c None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:02.363836 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3eb397-f4d7-49cb-a394-a9b513e92f5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:02.364692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3eb397-f4d7-49cb-a394-a9b513e92f5c None admin] RBAC: Adding query filter params (role.id=2362b672eb7b474dbd341608f3993123, scope.project.id=16957e4778784bc187de225af6d1e1db, user.id=7fe27f63d24a4cff85a9c0ae32b154cc) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:02.365013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3eb397-f4d7-49cb-a394-a9b513e92f5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:02.366515 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3eb397-f4d7-49cb-a394-a9b513e92f5c None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:02.386849 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 51/95] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:37:02 2022] GET /identity/v3/role_assignments?user.id=7fe27f63d24a4cff85a9c0ae32b154cc&scope.project.id=16957e4778784bc187de225af6d1e1db&role.id=2362b672eb7b474dbd341608f3993123 => generated 259 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:02.460639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f1b40-7bd8-41d5-97db-287ccb89bf37 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:02.505267 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdba84-2256-4630-a2eb-ac7428b3dedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:02.506189 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdba84-2256-4630-a2eb-ac7428b3dedf None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:02.506482 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdba84-2256-4630-a2eb-ac7428b3dedf None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:02.506765 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdba84-2256-4630-a2eb-ac7428b3dedf None admin] PATH_INFO: `/v3/projects/8749ab0d4cfb47f892c215d10a6c1a1d` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:02.507991 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdba84-2256-4630-a2eb-ac7428b3dedf None admin] RBAC: Authorizing `identity:get_project(project_id=8749ab0d4cfb47f892c215d10a6c1a1d)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:02.509474 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdba84-2256-4630-a2eb-ac7428b3dedf None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:02.511345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 45/96] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:02 2022] GET /identity/v3/projects/8749ab0d4cfb47f892c215d10a6c1a1d => generated 312 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:02.517900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3eb397-f4d7-49cb-a394-a9b513e92f5c None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:02.681499 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3eb397-f4d7-49cb-a394-a9b513e92f5c None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:02.727918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cdde08-18e4-46bf-b645-45a41a3a67ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:02.728618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdde08-18e4-46bf-b645-45a41a3a67ba None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:02.728881 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdde08-18e4-46bf-b645-45a41a3a67ba None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:02.729170 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cdde08-18e4-46bf-b645-45a41a3a67ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:02.730045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdde08-18e4-46bf-b645-45a41a3a67ba None admin] RBAC: Adding query filter params (role.id=2362b672eb7b474dbd341608f3993123, scope.project.id=8749ab0d4cfb47f892c215d10a6c1a1d, user.id=7fe27f63d24a4cff85a9c0ae32b154cc) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:02.730367 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdde08-18e4-46bf-b645-45a41a3a67ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:02.731849 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cdde08-18e4-46bf-b645-45a41a3a67ba None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:02.744143 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 52/97] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:37:02 2022] GET /identity/v3/role_assignments?user.id=7fe27f63d24a4cff85a9c0ae32b154cc&scope.project.id=8749ab0d4cfb47f892c215d10a6c1a1d&role.id=2362b672eb7b474dbd341608f3993123 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:04.493827 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f9885-44fc-429e-bbd8-0e57507b7636 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:04.494867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f9885-44fc-429e-bbd8-0e57507b7636 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:04.495360 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f9885-44fc-429e-bbd8-0e57507b7636 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:04.496945 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 46/98] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:04.503302 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7dec2-72fa-4ab8-a69f-89d904697c91 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:04.504255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7dec2-72fa-4ab8-a69f-89d904697c91 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:04.504740 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7dec2-72fa-4ab8-a69f-89d904697c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:04.525527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-ebe7dec2-72fa-4ab8-a69f-89d904697c91 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:04.527112 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ebe7dec2-72fa-4ab8-a69f-89d904697c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:04.544260 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:04.629788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 53/99] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:04.666451 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f9885-44fc-429e-bbd8-0e57507b7636 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:04.688458 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:04.768740 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f39ca-78b1-47a7-a164-8cedcfa45630 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:04.769035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f39ca-78b1-47a7-a164-8cedcfa45630 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:04.769215 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f39ca-78b1-47a7-a164-8cedcfa45630 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:04.770639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 54/100] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:04.778201 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296b6c7-da9c-4d5a-acdd-ffd697cd6677 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:04.778492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296b6c7-da9c-4d5a-acdd-ffd697cd6677 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:04.778761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296b6c7-da9c-4d5a-acdd-ffd697cd6677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:04.801141 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-5296b6c7-da9c-4d5a-acdd-ffd697cd6677 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:04.802368 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5296b6c7-da9c-4d5a-acdd-ffd697cd6677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:04.842232 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f9885-44fc-429e-bbd8-0e57507b7636 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:04.912764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fff721-3553-46cd-b009-d390946c1fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:04.913524 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fff721-3553-46cd-b009-d390946c1fda None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:04.914061 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fff721-3553-46cd-b009-d390946c1fda None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:04.914531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fff721-3553-46cd-b009-d390946c1fda None admin] PATH_INFO: `/v3/domains/default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:04.915863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fff721-3553-46cd-b009-d390946c1fda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:04.917595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fff721-3553-46cd-b009-d390946c1fda None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:04.925883 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 47/101] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:37:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:04.925883 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df17fff-eede-4d29-9501-f2b28b71edf1 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:04.925883 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df17fff-eede-4d29-9501-f2b28b71edf1 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:04.925883 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df17fff-eede-4d29-9501-f2b28b71edf1 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:04.925883 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 48/102] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:04.930324 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df17fff-eede-4d29-9501-f2b28b71edf1 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:04.932960 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 55/103] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 15:37:04.934473 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a0ad2-fab7-4b00-a1af-55644ac8c516 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:04.934774 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a0ad2-fab7-4b00-a1af-55644ac8c516 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:04.935060 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a0ad2-fab7-4b00-a1af-55644ac8c516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:04.972509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-d68a0ad2-fab7-4b00-a1af-55644ac8c516 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:04.974133 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-d68a0ad2-fab7-4b00-a1af-55644ac8c516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:05.070873 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:05.099151 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df17fff-eede-4d29-9501-f2b28b71edf1 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:05.127106 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 56/104] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:05.129236 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a0ad2-fab7-4b00-a1af-55644ac8c516 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:05.167613 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:05.191732 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae8793-c633-439a-b61a-5cca59dbb729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:05.192717 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae8793-c633-439a-b61a-5cca59dbb729 None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:05.193201 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae8793-c633-439a-b61a-5cca59dbb729 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:05.193618 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae8793-c633-439a-b61a-5cca59dbb729 None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:05.196715 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae8793-c633-439a-b61a-5cca59dbb729 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:05.198990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae8793-c633-439a-b61a-5cca59dbb729 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:05.254911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 49/105] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 23 15:37:04 2022] POST /identity/v3/projects => generated 302 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:37:05.255887 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae8793-c633-439a-b61a-5cca59dbb729 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:05.323917 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a0ad2-fab7-4b00-a1af-55644ac8c516 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:05.372434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30411118-7e54-4350-aa26-d8caa6481822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:05.374901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30411118-7e54-4350-aa26-d8caa6481822 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:05.375615 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30411118-7e54-4350-aa26-d8caa6481822 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:05.376032 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30411118-7e54-4350-aa26-d8caa6481822 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:05.399804 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30411118-7e54-4350-aa26-d8caa6481822 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:05.419123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-30411118-7e54-4350-aa26-d8caa6481822 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 15:37:05.419123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:05.419123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:05.419123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:05.419123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:05.419123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:05.419123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:05.419123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:05.419123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:05.419123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:05.419123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:05.419123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:05.419123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:05.419123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:05.419123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:05.419123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:05.420905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:05.420905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:05.420905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:05.420905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:05.420905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:05.420905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:05.420905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:05.420905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:05.420905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:05.420905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:05.420905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:05.420905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:05.420905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:05.420905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:05.420905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:05.420905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:05.421871 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:05.421871 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:05.421871 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:05.421871 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:05.421871 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:05.421871 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:05.421871 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:05.421871 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:05.421871 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:05.421871 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:05.421871 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 15:37:05.421871 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:05.423686 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 57/106] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:05.429777 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d502049-406e-4dd7-9421-ee895ff8f021 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:05.429777 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d502049-406e-4dd7-9421-ee895ff8f021 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:05.429777 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d502049-406e-4dd7-9421-ee895ff8f021 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:05.429777 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 58/107] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:05.433716 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05cbe8-41b2-4fa0-b633-07bb3991e364 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:05.434302 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05cbe8-41b2-4fa0-b633-07bb3991e364 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:05.434618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b05cbe8-41b2-4fa0-b633-07bb3991e364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:05.466596 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-5b05cbe8-41b2-4fa0-b633-07bb3991e364 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:05.468869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5b05cbe8-41b2-4fa0-b633-07bb3991e364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:05.499259 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae8793-c633-439a-b61a-5cca59dbb729 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:05.536046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:05.543121 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328060c-e104-4542-bc38-3ecda4b585b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:05.549879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328060c-e104-4542-bc38-3ecda4b585b6 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:05.549879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328060c-e104-4542-bc38-3ecda4b585b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:05.549879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328060c-e104-4542-bc38-3ecda4b585b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:05.561488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6328060c-e104-4542-bc38-3ecda4b585b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:05.565420 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:05.570705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-6328060c-e104-4542-bc38-3ecda4b585b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:37:05.570705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:05.570705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:05.570705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:05.570705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:05.570705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:05.570705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:05.570705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:05.570705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:05.570705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:05.570705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:05.570705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:05.570705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:05.570705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:05.570705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:05.570705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:05.572196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:05.572196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:05.572196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:05.572196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:05.572196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:05.572196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:05.572196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:05.572196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:05.572196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:05.572196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:05.572196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:05.572196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:05.572196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:05.572196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:05.572196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:05.572196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:05.573540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:05.573540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:05.573540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:05.573540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:05.573540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:05.573540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:05.573540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:05.573540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:05.573540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:05.573540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:05.573540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:37:05.573540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:05.573540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 50/108] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:37:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:05.573540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328060c-e104-4542-bc38-3ecda4b585b6 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:05.579621 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 59/109] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:05.580506 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05cbe8-41b2-4fa0-b633-07bb3991e364 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:05.715148 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b05cbe8-41b2-4fa0-b633-07bb3991e364 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:05.715601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328060c-e104-4542-bc38-3ecda4b585b6 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:05.752615 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363ea82-ec08-4b0a-9a9a-c416e9430fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:05.753307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363ea82-ec08-4b0a-9a9a-c416e9430fbf None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:05.753597 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363ea82-ec08-4b0a-9a9a-c416e9430fbf None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:05.753915 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e363ea82-ec08-4b0a-9a9a-c416e9430fbf None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:05.754807 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363ea82-ec08-4b0a-9a9a-c416e9430fbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:05.755122 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363ea82-ec08-4b0a-9a9a-c416e9430fbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:05.756571 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e363ea82-ec08-4b0a-9a9a-c416e9430fbf None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:05.764516 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028bb94-f3d2-4b11-888d-1b30d5192116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:05.765219 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028bb94-f3d2-4b11-888d-1b30d5192116 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:05.765505 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028bb94-f3d2-4b11-888d-1b30d5192116 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:05.765786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028bb94-f3d2-4b11-888d-1b30d5192116 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:05.766495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 60/110] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:05.766600 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028bb94-f3d2-4b11-888d-1b30d5192116 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:05.766881 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028bb94-f3d2-4b11-888d-1b30d5192116 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:05.767427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363ea82-ec08-4b0a-9a9a-c416e9430fbf None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:05.768331 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028bb94-f3d2-4b11-888d-1b30d5192116 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:05.787949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 51/111] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:05.788830 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028bb94-f3d2-4b11-888d-1b30d5192116 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:05.862405 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:05.882281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:05.888758 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e363ea82-ec08-4b0a-9a9a-c416e9430fbf None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:05.910748 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028bb94-f3d2-4b11-888d-1b30d5192116 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:05.926729 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113740be-92e1-4aa9-8982-c8678e246e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:05.927893 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113740be-92e1-4aa9-8982-c8678e246e54 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:05.928401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113740be-92e1-4aa9-8982-c8678e246e54 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:05.928875 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113740be-92e1-4aa9-8982-c8678e246e54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:05.940853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113740be-92e1-4aa9-8982-c8678e246e54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:05.947082 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fedc29-8923-441d-b1db-e848e9c881b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:05.947974 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fedc29-8923-441d-b1db-e848e9c881b3 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:05.948260 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fedc29-8923-441d-b1db-e848e9c881b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:05.948542 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fedc29-8923-441d-b1db-e848e9c881b3 None admin] PATH_INFO: `/v3/users/25bea438d9bc4701a8ff368969074002` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:05.949207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-113740be-92e1-4aa9-8982-c8678e246e54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:05.949207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:05.949207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:05.949207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:05.949207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:05.949207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:05.949207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:05.949207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:05.949207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:05.949207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:05.949207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:05.949207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:05.949207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:05.949207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:05.949207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:05.949207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:05.950029 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:05.950029 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:05.950029 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:05.950029 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:05.950029 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:05.950029 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:05.950029 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:05.950029 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:05.950029 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:05.950029 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:05.950029 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:05.950029 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:05.950029 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:05.950029 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:05.950029 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:05.950029 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:05.950794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:05.950794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:05.950794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:05.950794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:05.950794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:05.950794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:05.950794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:05.950794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:05.950794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:05.950794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:05.950794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:05.950794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:05.951936 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fedc29-8923-441d-b1db-e848e9c881b3 None admin] RBAC: Authorizing `identity:get_user(user_id=25bea438d9bc4701a8ff368969074002)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:05.952013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 61/112] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:05.952085 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fedc29-8923-441d-b1db-e848e9c881b3 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:05.953833 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 52/113] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:05 2022] GET /identity/v3/users/25bea438d9bc4701a8ff368969074002 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:05.954939 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b44b96-0c3d-48ba-8e58-2ca0a871d97c None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:05.956133 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b44b96-0c3d-48ba-8e58-2ca0a871d97c None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:05.956133 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b44b96-0c3d-48ba-8e58-2ca0a871d97c None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:05.956461 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113740be-92e1-4aa9-8982-c8678e246e54 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:05.956717 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 53/114] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:05.961643 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b44b96-0c3d-48ba-8e58-2ca0a871d97c None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:06.066182 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113740be-92e1-4aa9-8982-c8678e246e54 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:06.083298 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b44b96-0c3d-48ba-8e58-2ca0a871d97c None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:06.090445 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:06.108928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef582691-aec5-4d34-b619-58a2c61fbb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:06.110186 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef582691-aec5-4d34-b619-58a2c61fbb49 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:06.110542 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef582691-aec5-4d34-b619-58a2c61fbb49 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:06.110894 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef582691-aec5-4d34-b619-58a2c61fbb49 None admin] PATH_INFO: `/v3/users/5b213258c16a445e8ae628e473bc78f6` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:06.114717 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:06.130451 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2c1da-094b-46fc-a336-3d51322a353d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:06.131567 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2c1da-094b-46fc-a336-3d51322a353d None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:06.131947 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2c1da-094b-46fc-a336-3d51322a353d None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:06.132424 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2c1da-094b-46fc-a336-3d51322a353d None admin] PATH_INFO: `/v3/projects/16957e4778784bc187de225af6d1e1db` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:06.134653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2c1da-094b-46fc-a336-3d51322a353d None admin] RBAC: Authorizing `identity:get_project(project_id=16957e4778784bc187de225af6d1e1db)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:06.135903 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef582691-aec5-4d34-b619-58a2c61fbb49 None admin] RBAC: Authorizing `identity:get_user(user_id=5b213258c16a445e8ae628e473bc78f6)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:06.136369 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2c1da-094b-46fc-a336-3d51322a353d None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:06.137370 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef582691-aec5-4d34-b619-58a2c61fbb49 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:06.138539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 54/115] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:05 2022] GET /identity/v3/projects/16957e4778784bc187de225af6d1e1db => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:06.139359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 62/116] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:05 2022] GET /identity/v3/users/5b213258c16a445e8ae628e473bc78f6 => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:06.140771 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39a47c-103f-43c4-9344-0526473b3a61 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:06.141068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39a47c-103f-43c4-9344-0526473b3a61 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:06.141352 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39a47c-103f-43c4-9344-0526473b3a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:06.145619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2c1da-094b-46fc-a336-3d51322a353d None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:06.161288 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-ff39a47c-103f-43c4-9344-0526473b3a61 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:06.163020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ff39a47c-103f-43c4-9344-0526473b3a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:06.254416 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 63/117] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:06.256123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39a47c-103f-43c4-9344-0526473b3a61 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:06.288963 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2c1da-094b-46fc-a336-3d51322a353d None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:06.336492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a9e68-d131-48e8-924d-a16aca8a6598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:06.337274 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a9e68-d131-48e8-924d-a16aca8a6598 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:06.337772 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a9e68-d131-48e8-924d-a16aca8a6598 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:06.338322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a9e68-d131-48e8-924d-a16aca8a6598 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:06.339478 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a9e68-d131-48e8-924d-a16aca8a6598 None admin] RBAC: Adding query filter params (name=member) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:06.339821 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a9e68-d131-48e8-924d-a16aca8a6598 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:06.341224 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a9e68-d131-48e8-924d-a16aca8a6598 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:06.350684 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 55/118] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:06.355802 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a9e68-d131-48e8-924d-a16aca8a6598 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:06.382400 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39a47c-103f-43c4-9344-0526473b3a61 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:06.393906 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:06.429079 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03abdaa-f854-4222-b29d-2c33ce841b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:06.430302 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03abdaa-f854-4222-b29d-2c33ce841b67 None admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:06.430774 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03abdaa-f854-4222-b29d-2c33ce841b67 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:06.431188 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:06.433780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03abdaa-f854-4222-b29d-2c33ce841b67 None admin] PATH_INFO: `/v3/projects/16957e4778784bc187de225af6d1e1db/users/25bea438d9bc4701a8ff368969074002/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:06.435195 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03abdaa-f854-4222-b29d-2c33ce841b67 None admin] RBAC: Authorizing `identity:create_grant(project_id=16957e4778784bc187de225af6d1e1db, user_id=25bea438d9bc4701a8ff368969074002, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:06.436720 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03abdaa-f854-4222-b29d-2c33ce841b67 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:06.451998 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 64/119] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 23 15:37:06 2022] PUT /identity/v3/projects/16957e4778784bc187de225af6d1e1db/users/25bea438d9bc4701a8ff368969074002/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:37:06.453712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a973a7-95b4-4c64-a158-04c95ddf038c None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:06.454303 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a973a7-95b4-4c64-a158-04c95ddf038c None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:06.454586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a973a7-95b4-4c64-a158-04c95ddf038c None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:06.456672 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 65/120] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:06.456845 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a973a7-95b4-4c64-a158-04c95ddf038c None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:06.517227 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a9e68-d131-48e8-924d-a16aca8a6598 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:06.574582 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29401f6b-cccb-4156-85f8-e6e2c4db6807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:06.575804 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29401f6b-cccb-4156-85f8-e6e2c4db6807 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:06.576964 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29401f6b-cccb-4156-85f8-e6e2c4db6807 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:06.577456 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29401f6b-cccb-4156-85f8-e6e2c4db6807 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:06.610461 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a973a7-95b4-4c64-a158-04c95ddf038c None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:06.649843 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72191c2e-cbfd-4ccd-9a93-c5ae4c227b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:06.650616 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72191c2e-cbfd-4ccd-9a93-c5ae4c227b1f None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:06.650897 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72191c2e-cbfd-4ccd-9a93-c5ae4c227b1f None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:06.651178 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72191c2e-cbfd-4ccd-9a93-c5ae4c227b1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:06.662696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29401f6b-cccb-4156-85f8-e6e2c4db6807 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:06.664180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29401f6b-cccb-4156-85f8-e6e2c4db6807 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:06.668587 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72191c2e-cbfd-4ccd-9a93-c5ae4c227b1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:06.679654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-72191c2e-cbfd-4ccd-9a93-c5ae4c227b1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:06.679654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:06.679654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:06.679654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:06.679654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:06.679654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:06.679654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:06.679654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:06.679654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:06.679654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:06.679654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:06.679654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:06.679654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:06.679654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:06.679654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:06.679654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:06.680562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:06.680562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:06.680562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:06.680562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:06.680562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:06.680562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:06.680562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:06.680562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:06.680562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:06.680562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:06.680562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:06.680562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:06.680562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:06.680562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:06.680562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:06.680562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:06.681310 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:06.681310 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:06.681310 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:06.681310 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:06.681310 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:06.681310 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:06.681310 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:06.681310 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:06.681310 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:06.681310 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:06.681310 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:06.681310 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:06.688541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 66/121] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 23 15:37:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:06.688541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72191c2e-cbfd-4ccd-9a93-c5ae4c227b1f None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:06.729842 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:06.753732 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:06.820139 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 56/122] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:37:06.825967 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20893506-8e29-4feb-add0-84419eda7654 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:06.827365 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20893506-8e29-4feb-add0-84419eda7654 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:06.827365 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20893506-8e29-4feb-add0-84419eda7654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:06.844640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72191c2e-cbfd-4ccd-9a93-c5ae4c227b1f None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:06.844839 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-20893506-8e29-4feb-add0-84419eda7654 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:06.845989 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-20893506-8e29-4feb-add0-84419eda7654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:06.892392 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5c421-6ab2-4abc-a5d8-39ab97fc577f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:06.894139 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5c421-6ab2-4abc-a5d8-39ab97fc577f None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:06.895076 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5c421-6ab2-4abc-a5d8-39ab97fc577f None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:06.895858 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb5c421-6ab2-4abc-a5d8-39ab97fc577f None admin] PATH_INFO: `/v3/users/7fe27f63d24a4cff85a9c0ae32b154cc` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:06.897594 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5c421-6ab2-4abc-a5d8-39ab97fc577f None admin] RBAC: Authorizing `identity:get_user(user_id=7fe27f63d24a4cff85a9c0ae32b154cc)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:06.900514 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb5c421-6ab2-4abc-a5d8-39ab97fc577f None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:06.903153 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 67/123] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:06 2022] GET /identity/v3/users/7fe27f63d24a4cff85a9c0ae32b154cc => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:06.904796 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5c421-6ab2-4abc-a5d8-39ab97fc577f None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:06.928443 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 57/124] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:06.930169 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20893506-8e29-4feb-add0-84419eda7654 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:07.038521 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:07.041230 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:07.049503 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb5c421-6ab2-4abc-a5d8-39ab97fc577f None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:07.064441 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20893506-8e29-4feb-add0-84419eda7654 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:07.096044 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9607cbb-f8d8-4a24-a810-e3498b996534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:07.097307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9607cbb-f8d8-4a24-a810-e3498b996534 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:07.097762 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9607cbb-f8d8-4a24-a810-e3498b996534 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:07.098219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9607cbb-f8d8-4a24-a810-e3498b996534 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:07.099866 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9607cbb-f8d8-4a24-a810-e3498b996534 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:07.100335 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9607cbb-f8d8-4a24-a810-e3498b996534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:07.102422 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9607cbb-f8d8-4a24-a810-e3498b996534 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:07.111517 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe2bf6-c999-4aec-b491-b3d5aba7f5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:07.112536 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe2bf6-c999-4aec-b491-b3d5aba7f5f3 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:07.112998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe2bf6-c999-4aec-b491-b3d5aba7f5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:07.113382 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe2bf6-c999-4aec-b491-b3d5aba7f5f3 None admin] PATH_INFO: `/v3/projects/16957e4778784bc187de225af6d1e1db` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:07.114808 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 68/125] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:37:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:07.115790 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9607cbb-f8d8-4a24-a810-e3498b996534 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:07.119573 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe2bf6-c999-4aec-b491-b3d5aba7f5f3 None admin] RBAC: Authorizing `identity:get_project(project_id=16957e4778784bc187de225af6d1e1db)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:07.121409 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe2bf6-c999-4aec-b491-b3d5aba7f5f3 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:07.123656 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 58/126] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:06 2022] GET /identity/v3/projects/16957e4778784bc187de225af6d1e1db => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:07.128353 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe2bf6-c999-4aec-b491-b3d5aba7f5f3 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:07.252081 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe2bf6-c999-4aec-b491-b3d5aba7f5f3 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:07.262824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9607cbb-f8d8-4a24-a810-e3498b996534 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:07.297167 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4aeea-ce0f-4eb3-930b-ecb0c8f4d1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:07.298287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4aeea-ce0f-4eb3-930b-ecb0c8f4d1f6 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:07.298395 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4aeea-ce0f-4eb3-930b-ecb0c8f4d1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:07.298664 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4aeea-ce0f-4eb3-930b-ecb0c8f4d1f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:07.311866 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1217e7-d092-4cb1-aecf-3065a5e24b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:07.312749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1217e7-d092-4cb1-aecf-3065a5e24b13 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:07.313141 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1217e7-d092-4cb1-aecf-3065a5e24b13 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:07.313431 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1217e7-d092-4cb1-aecf-3065a5e24b13 None admin] PATH_INFO: `/v3/projects/16957e4778784bc187de225af6d1e1db` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:07.314692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1217e7-d092-4cb1-aecf-3065a5e24b13 None admin] RBAC: Authorizing `identity:get_project(project_id=16957e4778784bc187de225af6d1e1db)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:07.315111 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4aeea-ce0f-4eb3-930b-ecb0c8f4d1f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:07.316170 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1217e7-d092-4cb1-aecf-3065a5e24b13 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:07.318121 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 69/127] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:07 2022] GET /identity/v3/projects/16957e4778784bc187de225af6d1e1db => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:07.318750 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1217e7-d092-4cb1-aecf-3065a5e24b13 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:07.325725 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-58c4aeea-ce0f-4eb3-930b-ecb0c8f4d1f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:07.325725 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:07.325725 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:07.325725 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:07.325725 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:07.325725 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:07.325725 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:07.325725 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:07.325725 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:07.325725 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:07.325725 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:07.325725 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:07.325725 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:07.325725 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:07.325725 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:07.325725 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:07.327322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:07.327322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:07.327322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:07.327322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:07.327322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:07.327322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:07.327322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:07.327322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:07.327322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:07.327322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:07.327322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:07.327322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:07.327322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:07.327322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:07.327322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:07.327322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:07.328151 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:07.328151 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:07.328151 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:07.328151 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:07.328151 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:07.328151 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:07.328151 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:07.328151 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:07.328151 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:07.328151 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:07.328151 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:07.328151 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:07.331548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 59/128] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:07.333095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4aeea-ce0f-4eb3-930b-ecb0c8f4d1f6 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:07.348373 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:07.364748 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:07.459585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1217e7-d092-4cb1-aecf-3065a5e24b13 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:07.459778 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4aeea-ce0f-4eb3-930b-ecb0c8f4d1f6 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:07.496844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6f1fb-c478-4675-ac00-33c71692f438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:07.497516 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6f1fb-c478-4675-ac00-33c71692f438 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:07.497811 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6f1fb-c478-4675-ac00-33c71692f438 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:07.498172 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6f1fb-c478-4675-ac00-33c71692f438 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:07.499020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6f1fb-c478-4675-ac00-33c71692f438 None admin] RBAC: Adding query filter params (role.id=a655cf8750c8442eb3cce5c771188a99, scope.project.id=16957e4778784bc187de225af6d1e1db, user.id=5b213258c16a445e8ae628e473bc78f6) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:07.499342 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6f1fb-c478-4675-ac00-33c71692f438 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:07.500457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3e150-de4d-48e7-a2dc-bf47c1e055a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:07.500914 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6f1fb-c478-4675-ac00-33c71692f438 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:07.501773 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3e150-de4d-48e7-a2dc-bf47c1e055a3 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:07.502342 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3e150-de4d-48e7-a2dc-bf47c1e055a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:07.502824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3e150-de4d-48e7-a2dc-bf47c1e055a3 None admin] PATH_INFO: `/v3/users/7fe27f63d24a4cff85a9c0ae32b154cc` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:07.504295 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3e150-de4d-48e7-a2dc-bf47c1e055a3 None admin] RBAC: Authorizing `identity:get_user(user_id=7fe27f63d24a4cff85a9c0ae32b154cc)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:07.505995 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3e150-de4d-48e7-a2dc-bf47c1e055a3 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:07.513892 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 60/129] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:37:07 2022] GET /identity/v3/role_assignments?user.id=5b213258c16a445e8ae628e473bc78f6&scope.project.id=16957e4778784bc187de225af6d1e1db&role.id=a655cf8750c8442eb3cce5c771188a99 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:07.513892 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6f1fb-c478-4675-ac00-33c71692f438 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:07.517630 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 70/130] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:07 2022] GET /identity/v3/users/7fe27f63d24a4cff85a9c0ae32b154cc => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:07.518619 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3e150-de4d-48e7-a2dc-bf47c1e055a3 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:07.681909 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:07.696799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:07.706426 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3e150-de4d-48e7-a2dc-bf47c1e055a3 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:07.720329 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6f1fb-c478-4675-ac00-33c71692f438 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:07.743126 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9a8ea-1260-4502-8a0d-527a1af220c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:07.743901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9a8ea-1260-4502-8a0d-527a1af220c2 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:07.744187 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9a8ea-1260-4502-8a0d-527a1af220c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:07.744468 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9a8ea-1260-4502-8a0d-527a1af220c2 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:07.745230 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9a8ea-1260-4502-8a0d-527a1af220c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:07.745542 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9a8ea-1260-4502-8a0d-527a1af220c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:07.747107 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9a8ea-1260-4502-8a0d-527a1af220c2 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:07.756934 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 71/131] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:07.757688 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9a8ea-1260-4502-8a0d-527a1af220c2 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:07.769124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8a2f1-6e84-41f7-a095-4dd9f0feeb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:07.770149 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8a2f1-6e84-41f7-a095-4dd9f0feeb2d None admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:07.770533 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8a2f1-6e84-41f7-a095-4dd9f0feeb2d None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:07.770893 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8a2f1-6e84-41f7-a095-4dd9f0feeb2d None admin] PATH_INFO: `/v3/projects/16957e4778784bc187de225af6d1e1db/users/7fe27f63d24a4cff85a9c0ae32b154cc/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:07.773640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8a2f1-6e84-41f7-a095-4dd9f0feeb2d None admin] RBAC: Authorizing `identity:create_grant(project_id=16957e4778784bc187de225af6d1e1db, user_id=7fe27f63d24a4cff85a9c0ae32b154cc, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:07.776069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8a2f1-6e84-41f7-a095-4dd9f0feeb2d None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:07.802228 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 61/132] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 23 15:37:07 2022] PUT /identity/v3/projects/16957e4778784bc187de225af6d1e1db/users/7fe27f63d24a4cff85a9c0ae32b154cc/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:37:07.805077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8255f4-5425-4e12-b5e3-6fd91494bcc8 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:07.805486 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8255f4-5425-4e12-b5e3-6fd91494bcc8 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:07.805882 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8255f4-5425-4e12-b5e3-6fd91494bcc8 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:07.807619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 62/133] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:07.813714 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8255f4-5425-4e12-b5e3-6fd91494bcc8 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:07.951992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8255f4-5425-4e12-b5e3-6fd91494bcc8 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:07.958165 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9a8ea-1260-4502-8a0d-527a1af220c2 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:08.015997 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd405181-6dc3-4088-85a9-00787920edf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:08.016832 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd405181-6dc3-4088-85a9-00787920edf3 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:08.017121 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd405181-6dc3-4088-85a9-00787920edf3 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:08.017397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd405181-6dc3-4088-85a9-00787920edf3 None admin] PATH_INFO: `/v3/users/7fe27f63d24a4cff85a9c0ae32b154cc` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:08.019449 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd405181-6dc3-4088-85a9-00787920edf3 None admin] RBAC: Authorizing `identity:get_user(user_id=7fe27f63d24a4cff85a9c0ae32b154cc)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:08.020939 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd405181-6dc3-4088-85a9-00787920edf3 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:08.022911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 63/134] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:07 2022] GET /identity/v3/users/7fe27f63d24a4cff85a9c0ae32b154cc => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:08.024489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e73e2-8aef-485b-b1e2-8ddd4aebec16 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:08.024805 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e73e2-8aef-485b-b1e2-8ddd4aebec16 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:08.025092 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e73e2-8aef-485b-b1e2-8ddd4aebec16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:08.027853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846f700-f573-4340-b85c-395b183d264f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:08.029142 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846f700-f573-4340-b85c-395b183d264f None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:08.030254 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846f700-f573-4340-b85c-395b183d264f None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:08.030836 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:08.031223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846f700-f573-4340-b85c-395b183d264f None admin] PATH_INFO: `/v3/projects/16957e4778784bc187de225af6d1e1db` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:08.033717 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846f700-f573-4340-b85c-395b183d264f None admin] RBAC: Authorizing `identity:get_project(project_id=16957e4778784bc187de225af6d1e1db)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:08.035395 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846f700-f573-4340-b85c-395b183d264f None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:08.037362 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 72/135] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:07 2022] GET /identity/v3/projects/16957e4778784bc187de225af6d1e1db => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:08.038353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846f700-f573-4340-b85c-395b183d264f None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:08.045911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-742e73e2-8aef-485b-b1e2-8ddd4aebec16 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:08.047325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-742e73e2-8aef-485b-b1e2-8ddd4aebec16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:08.069893 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:08.158499 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 64/136] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:08.159179 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e73e2-8aef-485b-b1e2-8ddd4aebec16 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:08.215694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846f700-f573-4340-b85c-395b183d264f None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:08.314709 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23332b12-865b-4326-baf0-79621ddcdfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:08.315502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23332b12-865b-4326-baf0-79621ddcdfa0 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:08.315823 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23332b12-865b-4326-baf0-79621ddcdfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:08.316077 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23332b12-865b-4326-baf0-79621ddcdfa0 None admin] PATH_INFO: `/v3/projects/8749ab0d4cfb47f892c215d10a6c1a1d` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:08.317410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23332b12-865b-4326-baf0-79621ddcdfa0 None admin] RBAC: Authorizing `identity:get_project(project_id=8749ab0d4cfb47f892c215d10a6c1a1d)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:08.318907 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23332b12-865b-4326-baf0-79621ddcdfa0 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:08.319998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e73e2-8aef-485b-b1e2-8ddd4aebec16 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:08.320854 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 73/137] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:08 2022] GET /identity/v3/projects/8749ab0d4cfb47f892c215d10a6c1a1d => generated 312 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:08.321466 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23332b12-865b-4326-baf0-79621ddcdfa0 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:08.356650 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:08.363745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d010b-5f99-471b-a78c-2dfda97777f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:08.364713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d010b-5f99-471b-a78c-2dfda97777f2 None admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:08.365054 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d010b-5f99-471b-a78c-2dfda97777f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:08.365343 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d010b-5f99-471b-a78c-2dfda97777f2 None admin] PATH_INFO: `/v3/projects/16957e4778784bc187de225af6d1e1db/users/7fe27f63d24a4cff85a9c0ae32b154cc/roles/12fa8f67cf514b1e916afc130f0e6008` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:08.367928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d010b-5f99-471b-a78c-2dfda97777f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=16957e4778784bc187de225af6d1e1db, user_id=7fe27f63d24a4cff85a9c0ae32b154cc, role_id=12fa8f67cf514b1e916afc130f0e6008)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:08.369475 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d010b-5f99-471b-a78c-2dfda97777f2 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:08.383923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 65/138] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 23 15:37:08 2022] PUT /identity/v3/projects/16957e4778784bc187de225af6d1e1db/users/7fe27f63d24a4cff85a9c0ae32b154cc/roles/12fa8f67cf514b1e916afc130f0e6008 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:37:08.384575 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d010b-5f99-471b-a78c-2dfda97777f2 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:08.506141 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d010b-5f99-471b-a78c-2dfda97777f2 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:08.522292 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:08.537233 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23332b12-865b-4326-baf0-79621ddcdfa0 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:08.556326 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d1885-394c-451e-8304-8fd969406650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:08.557246 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d1885-394c-451e-8304-8fd969406650 None admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:08.557529 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d1885-394c-451e-8304-8fd969406650 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:08.557814 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d1885-394c-451e-8304-8fd969406650 None admin] PATH_INFO: `/v3/projects/8749ab0d4cfb47f892c215d10a6c1a1d/users/7fe27f63d24a4cff85a9c0ae32b154cc/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:08.559915 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d1885-394c-451e-8304-8fd969406650 None admin] RBAC: Authorizing `identity:create_grant(project_id=8749ab0d4cfb47f892c215d10a6c1a1d, user_id=7fe27f63d24a4cff85a9c0ae32b154cc, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:08.566597 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d1885-394c-451e-8304-8fd969406650 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:08.584299 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 66/139] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 23 15:37:08 2022] PUT /identity/v3/projects/8749ab0d4cfb47f892c215d10a6c1a1d/users/7fe27f63d24a4cff85a9c0ae32b154cc/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:37:08.593199 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e32264-646a-441d-a8d8-561b070d64e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:08.594423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e32264-646a-441d-a8d8-561b070d64e9 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:08.594887 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e32264-646a-441d-a8d8-561b070d64e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:08.595359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e32264-646a-441d-a8d8-561b070d64e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:08.596960 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e32264-646a-441d-a8d8-561b070d64e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:08.598835 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e32264-646a-441d-a8d8-561b070d64e9 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:08.600909 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 74/140] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:37:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:08.608215 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d1885-394c-451e-8304-8fd969406650 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:08.693155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:08.753643 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d1885-394c-451e-8304-8fd969406650 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:08.794614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b50a0-ac1e-4d8c-ae60-c916fb4336da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:08.795366 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b50a0-ac1e-4d8c-ae60-c916fb4336da None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:08.795657 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b50a0-ac1e-4d8c-ae60-c916fb4336da None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:08.795941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b50a0-ac1e-4d8c-ae60-c916fb4336da None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:08.796686 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b50a0-ac1e-4d8c-ae60-c916fb4336da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:08.798233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b50a0-ac1e-4d8c-ae60-c916fb4336da None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:08.830252 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 67/141] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 23 15:37:08 2022] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:37:09.008614 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841176c1-1c4f-4c4f-8f56-da79b07782ea None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:09.009842 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841176c1-1c4f-4c4f-8f56-da79b07782ea None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:09.010387 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841176c1-1c4f-4c4f-8f56-da79b07782ea None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:09.012058 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 75/142] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:09.017931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e085c-1b86-4349-a7c6-5358db8d27b8 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:09.018228 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e085c-1b86-4349-a7c6-5358db8d27b8 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:09.018518 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e085c-1b86-4349-a7c6-5358db8d27b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:09.040543 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-bf7e085c-1b86-4349-a7c6-5358db8d27b8 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:09.041749 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-bf7e085c-1b86-4349-a7c6-5358db8d27b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:09.116364 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 68/143] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:09.139854 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841176c1-1c4f-4c4f-8f56-da79b07782ea None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:09.255129 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841176c1-1c4f-4c4f-8f56-da79b07782ea None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:09.303976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bd953-f086-4470-8069-a64ea40528aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:09.304790 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bd953-f086-4470-8069-a64ea40528aa None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:09.305081 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bd953-f086-4470-8069-a64ea40528aa None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:09.305361 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bd953-f086-4470-8069-a64ea40528aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:09.320770 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74bd953-f086-4470-8069-a64ea40528aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:09.328504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-d74bd953-f086-4470-8069-a64ea40528aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:37:09.328504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:09.328504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:09.328504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:09.328504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:09.328504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:09.328504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:09.328504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:09.328504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:09.328504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:09.328504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:09.328504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:09.328504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:09.328504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:09.328504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:09.328504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:09.329354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:09.329354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:09.329354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:09.329354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:09.329354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:09.329354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:09.329354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:09.329354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:09.329354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:09.329354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:09.329354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:09.329354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:09.329354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:09.329354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:09.329354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:09.329354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:09.330784 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:09.330784 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:09.330784 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:09.330784 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:09.330784 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:09.330784 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:09.330784 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:09.330784 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:09.330784 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:09.330784 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:09.330784 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:37:09.330784 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:09.330784 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 76/144] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:37:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:09.335703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e085c-1b86-4349-a7c6-5358db8d27b8 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:09.403436 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:09.495601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e085c-1b86-4349-a7c6-5358db8d27b8 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:09.534552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93bbd9-7f5f-4b8c-92a8-cd2224409c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:09.535287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93bbd9-7f5f-4b8c-92a8-cd2224409c43 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:09.535595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93bbd9-7f5f-4b8c-92a8-cd2224409c43 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:09.535875 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93bbd9-7f5f-4b8c-92a8-cd2224409c43 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:09.536642 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93bbd9-7f5f-4b8c-92a8-cd2224409c43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:09.536957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93bbd9-7f5f-4b8c-92a8-cd2224409c43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:09.538821 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93bbd9-7f5f-4b8c-92a8-cd2224409c43 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:09.548656 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 69/145] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:09.554386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bd953-f086-4470-8069-a64ea40528aa None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:09.582662 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:09.686505 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74bd953-f086-4470-8069-a64ea40528aa None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:09.729130 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47f759-f7a2-4d79-b0c8-e5c1a4e19718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:09.730287 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47f759-f7a2-4d79-b0c8-e5c1a4e19718 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:09.730732 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47f759-f7a2-4d79-b0c8-e5c1a4e19718 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:09.731153 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47f759-f7a2-4d79-b0c8-e5c1a4e19718 None admin] PATH_INFO: `/v3/users/25bea438d9bc4701a8ff368969074002` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:09.733106 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47f759-f7a2-4d79-b0c8-e5c1a4e19718 None admin] RBAC: Authorizing `identity:get_user(user_id=25bea438d9bc4701a8ff368969074002)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:09.734825 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47f759-f7a2-4d79-b0c8-e5c1a4e19718 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:09.736615 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 77/146] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:09 2022] GET /identity/v3/users/25bea438d9bc4701a8ff368969074002 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:09.742598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93bbd9-7f5f-4b8c-92a8-cd2224409c43 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:09.867075 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:09.870259 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93bbd9-7f5f-4b8c-92a8-cd2224409c43 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:09.907215 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e18a2-953b-407c-a269-da026d27317a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:09.907888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e18a2-953b-407c-a269-da026d27317a None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:09.908179 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e18a2-953b-407c-a269-da026d27317a None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:09.908466 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e18a2-953b-407c-a269-da026d27317a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:09.987425 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e18a2-953b-407c-a269-da026d27317a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:09.988986 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e18a2-953b-407c-a269-da026d27317a None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:10.093574 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:10.101989 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 70/147] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:37:10.103364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47f759-f7a2-4d79-b0c8-e5c1a4e19718 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:10.238247 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:10.252128 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47f759-f7a2-4d79-b0c8-e5c1a4e19718 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:10.292151 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d23ea-5ad4-405e-95e3-f60e3e1c89be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:10.293068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d23ea-5ad4-405e-95e3-f60e3e1c89be None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:10.293356 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d23ea-5ad4-405e-95e3-f60e3e1c89be None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:10.293631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d23ea-5ad4-405e-95e3-f60e3e1c89be None admin] PATH_INFO: `/v3/projects/16957e4778784bc187de225af6d1e1db` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:10.295739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d23ea-5ad4-405e-95e3-f60e3e1c89be None admin] RBAC: Authorizing `identity:get_project(project_id=16957e4778784bc187de225af6d1e1db)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:10.297327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d23ea-5ad4-405e-95e3-f60e3e1c89be None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:10.299193 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 78/148] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:10 2022] GET /identity/v3/projects/16957e4778784bc187de225af6d1e1db => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:10.314530 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e18a2-953b-407c-a269-da026d27317a None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:10.430339 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e18a2-953b-407c-a269-da026d27317a None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:10.468055 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e1a6d-a716-4adf-9f5a-af047ba116f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:10.469099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e1a6d-a716-4adf-9f5a-af047ba116f8 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:10.469593 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e1a6d-a716-4adf-9f5a-af047ba116f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:10.470125 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e1a6d-a716-4adf-9f5a-af047ba116f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:10.471187 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e1a6d-a716-4adf-9f5a-af047ba116f8 None admin] RBAC: Adding query filter params (role.id=abdc0e0957534149b3653eaa33cbd054, scope.project.id=16957e4778784bc187de225af6d1e1db, user.id=25bea438d9bc4701a8ff368969074002) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:10.471721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e1a6d-a716-4adf-9f5a-af047ba116f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:10.473407 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e1a6d-a716-4adf-9f5a-af047ba116f8 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:10.480578 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 71/149] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:37:10 2022] GET /identity/v3/role_assignments?user.id=25bea438d9bc4701a8ff368969074002&scope.project.id=16957e4778784bc187de225af6d1e1db&role.id=abdc0e0957534149b3653eaa33cbd054 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:10.567329 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21a3a7-92ac-4abc-8557-e6011c7fad76 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:10.567624 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21a3a7-92ac-4abc-8557-e6011c7fad76 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:10.567905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21a3a7-92ac-4abc-8557-e6011c7fad76 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:10.569366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 79/150] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:10.575313 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592a730-7db1-4aa7-9426-6b67bc1c063f None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:10.575738 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592a730-7db1-4aa7-9426-6b67bc1c063f None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:10.576702 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592a730-7db1-4aa7-9426-6b67bc1c063f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:10.602516 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-e592a730-7db1-4aa7-9426-6b67bc1c063f None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:10.603738 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-e592a730-7db1-4aa7-9426-6b67bc1c063f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:10.683769 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:10.696429 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 72/151] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 15:37:10.719277 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21a3a7-92ac-4abc-8557-e6011c7fad76 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:10.845968 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21a3a7-92ac-4abc-8557-e6011c7fad76 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:10.889258 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29c3d4-8d81-41ef-8924-656e1c5f7146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:10.890100 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29c3d4-8d81-41ef-8924-656e1c5f7146 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:10.890387 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29c3d4-8d81-41ef-8924-656e1c5f7146 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:10.890671 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29c3d4-8d81-41ef-8924-656e1c5f7146 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:10.906565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29c3d4-8d81-41ef-8924-656e1c5f7146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:10.914745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-cf29c3d4-8d81-41ef-8924-656e1c5f7146 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 15:37:10.914745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:10.914745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:10.914745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:10.914745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:10.914745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:10.914745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:10.914745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:10.914745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:10.914745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:10.914745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:10.914745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:10.914745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:10.914745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:10.914745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:10.914745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:10.915645 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:10.915645 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:10.915645 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:10.915645 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:10.915645 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:10.915645 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:10.915645 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:10.915645 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:10.915645 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:10.915645 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:10.915645 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:10.915645 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:10.915645 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:10.915645 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:10.915645 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:10.915645 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:10.916403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:10.916403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:10.916403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:10.916403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:10.916403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:10.916403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:10.916403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:10.916403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:10.916403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:10.916403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:10.916403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 15:37:10.916403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:10.916403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 80/152] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:10.923525 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592a730-7db1-4aa7-9426-6b67bc1c063f None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:11.033963 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592a730-7db1-4aa7-9426-6b67bc1c063f None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:11.073647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9964fa3-4083-455a-a44c-2fcafea1298e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:11.074377 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9964fa3-4083-455a-a44c-2fcafea1298e None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:11.074946 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9964fa3-4083-455a-a44c-2fcafea1298e None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:11.075229 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9964fa3-4083-455a-a44c-2fcafea1298e None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:11.076027 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9964fa3-4083-455a-a44c-2fcafea1298e None admin] RBAC: Adding query filter params (name=reader) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:11.076877 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9964fa3-4083-455a-a44c-2fcafea1298e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:11.078304 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9964fa3-4083-455a-a44c-2fcafea1298e None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:11.088082 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 73/153] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:11.094634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29c3d4-8d81-41ef-8924-656e1c5f7146 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:11.115611 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:11.211785 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29c3d4-8d81-41ef-8924-656e1c5f7146 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:11.248938 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203f707-f147-459b-b6e3-3c94a47d5716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:11.249836 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203f707-f147-459b-b6e3-3c94a47d5716 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:11.250166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203f707-f147-459b-b6e3-3c94a47d5716 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:11.250407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203f707-f147-459b-b6e3-3c94a47d5716 None admin] PATH_INFO: `/v3/users/5b213258c16a445e8ae628e473bc78f6` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:11.254640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203f707-f147-459b-b6e3-3c94a47d5716 None admin] RBAC: Authorizing `identity:get_user(user_id=5b213258c16a445e8ae628e473bc78f6)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:11.256194 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203f707-f147-459b-b6e3-3c94a47d5716 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:11.258101 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 81/154] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:11 2022] GET /identity/v3/users/5b213258c16a445e8ae628e473bc78f6 => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:11.264496 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9964fa3-4083-455a-a44c-2fcafea1298e None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:11.334237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:11.351202 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c9644-6c51-42c7-9358-9e873db299db None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:11.351541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c9644-6c51-42c7-9358-9e873db299db None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:11.351768 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c9644-6c51-42c7-9358-9e873db299db None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:11.353155 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 82/155] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:11.363559 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93e3c2-38da-4af9-b82a-c7efd21617ee None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:11.363857 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93e3c2-38da-4af9-b82a-c7efd21617ee None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:11.364123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93e3c2-38da-4af9-b82a-c7efd21617ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:11.404386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-7e93e3c2-38da-4af9-b82a-c7efd21617ee None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:11.407636 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-7e93e3c2-38da-4af9-b82a-c7efd21617ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:11.447174 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9964fa3-4083-455a-a44c-2fcafea1298e None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:11.535102 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b3967-0007-46ca-b334-606ba2739afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:11.535990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b3967-0007-46ca-b334-606ba2739afb None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:11.536277 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b3967-0007-46ca-b334-606ba2739afb None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:11.536554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47b3967-0007-46ca-b334-606ba2739afb None admin] PATH_INFO: `/v3/projects/16957e4778784bc187de225af6d1e1db` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:11.541983 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b3967-0007-46ca-b334-606ba2739afb None admin] RBAC: Authorizing `identity:get_project(project_id=16957e4778784bc187de225af6d1e1db)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:11.547697 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47b3967-0007-46ca-b334-606ba2739afb None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:11.547697 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 74/156] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:11 2022] GET /identity/v3/projects/16957e4778784bc187de225af6d1e1db => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:11.553612 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b3967-0007-46ca-b334-606ba2739afb None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:11.578813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 83/157] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 15:37:11.614258 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93e3c2-38da-4af9-b82a-c7efd21617ee None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:11.638098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:11.771530 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47b3967-0007-46ca-b334-606ba2739afb None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:11.804168 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93e3c2-38da-4af9-b82a-c7efd21617ee None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:11.811568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:11.845130 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb8a89-680e-451a-ab08-7e8c1c576b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:11.846668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb8a89-680e-451a-ab08-7e8c1c576b6f None admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:11.847027 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb8a89-680e-451a-ab08-7e8c1c576b6f None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:11.847309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb8a89-680e-451a-ab08-7e8c1c576b6f None admin] PATH_INFO: `/v3/projects/16957e4778784bc187de225af6d1e1db/users/5b213258c16a445e8ae628e473bc78f6/roles/a655cf8750c8442eb3cce5c771188a99` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:11.859567 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb8a89-680e-451a-ab08-7e8c1c576b6f None admin] RBAC: Authorizing `identity:create_grant(project_id=16957e4778784bc187de225af6d1e1db, user_id=5b213258c16a445e8ae628e473bc78f6, role_id=a655cf8750c8442eb3cce5c771188a99)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:11.861024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfcd710-fc4c-42e8-b36c-fd4fad7938d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:11.861194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb8a89-680e-451a-ab08-7e8c1c576b6f None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:11.862157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcd710-fc4c-42e8-b36c-fd4fad7938d7 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:11.862600 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcd710-fc4c-42e8-b36c-fd4fad7938d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:11.863026 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfcd710-fc4c-42e8-b36c-fd4fad7938d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:11.884303 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 75/158] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 23 15:37:11 2022] PUT /identity/v3/projects/16957e4778784bc187de225af6d1e1db/users/5b213258c16a445e8ae628e473bc78f6/roles/a655cf8750c8442eb3cce5c771188a99 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:37:11.889435 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfcd710-fc4c-42e8-b36c-fd4fad7938d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:11.897495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-edfcd710-fc4c-42e8-b36c-fd4fad7938d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:11.897495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:11.897495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:11.897495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:11.897495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:11.897495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:11.897495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:11.897495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:11.897495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:11.897495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:11.897495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:11.897495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:11.897495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:11.897495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:11.897495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:11.897495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:11.898653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:11.898653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:11.898653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:11.898653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:11.898653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:11.898653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:11.898653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:11.898653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:11.898653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:11.898653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:11.898653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:11.898653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:11.898653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:11.898653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:11.898653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:11.898653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:11.899642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:11.899642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:11.899642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:11.899642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:11.899642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:11.899642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:11.899642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:11.899642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:11.899642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:11.899642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:11.899642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:11.899642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:11.907711 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 84/159] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:11.913301 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb8a89-680e-451a-ab08-7e8c1c576b6f None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:11.998400 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feab251-fd49-4b6b-9f36-ab43d8378fc3 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:11.998697 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feab251-fd49-4b6b-9f36-ab43d8378fc3 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:11.998982 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feab251-fd49-4b6b-9f36-ab43d8378fc3 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:12.000430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 85/160] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:12.006518 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9b1ba-3be5-455f-88b8-44ad22ac38f8 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:12.006863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9b1ba-3be5-455f-88b8-44ad22ac38f8 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:12.007154 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9b1ba-3be5-455f-88b8-44ad22ac38f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:12.047077 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-b7f9b1ba-3be5-455f-88b8-44ad22ac38f8 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:12.050658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-b7f9b1ba-3be5-455f-88b8-44ad22ac38f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:12.069092 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb8a89-680e-451a-ab08-7e8c1c576b6f None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:12.156942 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fa343-f5bc-40f6-8fcc-a648fb22c213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:12.157632 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fa343-f5bc-40f6-8fcc-a648fb22c213 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:12.157942 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fa343-f5bc-40f6-8fcc-a648fb22c213 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:12.158225 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fa343-f5bc-40f6-8fcc-a648fb22c213 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:12.159174 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13fa343-f5bc-40f6-8fcc-a648fb22c213 None admin] RBAC: Adding query filter params (name=member) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:12.159487 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13fa343-f5bc-40f6-8fcc-a648fb22c213 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:12.161235 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13fa343-f5bc-40f6-8fcc-a648fb22c213 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:12.179988 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 76/161] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:12.187538 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fa343-f5bc-40f6-8fcc-a648fb22c213 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:12.213257 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 86/162] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:12.253803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9b1ba-3be5-455f-88b8-44ad22ac38f8 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:12.263258 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:12.284938 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:12.377704 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fa343-f5bc-40f6-8fcc-a648fb22c213 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:12.426276 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9b1ba-3be5-455f-88b8-44ad22ac38f8 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:12.450202 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac937f1-7311-48df-a88f-659f1d1f5beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:12.451128 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac937f1-7311-48df-a88f-659f1d1f5beb None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:12.451418 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac937f1-7311-48df-a88f-659f1d1f5beb None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:12.451705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac937f1-7311-48df-a88f-659f1d1f5beb None admin] PATH_INFO: `/v3/users/7fe27f63d24a4cff85a9c0ae32b154cc` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:12.453090 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac937f1-7311-48df-a88f-659f1d1f5beb None admin] RBAC: Authorizing `identity:get_user(user_id=7fe27f63d24a4cff85a9c0ae32b154cc)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:12.454583 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac937f1-7311-48df-a88f-659f1d1f5beb None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:12.456408 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 77/163] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:12 2022] GET /identity/v3/users/7fe27f63d24a4cff85a9c0ae32b154cc => generated 275 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:37:12.462139 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac937f1-7311-48df-a88f-659f1d1f5beb None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:12.489313 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8594b73-876c-42cd-93d7-c9acf71e2724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:12.490832 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8594b73-876c-42cd-93d7-c9acf71e2724 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:12.491476 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8594b73-876c-42cd-93d7-c9acf71e2724 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:12.491976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8594b73-876c-42cd-93d7-c9acf71e2724 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:12.508380 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8594b73-876c-42cd-93d7-c9acf71e2724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:12.522782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-e8594b73-876c-42cd-93d7-c9acf71e2724 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:12.522782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:12.522782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:12.522782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:12.522782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:12.522782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:12.522782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:12.522782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:12.522782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:12.522782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:12.522782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:12.522782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:12.522782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:12.522782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:12.522782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:12.522782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:12.523722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:12.523722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:12.523722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:12.523722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:12.523722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:12.523722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:12.523722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:12.523722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:12.523722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:12.523722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:12.523722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:12.523722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:12.523722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:12.523722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:12.523722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:12.523722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:12.524909 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:12.524909 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:12.524909 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:12.524909 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:12.524909 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:12.524909 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:12.524909 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:12.524909 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:12.524909 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:12.524909 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:12.524909 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:12.524909 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:12.524909 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 87/164] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 23 15:37:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:37:12.529762 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8594b73-876c-42cd-93d7-c9acf71e2724 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:12.628637 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:12.684654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8594b73-876c-42cd-93d7-c9acf71e2724 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:12.718873 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac937f1-7311-48df-a88f-659f1d1f5beb None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:12.743873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c37f30-7f91-4820-b135-1c7c55ce4090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:12.744567 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c37f30-7f91-4820-b135-1c7c55ce4090 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:12.744853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c37f30-7f91-4820-b135-1c7c55ce4090 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:12.745135 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c37f30-7f91-4820-b135-1c7c55ce4090 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:12.745944 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c37f30-7f91-4820-b135-1c7c55ce4090 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:12.746262 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c37f30-7f91-4820-b135-1c7c55ce4090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:12.747874 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c37f30-7f91-4820-b135-1c7c55ce4090 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:12.755142 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:12.760019 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 88/165] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:37:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:12.766141 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c37f30-7f91-4820-b135-1c7c55ce4090 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:12.796119 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d4a07c-3c69-4531-8b5f-53462bd4eadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:12.796852 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4a07c-3c69-4531-8b5f-53462bd4eadf None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:12.797142 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4a07c-3c69-4531-8b5f-53462bd4eadf None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:12.797472 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4a07c-3c69-4531-8b5f-53462bd4eadf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:12.895142 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c37f30-7f91-4820-b135-1c7c55ce4090 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:12.925149 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:12.936755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199f43c-a053-486f-9a3a-79a65310b039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:12.937987 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199f43c-a053-486f-9a3a-79a65310b039 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:12.938439 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199f43c-a053-486f-9a3a-79a65310b039 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:12.938874 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199f43c-a053-486f-9a3a-79a65310b039 None admin] PATH_INFO: `/v3/users/7fe27f63d24a4cff85a9c0ae32b154cc` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:12.939126 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4a07c-3c69-4531-8b5f-53462bd4eadf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:12.940495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199f43c-a053-486f-9a3a-79a65310b039 None admin] RBAC: Authorizing `identity:get_user(user_id=7fe27f63d24a4cff85a9c0ae32b154cc)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:12.940631 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d4a07c-3c69-4531-8b5f-53462bd4eadf None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:12.942261 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199f43c-a053-486f-9a3a-79a65310b039 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:12.944136 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 89/166] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:12 2022] GET /identity/v3/users/7fe27f63d24a4cff85a9c0ae32b154cc => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:12.945581 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3b31d-014d-4f00-9b4b-68ff1c38a550 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:12.946040 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3b31d-014d-4f00-9b4b-68ff1c38a550 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:12.946482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3b31d-014d-4f00-9b4b-68ff1c38a550 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:12.948220 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 90/167] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:12.954080 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3b31d-014d-4f00-9b4b-68ff1c38a550 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:13.133741 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3b31d-014d-4f00-9b4b-68ff1c38a550 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:13.136520 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 78/168] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:37:13.142994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382047f7-96c3-474d-918c-233288c185c9 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:13.145273 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382047f7-96c3-474d-918c-233288c185c9 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:13.145730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382047f7-96c3-474d-918c-233288c185c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:13.179739 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-382047f7-96c3-474d-918c-233288c185c9 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:13.183932 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-382047f7-96c3-474d-918c-233288c185c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:13.206207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:13.208413 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a35047-c191-44d1-b452-a2b874f48a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:13.209141 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a35047-c191-44d1-b452-a2b874f48a4e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:13.209447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a35047-c191-44d1-b452-a2b874f48a4e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:13.209731 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a35047-c191-44d1-b452-a2b874f48a4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:13.340774 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 79/169] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:13.341465 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382047f7-96c3-474d-918c-233288c185c9 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:13.378218 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:13.396743 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a35047-c191-44d1-b452-a2b874f48a4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:13.398241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a35047-c191-44d1-b452-a2b874f48a4e None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:13.580321 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382047f7-96c3-474d-918c-233288c185c9 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:13.642376 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 91/170] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:37:13.643617 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a35047-c191-44d1-b452-a2b874f48a4e None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:13.671868 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f5284-02f6-4c79-9706-9a1dd0816540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:13.672698 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f5284-02f6-4c79-9706-9a1dd0816540 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:13.673353 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f5284-02f6-4c79-9706-9a1dd0816540 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:13.673637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f5284-02f6-4c79-9706-9a1dd0816540 None admin] PATH_INFO: `/v3/projects/16957e4778784bc187de225af6d1e1db` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:13.674911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f5284-02f6-4c79-9706-9a1dd0816540 None admin] RBAC: Authorizing `identity:get_project(project_id=16957e4778784bc187de225af6d1e1db)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:13.676391 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f5284-02f6-4c79-9706-9a1dd0816540 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:13.678191 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 80/171] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:13 2022] GET /identity/v3/projects/16957e4778784bc187de225af6d1e1db => generated 298 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:13.678985 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f5284-02f6-4c79-9706-9a1dd0816540 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:13.728419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:13.817987 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:13.825000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a35047-c191-44d1-b452-a2b874f48a4e None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:13.873106 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e0b68-0e81-49b1-ac54-34f5d5084bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:13.874685 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e0b68-0e81-49b1-ac54-34f5d5084bbc None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:13.875038 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e0b68-0e81-49b1-ac54-34f5d5084bbc None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:13.875629 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e0b68-0e81-49b1-ac54-34f5d5084bbc None admin] PATH_INFO: `/v3/roles/member` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:13.880459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f5284-02f6-4c79-9706-9a1dd0816540 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:13.891072 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e0b68-0e81-49b1-ac54-34f5d5084bbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:13.904769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-ad3e0b68-0e81-49b1-ac54-34f5d5084bbc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:13.904769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:13.904769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:13.904769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:13.904769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:13.904769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:13.904769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:13.904769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:13.904769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:13.904769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:13.904769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:13.904769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:13.904769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:13.904769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:13.904769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:13.904769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:13.906166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:13.906166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:13.906166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:13.906166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:13.906166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:13.906166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:13.906166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:13.906166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:13.906166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:13.906166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:13.906166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:13.906166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:13.906166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:13.906166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:13.906166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:13.906166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:13.907013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:13.907013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:13.907013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:13.907013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:13.907013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:13.907013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:13.907013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:13.907013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:13.907013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:13.907013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:13.907013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:13.907013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:13.907588 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 92/172] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:13.909403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e0b68-0e81-49b1-ac54-34f5d5084bbc None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:13.928819 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90c2e1-1dc5-44e2-a826-acb0754b609b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:13.929799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90c2e1-1dc5-44e2-a826-acb0754b609b None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:13.930323 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90c2e1-1dc5-44e2-a826-acb0754b609b None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:13.930811 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90c2e1-1dc5-44e2-a826-acb0754b609b None admin] PATH_INFO: `/v3/projects/16957e4778784bc187de225af6d1e1db` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:13.932821 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90c2e1-1dc5-44e2-a826-acb0754b609b None admin] RBAC: Authorizing `identity:get_project(project_id=16957e4778784bc187de225af6d1e1db)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:13.934765 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90c2e1-1dc5-44e2-a826-acb0754b609b None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:13.942130 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 81/173] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:13 2022] GET /identity/v3/projects/16957e4778784bc187de225af6d1e1db => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:13.943574 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22b200-11a2-4bfe-8ba7-4db81c05f2e9 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:13.943869 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22b200-11a2-4bfe-8ba7-4db81c05f2e9 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:13.944267 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22b200-11a2-4bfe-8ba7-4db81c05f2e9 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:13.945981 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 82/174] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:13.947107 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8781c7d-c60f-4285-b85d-2fb97b95014b None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:13.947393 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8781c7d-c60f-4285-b85d-2fb97b95014b None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:13.947670 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8781c7d-c60f-4285-b85d-2fb97b95014b None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:13.954094 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 83/175] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:13.955055 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8781c7d-c60f-4285-b85d-2fb97b95014b None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:14.044164 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e0b68-0e81-49b1-ac54-34f5d5084bbc None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:14.071821 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:14.081682 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930a105-568e-4718-9f5b-ee8545302187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:14.082458 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930a105-568e-4718-9f5b-ee8545302187 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:14.082746 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930a105-568e-4718-9f5b-ee8545302187 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:14.083027 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930a105-568e-4718-9f5b-ee8545302187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:14.083900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930a105-568e-4718-9f5b-ee8545302187 None admin] RBAC: Adding query filter params (role.id=2362b672eb7b474dbd341608f3993123, scope.project.id=16957e4778784bc187de225af6d1e1db, user.id=7fe27f63d24a4cff85a9c0ae32b154cc) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:14.084216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930a105-568e-4718-9f5b-ee8545302187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:14.086211 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930a105-568e-4718-9f5b-ee8545302187 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:14.092903 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 93/176] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:37:13 2022] GET /identity/v3/role_assignments?user.id=7fe27f63d24a4cff85a9c0ae32b154cc&scope.project.id=16957e4778784bc187de225af6d1e1db&role.id=2362b672eb7b474dbd341608f3993123 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:14.093643 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930a105-568e-4718-9f5b-ee8545302187 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:14.103117 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8781c7d-c60f-4285-b85d-2fb97b95014b None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:14.133283 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:14.164775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1d430-7ab0-4ef0-8e6d-6efb9baeb91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:14.166255 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1d430-7ab0-4ef0-8e6d-6efb9baeb91f None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:14.166742 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1d430-7ab0-4ef0-8e6d-6efb9baeb91f None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:14.167263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1d430-7ab0-4ef0-8e6d-6efb9baeb91f None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:14.169050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1d430-7ab0-4ef0-8e6d-6efb9baeb91f None admin] RBAC: Adding query filter params (name=member) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:14.169613 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1d430-7ab0-4ef0-8e6d-6efb9baeb91f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:14.171924 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1d430-7ab0-4ef0-8e6d-6efb9baeb91f None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:14.186845 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 84/177] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:14.188939 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127c4cc-4d9f-4c77-8cfe-1e44e257ab80 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:14.190123 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127c4cc-4d9f-4c77-8cfe-1e44e257ab80 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:14.191290 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127c4cc-4d9f-4c77-8cfe-1e44e257ab80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:14.222694 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-2127c4cc-4d9f-4c77-8cfe-1e44e257ab80 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:14.223931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-2127c4cc-4d9f-4c77-8cfe-1e44e257ab80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:14.270756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930a105-568e-4718-9f5b-ee8545302187 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:14.315256 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8182a-fb49-4b78-b029-386e2a213120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:14.316847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8182a-fb49-4b78-b029-386e2a213120 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:14.317353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8182a-fb49-4b78-b029-386e2a213120 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:14.317837 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8182a-fb49-4b78-b029-386e2a213120 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:14.318941 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8182a-fb49-4b78-b029-386e2a213120 None admin] RBAC: Adding query filter params (role.id=12fa8f67cf514b1e916afc130f0e6008, scope.project.id=16957e4778784bc187de225af6d1e1db, user.id=7fe27f63d24a4cff85a9c0ae32b154cc) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:14.319455 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8182a-fb49-4b78-b029-386e2a213120 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:14.319886 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 85/178] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:14.321331 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bfdf0-1ae4-4f39-9814-d58a39a1df2c None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:14.321579 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8182a-fb49-4b78-b029-386e2a213120 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:14.321691 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bfdf0-1ae4-4f39-9814-d58a39a1df2c None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:14.322001 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bfdf0-1ae4-4f39-9814-d58a39a1df2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:14.329520 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 94/179] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:37:14 2022] GET /identity/v3/role_assignments?user.id=7fe27f63d24a4cff85a9c0ae32b154cc&scope.project.id=16957e4778784bc187de225af6d1e1db&role.id=12fa8f67cf514b1e916afc130f0e6008 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:14.331131 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925899d7-442f-45a8-b7ee-57fc96dca93e None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:14.331642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925899d7-442f-45a8-b7ee-57fc96dca93e None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:14.332138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925899d7-442f-45a8-b7ee-57fc96dca93e None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:14.333680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 95/180] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:14.334685 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925899d7-442f-45a8-b7ee-57fc96dca93e None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:14.363103 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-8e6bfdf0-1ae4-4f39-9814-d58a39a1df2c None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:14.365890 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-8e6bfdf0-1ae4-4f39-9814-d58a39a1df2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:14.453494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 86/181] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:14.455222 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a6f45-596c-44db-b86b-ecbab7e59389 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:14.455767 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a6f45-596c-44db-b86b-ecbab7e59389 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:14.456299 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a6f45-596c-44db-b86b-ecbab7e59389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:14.467886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:14.469237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:14.489992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-597a6f45-596c-44db-b86b-ecbab7e59389 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:14.491854 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-597a6f45-596c-44db-b86b-ecbab7e59389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:14.508324 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925899d7-442f-45a8-b7ee-57fc96dca93e None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:14.558680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26ecd9-65f7-4c05-a7ab-42a1d4cc8c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:14.560322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26ecd9-65f7-4c05-a7ab-42a1d4cc8c82 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:14.561603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26ecd9-65f7-4c05-a7ab-42a1d4cc8c82 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:14.562054 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26ecd9-65f7-4c05-a7ab-42a1d4cc8c82 None admin] PATH_INFO: `/v3/users/7fe27f63d24a4cff85a9c0ae32b154cc` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:14.564937 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26ecd9-65f7-4c05-a7ab-42a1d4cc8c82 None admin] RBAC: Authorizing `identity:get_user(user_id=7fe27f63d24a4cff85a9c0ae32b154cc)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:14.566471 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26ecd9-65f7-4c05-a7ab-42a1d4cc8c82 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:14.568454 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 96/182] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:14 2022] GET /identity/v3/users/7fe27f63d24a4cff85a9c0ae32b154cc => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:14.569010 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26ecd9-65f7-4c05-a7ab-42a1d4cc8c82 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:14.604213 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 87/183] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:14.606225 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a6f45-596c-44db-b86b-ecbab7e59389 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:14.720742 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26ecd9-65f7-4c05-a7ab-42a1d4cc8c82 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:14.754840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a6f45-596c-44db-b86b-ecbab7e59389 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:14.764502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cb772-0fbe-4e77-910c-1457e4273170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:14.765322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cb772-0fbe-4e77-910c-1457e4273170 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:14.765601 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cb772-0fbe-4e77-910c-1457e4273170 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:14.765903 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cb772-0fbe-4e77-910c-1457e4273170 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:14.781078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7cb772-0fbe-4e77-910c-1457e4273170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:14.789216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-bb7cb772-0fbe-4e77-910c-1457e4273170 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:14.789216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:14.789216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:14.789216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:14.789216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:14.789216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:14.789216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:14.789216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:14.789216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:14.789216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:14.789216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:14.789216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:14.789216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:14.789216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:14.789216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:14.789216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:14.790327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:14.790327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:14.790327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:14.790327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:14.790327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:14.790327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:14.790327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:14.790327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:14.790327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:14.790327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:14.790327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:14.790327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:14.790327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:14.790327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:14.790327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:14.790327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:14.791399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:14.791399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:14.791399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:14.791399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:14.791399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:14.791399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:14.791399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:14.791399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:14.791399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:14.791399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:14.791399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:14.791399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:14.791399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 97/184] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 23 15:37:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:14.792137 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cb772-0fbe-4e77-910c-1457e4273170 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:14.798412 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:14.805359 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6588d0a-6d9b-4d33-ac9c-c5edf3227a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:14.806457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6588d0a-6d9b-4d33-ac9c-c5edf3227a08 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:14.806887 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6588d0a-6d9b-4d33-ac9c-c5edf3227a08 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:14.807294 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6588d0a-6d9b-4d33-ac9c-c5edf3227a08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:14.810178 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:14.821001 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6588d0a-6d9b-4d33-ac9c-c5edf3227a08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:14.829844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-b6588d0a-6d9b-4d33-ac9c-c5edf3227a08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:37:14.829844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:14.829844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:14.829844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:14.829844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:14.829844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:14.829844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:14.829844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:14.829844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:14.829844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:14.829844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:14.829844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:14.829844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:14.829844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:14.829844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:14.829844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:14.830766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:14.830766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:14.830766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:14.830766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:14.830766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:14.830766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:14.830766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:14.830766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:14.830766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:14.830766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:14.830766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:14.830766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:14.830766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:14.830766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:14.830766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:14.830766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:14.831545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:14.831545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:14.831545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:14.831545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:14.831545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:14.831545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:14.831545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:14.831545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:14.831545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:14.831545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:14.831545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:37:14.831545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:14.831545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 88/185] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:37:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:14.832484 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6588d0a-6d9b-4d33-ac9c-c5edf3227a08 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:14.918202 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cb772-0fbe-4e77-910c-1457e4273170 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:14.948246 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6588d0a-6d9b-4d33-ac9c-c5edf3227a08 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:14.961183 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0a8f4-49bb-49ca-be4f-7df08e982aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:14.961843 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0a8f4-49bb-49ca-be4f-7df08e982aac None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:14.962164 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0a8f4-49bb-49ca-be4f-7df08e982aac None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:14.962441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0a8f4-49bb-49ca-be4f-7df08e982aac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:14.985389 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1009b8c-a81e-4299-b5d4-a4e340d6a89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:14.987279 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1009b8c-a81e-4299-b5d4-a4e340d6a89b None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:14.987279 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1009b8c-a81e-4299-b5d4-a4e340d6a89b None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:14.987279 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1009b8c-a81e-4299-b5d4-a4e340d6a89b None admin] PATH_INFO: `/v3/domains/default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:14.988794 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1009b8c-a81e-4299-b5d4-a4e340d6a89b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:14.991069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1009b8c-a81e-4299-b5d4-a4e340d6a89b None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:14.992734 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 89/186] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:37:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:14.993507 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1009b8c-a81e-4299-b5d4-a4e340d6a89b None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:15.035760 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0a8f4-49bb-49ca-be4f-7df08e982aac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:15.037246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0a8f4-49bb-49ca-be4f-7df08e982aac None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:15.050205 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:15.059570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:15.102109 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1009b8c-a81e-4299-b5d4-a4e340d6a89b None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:15.139089 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6280d-6935-46f7-bf32-3aff6defd2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:15.139901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6280d-6935-46f7-bf32-3aff6defd2f9 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:15.140330 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6280d-6935-46f7-bf32-3aff6defd2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:15.140660 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6280d-6935-46f7-bf32-3aff6defd2f9 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:15.141425 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6280d-6935-46f7-bf32-3aff6defd2f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:15.141970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6280d-6935-46f7-bf32-3aff6defd2f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:15.143339 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6280d-6935-46f7-bf32-3aff6defd2f9 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:15.147751 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 98/187] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:37:15.152378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0a8f4-49bb-49ca-be4f-7df08e982aac None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:15.157684 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 90/188] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:37:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:15.159059 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c81b5-3d04-4c28-92fe-2458437920b5 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:15.160292 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c81b5-3d04-4c28-92fe-2458437920b5 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:15.160292 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c81b5-3d04-4c28-92fe-2458437920b5 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:15.166774 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 91/189] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:15.166774 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c81b5-3d04-4c28-92fe-2458437920b5 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:15.263339 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0a8f4-49bb-49ca-be4f-7df08e982aac None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:15.276710 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:15.276900 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c81b5-3d04-4c28-92fe-2458437920b5 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:15.303312 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:15.310142 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1477fa-e772-4634-9836-ab518aa2ee87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:15.310830 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1477fa-e772-4634-9836-ab518aa2ee87 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:15.311116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1477fa-e772-4634-9836-ab518aa2ee87 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:15.311395 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1477fa-e772-4634-9836-ab518aa2ee87 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:15.312153 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1477fa-e772-4634-9836-ab518aa2ee87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:15.312465 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1477fa-e772-4634-9836-ab518aa2ee87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:15.313894 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1477fa-e772-4634-9836-ab518aa2ee87 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:15.315296 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9fd90-55d2-46e6-8d0a-06d32c25eebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:15.315972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9fd90-55d2-46e6-8d0a-06d32c25eebe None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:15.316261 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9fd90-55d2-46e6-8d0a-06d32c25eebe None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:15.316535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9fd90-55d2-46e6-8d0a-06d32c25eebe None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:15.317255 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9fd90-55d2-46e6-8d0a-06d32c25eebe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:15.318724 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9fd90-55d2-46e6-8d0a-06d32c25eebe None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:15.322565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 99/190] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:15.322565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1477fa-e772-4634-9836-ab518aa2ee87 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:15.344451 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 92/191] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 23 15:37:15 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:37:15.345373 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9fd90-55d2-46e6-8d0a-06d32c25eebe None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:15.460475 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1477fa-e772-4634-9836-ab518aa2ee87 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:15.484435 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9fd90-55d2-46e6-8d0a-06d32c25eebe None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:15.504049 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4b6b7-0bd7-4524-9295-0656df672be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:15.504938 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4b6b7-0bd7-4524-9295-0656df672be0 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:15.505221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4b6b7-0bd7-4524-9295-0656df672be0 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:15.505501 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4b6b7-0bd7-4524-9295-0656df672be0 None admin] PATH_INFO: `/v3/projects/8749ab0d4cfb47f892c215d10a6c1a1d` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:15.506785 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4b6b7-0bd7-4524-9295-0656df672be0 None admin] RBAC: Authorizing `identity:get_project(project_id=8749ab0d4cfb47f892c215d10a6c1a1d)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:15.508247 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4b6b7-0bd7-4524-9295-0656df672be0 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:15.510030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 100/192] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:15 2022] GET /identity/v3/projects/8749ab0d4cfb47f892c215d10a6c1a1d => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:15.511319 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275cdcc-9987-4c43-ac72-34db66062547 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:15.511609 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275cdcc-9987-4c43-ac72-34db66062547 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:15.511888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275cdcc-9987-4c43-ac72-34db66062547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:15.530048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-5275cdcc-9987-4c43-ac72-34db66062547 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:15.530730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7127a33-3c75-4d95-b289-1e7b4e03a182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:15.531443 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5275cdcc-9987-4c43-ac72-34db66062547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:15.531607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7127a33-3c75-4d95-b289-1e7b4e03a182 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:15.532069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7127a33-3c75-4d95-b289-1e7b4e03a182 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:15.532158 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7127a33-3c75-4d95-b289-1e7b4e03a182 None admin] PATH_INFO: `/v3/users/edf7adf115504e10a57f09af9408e818` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:15.551907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7127a33-3c75-4d95-b289-1e7b4e03a182 None admin] RBAC: Authorizing `identity:get_user(user_id=edf7adf115504e10a57f09af9408e818)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:15.553391 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7127a33-3c75-4d95-b289-1e7b4e03a182 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:15.555192 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 93/193] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:15 2022] GET /identity/v3/users/edf7adf115504e10a57f09af9408e818 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:15.556117 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7127a33-3c75-4d95-b289-1e7b4e03a182 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:15.577660 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:15.612488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:15.629982 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 101/194] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:15.631522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275cdcc-9987-4c43-ac72-34db66062547 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:15.696290 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7127a33-3c75-4d95-b289-1e7b4e03a182 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:15.744738 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51ed93-24d7-487d-a32a-2a47dfe0241d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:15.746193 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51ed93-24d7-487d-a32a-2a47dfe0241d None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:15.746629 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51ed93-24d7-487d-a32a-2a47dfe0241d None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:15.747218 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51ed93-24d7-487d-a32a-2a47dfe0241d None admin] PATH_INFO: `/v3/users/edf7adf115504e10a57f09af9408e818` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:15.749952 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51ed93-24d7-487d-a32a-2a47dfe0241d None admin] RBAC: Authorizing `identity:get_user(user_id=edf7adf115504e10a57f09af9408e818)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:15.752444 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51ed93-24d7-487d-a32a-2a47dfe0241d None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:15.754916 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 94/195] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:15 2022] GET /identity/v3/users/edf7adf115504e10a57f09af9408e818 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:15.756231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51ed93-24d7-487d-a32a-2a47dfe0241d None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:15.757627 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275cdcc-9987-4c43-ac72-34db66062547 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:15.808306 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5f840-e239-4184-ab84-1f57d0490391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:15.808901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5f840-e239-4184-ab84-1f57d0490391 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:15.809198 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5f840-e239-4184-ab84-1f57d0490391 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:15.809511 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5f840-e239-4184-ab84-1f57d0490391 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:15.811587 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5f840-e239-4184-ab84-1f57d0490391 None admin] RBAC: Adding query filter params (role.id=2362b672eb7b474dbd341608f3993123, scope.project.id=8749ab0d4cfb47f892c215d10a6c1a1d, user.id=7fe27f63d24a4cff85a9c0ae32b154cc) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:15.811912 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5f840-e239-4184-ab84-1f57d0490391 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:15.813911 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5f840-e239-4184-ab84-1f57d0490391 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:15.822582 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 102/196] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:37:15 2022] GET /identity/v3/role_assignments?user.id=7fe27f63d24a4cff85a9c0ae32b154cc&scope.project.id=8749ab0d4cfb47f892c215d10a6c1a1d&role.id=2362b672eb7b474dbd341608f3993123 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:15.824655 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5f840-e239-4184-ab84-1f57d0490391 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:15.926266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:15.944723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51ed93-24d7-487d-a32a-2a47dfe0241d None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:15.949322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:16.017250 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54af9b3-13e5-48ff-928b-ce2e191f5c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:16.017960 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54af9b3-13e5-48ff-928b-ce2e191f5c40 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:16.018252 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54af9b3-13e5-48ff-928b-ce2e191f5c40 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:16.018534 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54af9b3-13e5-48ff-928b-ce2e191f5c40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:16.041440 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5f840-e239-4184-ab84-1f57d0490391 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:16.102427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfe301-ba61-421a-a456-ed12e93570b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:16.103458 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfe301-ba61-421a-a456-ed12e93570b0 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:16.103916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfe301-ba61-421a-a456-ed12e93570b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:16.104362 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfe301-ba61-421a-a456-ed12e93570b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:16.124042 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bfe301-ba61-421a-a456-ed12e93570b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:16.125583 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54af9b3-13e5-48ff-928b-ce2e191f5c40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:16.127124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54af9b3-13e5-48ff-928b-ce2e191f5c40 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:16.139008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-b5bfe301-ba61-421a-a456-ed12e93570b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 15:37:16.139008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:16.139008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:16.139008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:16.139008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:16.139008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:16.139008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:16.139008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:16.139008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:16.139008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:16.139008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:16.139008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:16.139008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:16.139008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:16.139008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:16.139008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:16.139948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:16.139948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:16.139948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:16.139948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:16.139948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:16.139948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:16.139948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:16.139948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:16.139948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:16.139948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:16.139948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:16.139948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:16.139948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:16.139948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:16.139948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:16.139948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:16.140720 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:16.140720 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:16.140720 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:16.140720 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:16.140720 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:16.140720 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:16.140720 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:16.140720 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:16.140720 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:16.140720 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:16.140720 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 15:37:16.140720 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:16.140720 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 103/197] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:16.142342 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfe301-ba61-421a-a456-ed12e93570b0 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:16.274980 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 95/198] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:37:16.275820 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54af9b3-13e5-48ff-928b-ce2e191f5c40 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:16.282026 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:16.285388 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:16.291564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfe301-ba61-421a-a456-ed12e93570b0 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:16.352778 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d49d9-e58a-4fed-b9fb-c2cd47db314f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:16.353514 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d49d9-e58a-4fed-b9fb-c2cd47db314f None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:16.353847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d49d9-e58a-4fed-b9fb-c2cd47db314f None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:16.354157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d49d9-e58a-4fed-b9fb-c2cd47db314f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:16.438690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54af9b3-13e5-48ff-928b-ce2e191f5c40 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:16.443721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d49d9-e58a-4fed-b9fb-c2cd47db314f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:16.445259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d49d9-e58a-4fed-b9fb-c2cd47db314f None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:16.485302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae72c0-aec1-4982-9efc-1cd60b611b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:16.486311 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae72c0-aec1-4982-9efc-1cd60b611b38 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:16.487335 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae72c0-aec1-4982-9efc-1cd60b611b38 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:16.487766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae72c0-aec1-4982-9efc-1cd60b611b38 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:16.488671 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae72c0-aec1-4982-9efc-1cd60b611b38 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:16.489595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae72c0-aec1-4982-9efc-1cd60b611b38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:16.491872 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae72c0-aec1-4982-9efc-1cd60b611b38 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:16.505440 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 96/199] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:16.511033 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae72c0-aec1-4982-9efc-1cd60b611b38 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:16.554099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:16.570900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 104/200] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:37:16.571758 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d49d9-e58a-4fed-b9fb-c2cd47db314f None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:16.602724 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:16.656082 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae72c0-aec1-4982-9efc-1cd60b611b38 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:16.690692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d49d9-e58a-4fed-b9fb-c2cd47db314f None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:16.710811 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79faf10-c223-41ad-929c-217141bbf4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:16.712359 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79faf10-c223-41ad-929c-217141bbf4f2 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:16.713395 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79faf10-c223-41ad-929c-217141bbf4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:16.713923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79faf10-c223-41ad-929c-217141bbf4f2 None admin] PATH_INFO: `/v3/projects/89a6206a5b7347f989194e2334051714` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:16.715556 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79faf10-c223-41ad-929c-217141bbf4f2 None admin] RBAC: Authorizing `identity:get_project(project_id=89a6206a5b7347f989194e2334051714)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:16.718467 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79faf10-c223-41ad-929c-217141bbf4f2 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:16.721790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 97/201] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:16 2022] GET /identity/v3/projects/89a6206a5b7347f989194e2334051714 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:16.723189 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79faf10-c223-41ad-929c-217141bbf4f2 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:16.733397 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890f153-8383-48ec-86c1-23fcc642e0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:16.734325 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890f153-8383-48ec-86c1-23fcc642e0b5 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:16.734609 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890f153-8383-48ec-86c1-23fcc642e0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:16.734888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890f153-8383-48ec-86c1-23fcc642e0b5 None admin] PATH_INFO: `/v3/users/5b213258c16a445e8ae628e473bc78f6` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:16.736096 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890f153-8383-48ec-86c1-23fcc642e0b5 None admin] RBAC: Authorizing `identity:get_user(user_id=5b213258c16a445e8ae628e473bc78f6)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:16.737616 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890f153-8383-48ec-86c1-23fcc642e0b5 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:16.739364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 105/202] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:16 2022] GET /identity/v3/users/5b213258c16a445e8ae628e473bc78f6 => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:16.740131 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890f153-8383-48ec-86c1-23fcc642e0b5 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:16.819210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:16.874233 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890f153-8383-48ec-86c1-23fcc642e0b5 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:16.878455 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79faf10-c223-41ad-929c-217141bbf4f2 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:16.924594 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f580e-6d2e-4f88-8f52-dec11e5b481a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:16.925995 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f580e-6d2e-4f88-8f52-dec11e5b481a None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:16.926422 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f580e-6d2e-4f88-8f52-dec11e5b481a None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:16.926843 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f580e-6d2e-4f88-8f52-dec11e5b481a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:16.928506 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f580e-6d2e-4f88-8f52-dec11e5b481a None admin] RBAC: Adding query filter params (role.id=12fa8f67cf514b1e916afc130f0e6008, scope.project.id=89a6206a5b7347f989194e2334051714, user.id=edf7adf115504e10a57f09af9408e818) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:16.928983 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f580e-6d2e-4f88-8f52-dec11e5b481a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:16.931816 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f580e-6d2e-4f88-8f52-dec11e5b481a None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:16.944404 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 106/203] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:37:16 2022] GET /identity/v3/role_assignments?user.id=edf7adf115504e10a57f09af9408e818&scope.project.id=89a6206a5b7347f989194e2334051714&role.id=12fa8f67cf514b1e916afc130f0e6008 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:16.945386 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4afb8-d5d2-4a9a-838e-b7e4892e2d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:16.945566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f580e-6d2e-4f88-8f52-dec11e5b481a None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:16.947398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4afb8-d5d2-4a9a-838e-b7e4892e2d5b None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:16.948205 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4afb8-d5d2-4a9a-838e-b7e4892e2d5b None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:16.949126 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4afb8-d5d2-4a9a-838e-b7e4892e2d5b None admin] PATH_INFO: `/v3/projects/89a6206a5b7347f989194e2334051714` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:16.953721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4afb8-d5d2-4a9a-838e-b7e4892e2d5b None admin] RBAC: Authorizing `identity:get_project(project_id=89a6206a5b7347f989194e2334051714)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:16.956957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4afb8-d5d2-4a9a-838e-b7e4892e2d5b None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:16.960873 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 98/204] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:16 2022] GET /identity/v3/projects/89a6206a5b7347f989194e2334051714 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:16.968899 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4afb8-d5d2-4a9a-838e-b7e4892e2d5b None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:16.975466 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:17.102047 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f580e-6d2e-4f88-8f52-dec11e5b481a None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:17.132332 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:17.150998 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c57d5-8f40-4124-8ca5-0e8bee944c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:17.152054 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c57d5-8f40-4124-8ca5-0e8bee944c21 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:17.152543 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c57d5-8f40-4124-8ca5-0e8bee944c21 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:17.153047 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c57d5-8f40-4124-8ca5-0e8bee944c21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:17.222581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4afb8-d5d2-4a9a-838e-b7e4892e2d5b None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:17.231729 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c57d5-8f40-4124-8ca5-0e8bee944c21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:17.233570 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c57d5-8f40-4124-8ca5-0e8bee944c21 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:17.293368 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d6667-0e66-4c85-958e-e5263cb3209e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:17.294087 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d6667-0e66-4c85-958e-e5263cb3209e None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:17.294276 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d6667-0e66-4c85-958e-e5263cb3209e None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:17.294551 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d6667-0e66-4c85-958e-e5263cb3209e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:17.295449 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d6667-0e66-4c85-958e-e5263cb3209e None admin] RBAC: Adding query filter params (role.id=abdc0e0957534149b3653eaa33cbd054, scope.project.id=89a6206a5b7347f989194e2334051714, user.id=edf7adf115504e10a57f09af9408e818) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:17.295762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d6667-0e66-4c85-958e-e5263cb3209e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:17.297237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d6667-0e66-4c85-958e-e5263cb3209e None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:17.314043 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 99/205] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:37:16 2022] GET /identity/v3/role_assignments?user.id=edf7adf115504e10a57f09af9408e818&scope.project.id=89a6206a5b7347f989194e2334051714&role.id=abdc0e0957534149b3653eaa33cbd054 => generated 259 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:37:17.353024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 107/206] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:37:17.359320 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d6667-0e66-4c85-958e-e5263cb3209e None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:17.457388 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:17.504973 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d6667-0e66-4c85-958e-e5263cb3209e None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:17.545650 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a8d76-d878-4842-95f1-adaec258c5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:17.546609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a8d76-d878-4842-95f1-adaec258c5b7 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:17.546897 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a8d76-d878-4842-95f1-adaec258c5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:17.547175 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a8d76-d878-4842-95f1-adaec258c5b7 None admin] PATH_INFO: `/v3/projects/16957e4778784bc187de225af6d1e1db` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:17.549345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a8d76-d878-4842-95f1-adaec258c5b7 None admin] RBAC: Authorizing `identity:get_project(project_id=16957e4778784bc187de225af6d1e1db)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:17.550867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a8d76-d878-4842-95f1-adaec258c5b7 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:17.552661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 100/207] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:17 2022] GET /identity/v3/projects/16957e4778784bc187de225af6d1e1db => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:17.558584 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c57d5-8f40-4124-8ca5-0e8bee944c21 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:17.613427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:17.738032 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c57d5-8f40-4124-8ca5-0e8bee944c21 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:17.747368 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbbb86-df17-4a7d-b683-8363b2ee63b5 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:17.747672 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbbb86-df17-4a7d-b683-8363b2ee63b5 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:17.748003 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbbb86-df17-4a7d-b683-8363b2ee63b5 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:17.749403 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 101/208] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:37:17.759492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23918fc2-028b-4858-8a1f-c0df51fbffe6 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:17.759765 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23918fc2-028b-4858-8a1f-c0df51fbffe6 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:17.759980 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23918fc2-028b-4858-8a1f-c0df51fbffe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:17.786419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856bbbf-300f-4efe-9301-81ddf6fbc4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:17.787387 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856bbbf-300f-4efe-9301-81ddf6fbc4e2 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:17.787866 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856bbbf-300f-4efe-9301-81ddf6fbc4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:17.788310 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856bbbf-300f-4efe-9301-81ddf6fbc4e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:17.789971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856bbbf-300f-4efe-9301-81ddf6fbc4e2 None admin] RBAC: Adding query filter params (role.id=a655cf8750c8442eb3cce5c771188a99, scope.project.id=16957e4778784bc187de225af6d1e1db, user.id=5b213258c16a445e8ae628e473bc78f6) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:17.790480 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856bbbf-300f-4efe-9301-81ddf6fbc4e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:17.792117 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856bbbf-300f-4efe-9301-81ddf6fbc4e2 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:17.799774 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 108/209] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:37:17 2022] GET /identity/v3/role_assignments?user.id=5b213258c16a445e8ae628e473bc78f6&scope.project.id=16957e4778784bc187de225af6d1e1db&role.id=a655cf8750c8442eb3cce5c771188a99 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:17.805903 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-23918fc2-028b-4858-8a1f-c0df51fbffe6 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:17.806093 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-23918fc2-028b-4858-8a1f-c0df51fbffe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:17.830693 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e7d7e-eb85-4472-bb5a-552816938374 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:17.831079 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e7d7e-eb85-4472-bb5a-552816938374 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:17.831426 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e7d7e-eb85-4472-bb5a-552816938374 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:17.833007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 109/210] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:37:17.839420 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c1a18-9348-44ed-86f0-866421eef258 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:17.839744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c1a18-9348-44ed-86f0-866421eef258 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:17.839990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c1a18-9348-44ed-86f0-866421eef258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:17.864512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-175c1a18-9348-44ed-86f0-866421eef258 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:17.866135 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-175c1a18-9348-44ed-86f0-866421eef258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:17.953261 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 110/211] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 15:37:17.991162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c1a18-9348-44ed-86f0-866421eef258 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:17.992676 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 102/212] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:18.019094 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23918fc2-028b-4858-8a1f-c0df51fbffe6 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:18.041582 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:18.132851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:18.156557 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c1a18-9348-44ed-86f0-866421eef258 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:18.180518 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23918fc2-028b-4858-8a1f-c0df51fbffe6 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:18.198551 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea055e79-c5ac-4509-a827-e8e288c7c433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:18.199701 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea055e79-c5ac-4509-a827-e8e288c7c433 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:18.200285 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea055e79-c5ac-4509-a827-e8e288c7c433 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:18.201339 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea055e79-c5ac-4509-a827-e8e288c7c433 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:18.202846 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea055e79-c5ac-4509-a827-e8e288c7c433 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:18.207841 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea055e79-c5ac-4509-a827-e8e288c7c433 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:18.210342 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 111/213] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:37:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:18.217900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea055e79-c5ac-4509-a827-e8e288c7c433 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:18.230372 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de21d77-0a9e-4f7a-ab1b-3bf96075d3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:18.231168 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de21d77-0a9e-4f7a-ab1b-3bf96075d3dd None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:18.231457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de21d77-0a9e-4f7a-ab1b-3bf96075d3dd None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:18.231733 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de21d77-0a9e-4f7a-ab1b-3bf96075d3dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:18.248994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de21d77-0a9e-4f7a-ab1b-3bf96075d3dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:18.262364 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-4de21d77-0a9e-4f7a-ab1b-3bf96075d3dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:18.262364 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:18.262364 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:18.262364 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:18.262364 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:18.262364 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:18.262364 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:18.262364 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:18.262364 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:18.262364 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:18.262364 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:18.262364 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:18.262364 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:18.262364 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:18.262364 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:18.262364 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:18.263283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:18.263283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:18.263283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:18.263283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:18.263283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:18.263283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:18.263283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:18.263283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:18.263283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:18.263283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:18.263283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:18.263283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:18.263283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:18.263283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:18.263283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:18.263283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:18.264562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:18.264562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:18.264562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:18.264562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:18.264562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:18.264562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:18.264562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:18.264562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:18.264562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:18.264562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:18.264562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:18.264562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:18.267116 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 103/214] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:37:18.273154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de21d77-0a9e-4f7a-ab1b-3bf96075d3dd None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:18.331936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:18.345872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea055e79-c5ac-4509-a827-e8e288c7c433 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:18.380050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de21d77-0a9e-4f7a-ab1b-3bf96075d3dd None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:18.382123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e08ae-ea85-44b4-a155-eff7ab30429e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:18.382988 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e08ae-ea85-44b4-a155-eff7ab30429e None admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:18.383371 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e08ae-ea85-44b4-a155-eff7ab30429e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:18.384526 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e08ae-ea85-44b4-a155-eff7ab30429e None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:18.384526 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e08ae-ea85-44b4-a155-eff7ab30429e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:18.386146 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e08ae-ea85-44b4-a155-eff7ab30429e None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:18.409293 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:18.418841 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 112/215] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 23 15:37:18 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:37:18.423636 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b46fb4-fd34-43dc-9d24-978fa4f438b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:18.424595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b46fb4-fd34-43dc-9d24-978fa4f438b8 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:18.425035 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b46fb4-fd34-43dc-9d24-978fa4f438b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:18.425463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b46fb4-fd34-43dc-9d24-978fa4f438b8 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:18.426535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b46fb4-fd34-43dc-9d24-978fa4f438b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:18.427070 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b46fb4-fd34-43dc-9d24-978fa4f438b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:18.428715 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b46fb4-fd34-43dc-9d24-978fa4f438b8 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:18.439930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 104/216] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:37:18.445975 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e08ae-ea85-44b4-a155-eff7ab30429e None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:18.568220 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e08ae-ea85-44b4-a155-eff7ab30429e None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:18.611276 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f6771-5420-43b9-85d3-52d5b2e934ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:18.612165 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f6771-5420-43b9-85d3-52d5b2e934ec None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:18.612448 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f6771-5420-43b9-85d3-52d5b2e934ec None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:18.612782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f6771-5420-43b9-85d3-52d5b2e934ec None admin] PATH_INFO: `/v3/users/f0bc01e871354b158a0d361e93e4c66b` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:18.627250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f6771-5420-43b9-85d3-52d5b2e934ec None admin] RBAC: Authorizing `identity:get_user(user_id=f0bc01e871354b158a0d361e93e4c66b)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:18.628723 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f6771-5420-43b9-85d3-52d5b2e934ec None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:18.630809 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 113/217] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:18 2022] GET /identity/v3/users/f0bc01e871354b158a0d361e93e4c66b => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:18.636425 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b46fb4-fd34-43dc-9d24-978fa4f438b8 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:18.758808 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b46fb4-fd34-43dc-9d24-978fa4f438b8 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:18.794038 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e18786-dab7-40d0-884a-9e4b7878e556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:18.795235 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e18786-dab7-40d0-884a-9e4b7878e556 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:18.795528 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e18786-dab7-40d0-884a-9e4b7878e556 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:18.795801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e18786-dab7-40d0-884a-9e4b7878e556 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:18.856026 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:18.871230 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e18786-dab7-40d0-884a-9e4b7878e556 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:18.873216 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e18786-dab7-40d0-884a-9e4b7878e556 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:18.991839 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 105/218] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:37:18.999457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f6771-5420-43b9-85d3-52d5b2e934ec None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:19.002650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:19.153415 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f6771-5420-43b9-85d3-52d5b2e934ec None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:19.204899 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1676289-fb59-4fd4-bfea-45f46750aaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:19.205783 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1676289-fb59-4fd4-bfea-45f46750aaa5 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:19.206096 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1676289-fb59-4fd4-bfea-45f46750aaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:19.206379 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1676289-fb59-4fd4-bfea-45f46750aaa5 None admin] PATH_INFO: `/v3/projects/89a6206a5b7347f989194e2334051714` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:19.207614 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1676289-fb59-4fd4-bfea-45f46750aaa5 None admin] RBAC: Authorizing `identity:get_project(project_id=89a6206a5b7347f989194e2334051714)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:19.209090 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1676289-fb59-4fd4-bfea-45f46750aaa5 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:19.211220 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 114/219] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:18 2022] GET /identity/v3/projects/89a6206a5b7347f989194e2334051714 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:19.218335 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e18786-dab7-40d0-884a-9e4b7878e556 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:19.337897 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:19.360316 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e18786-dab7-40d0-884a-9e4b7878e556 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:19.406401 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598f80f-c1e4-471a-9851-1869839426d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:19.407775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598f80f-c1e4-471a-9851-1869839426d2 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:19.408236 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598f80f-c1e4-471a-9851-1869839426d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:19.408688 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598f80f-c1e4-471a-9851-1869839426d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:19.409720 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598f80f-c1e4-471a-9851-1869839426d2 None admin] RBAC: Adding query filter params (role.id=2362b672eb7b474dbd341608f3993123, scope.project.id=89a6206a5b7347f989194e2334051714, user.id=f0bc01e871354b158a0d361e93e4c66b) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:19.410224 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598f80f-c1e4-471a-9851-1869839426d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:19.411832 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598f80f-c1e4-471a-9851-1869839426d2 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:19.417937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 106/220] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:37:19 2022] GET /identity/v3/role_assignments?user.id=f0bc01e871354b158a0d361e93e4c66b&scope.project.id=89a6206a5b7347f989194e2334051714&role.id=2362b672eb7b474dbd341608f3993123 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:19.583415 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea92b9c-f5f0-4516-b8a2-e8d1c7bae763 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:19.583940 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea92b9c-f5f0-4516-b8a2-e8d1c7bae763 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:19.584012 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea92b9c-f5f0-4516-b8a2-e8d1c7bae763 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:19.585446 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 115/221] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:19.591135 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c5d8c-7bb0-44a2-8f60-b577496e48cc None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:19.591770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c5d8c-7bb0-44a2-8f60-b577496e48cc None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:19.592260 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c5d8c-7bb0-44a2-8f60-b577496e48cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:19.614907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-aa0c5d8c-7bb0-44a2-8f60-b577496e48cc None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:19.616536 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-aa0c5d8c-7bb0-44a2-8f60-b577496e48cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:19.702025 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 107/222] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:19.737884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea92b9c-f5f0-4516-b8a2-e8d1c7bae763 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:19.838378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:19.884637 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea92b9c-f5f0-4516-b8a2-e8d1c7bae763 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:19.937997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e840fc4-5c41-49b3-bbd9-a1d1d7cf2312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:19.938816 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e840fc4-5c41-49b3-bbd9-a1d1d7cf2312 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:19.939100 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e840fc4-5c41-49b3-bbd9-a1d1d7cf2312 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:19.939378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e840fc4-5c41-49b3-bbd9-a1d1d7cf2312 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:19.957753 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e840fc4-5c41-49b3-bbd9-a1d1d7cf2312 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:19.965793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-4e840fc4-5c41-49b3-bbd9-a1d1d7cf2312 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:19.965793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:19.965793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:19.965793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:19.965793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:19.965793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:19.965793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:19.965793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:19.965793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:19.965793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:19.965793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:19.965793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:19.965793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:19.965793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:19.965793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:19.965793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:19.967271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:19.967271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:19.967271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:19.967271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:19.967271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:19.967271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:19.967271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:19.967271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:19.967271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:19.967271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:19.967271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:19.967271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:19.967271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:19.967271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:19.967271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:19.967271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:19.968698 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:19.968698 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:19.968698 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:19.968698 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:19.968698 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:19.968698 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:19.968698 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:19.968698 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:19.968698 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:19.968698 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:19.968698 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:19.968698 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:19.968698 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 116/223] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 23 15:37:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:19.975772 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c5d8c-7bb0-44a2-8f60-b577496e48cc None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:19.994683 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083846ea-fd1a-40d7-a593-230e550419fd None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:19.994989 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083846ea-fd1a-40d7-a593-230e550419fd None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:19.995251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083846ea-fd1a-40d7-a593-230e550419fd None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:19.996631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 117/224] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:37:20.002229 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652509a-d9c9-4327-8cd0-caa7b8d11f7a None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:20.002507 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652509a-d9c9-4327-8cd0-caa7b8d11f7a None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:20.002789 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652509a-d9c9-4327-8cd0-caa7b8d11f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:20.025903 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-6652509a-d9c9-4327-8cd0-caa7b8d11f7a None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:20.027102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-6652509a-d9c9-4327-8cd0-caa7b8d11f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:20.143262 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:20.185422 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c5d8c-7bb0-44a2-8f60-b577496e48cc None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:20.192362 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 118/225] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:20.214714 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652509a-d9c9-4327-8cd0-caa7b8d11f7a None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:20.241497 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4600f-cfe5-469d-8a90-a0ad0c024363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:20.242656 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4600f-cfe5-469d-8a90-a0ad0c024363 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:20.243110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4600f-cfe5-469d-8a90-a0ad0c024363 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:20.244188 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4600f-cfe5-469d-8a90-a0ad0c024363 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:20.245158 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4600f-cfe5-469d-8a90-a0ad0c024363 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:20.245627 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4600f-cfe5-469d-8a90-a0ad0c024363 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:20.247596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4600f-cfe5-469d-8a90-a0ad0c024363 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:20.258016 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 108/226] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:37:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:20.263760 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4600f-cfe5-469d-8a90-a0ad0c024363 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:20.363859 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:20.450418 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4600f-cfe5-469d-8a90-a0ad0c024363 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:20.455682 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652509a-d9c9-4327-8cd0-caa7b8d11f7a None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:20.499795 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01fcec-a62c-450d-8cb3-b64bf747014c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:20.500622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01fcec-a62c-450d-8cb3-b64bf747014c None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:20.500910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01fcec-a62c-450d-8cb3-b64bf747014c None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:20.501209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01fcec-a62c-450d-8cb3-b64bf747014c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:20.514250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01fcec-a62c-450d-8cb3-b64bf747014c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:20.522694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-0e01fcec-a62c-450d-8cb3-b64bf747014c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:37:20.522694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:20.522694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:20.522694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:20.522694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:20.522694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:20.522694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:20.522694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:20.522694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:20.522694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:20.522694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:20.522694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:20.522694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:20.522694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:20.522694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:20.522694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:20.523564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:20.523564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:20.523564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:20.523564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:20.523564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:20.523564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:20.523564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:20.523564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:20.523564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:20.523564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:20.523564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:20.523564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:20.523564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:20.523564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:20.523564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:20.523564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:20.524341 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:20.524341 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:20.524341 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:20.524341 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:20.524341 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:20.524341 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:20.524341 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:20.524341 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:20.524341 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:20.524341 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:20.524341 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:37:20.524341 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:20.524341 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 119/227] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:37:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:37:20.530652 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01fcec-a62c-450d-8cb3-b64bf747014c None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:20.543105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7b0da-093a-43f8-8d33-f8a4b651f3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:20.544005 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7b0da-093a-43f8-8d33-f8a4b651f3fe None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:20.544286 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7b0da-093a-43f8-8d33-f8a4b651f3fe None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:20.544588 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7b0da-093a-43f8-8d33-f8a4b651f3fe None admin] PATH_INFO: `/v3/users/edf7adf115504e10a57f09af9408e818` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:20.547117 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7b0da-093a-43f8-8d33-f8a4b651f3fe None admin] RBAC: Authorizing `identity:get_user(user_id=edf7adf115504e10a57f09af9408e818)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:20.548584 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7b0da-093a-43f8-8d33-f8a4b651f3fe None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:20.556203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 109/228] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:20 2022] GET /identity/v3/users/edf7adf115504e10a57f09af9408e818 => generated 283 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:20.557088 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7b0da-093a-43f8-8d33-f8a4b651f3fe None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:20.577930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:20.717131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7b0da-093a-43f8-8d33-f8a4b651f3fe None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:20.725313 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01fcec-a62c-450d-8cb3-b64bf747014c None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:20.754548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b58877-b120-4a4b-9876-084c3a8933fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:20.755460 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b58877-b120-4a4b-9876-084c3a8933fb None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:20.755748 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b58877-b120-4a4b-9876-084c3a8933fb None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:20.756028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b58877-b120-4a4b-9876-084c3a8933fb None admin] PATH_INFO: `/v3/projects/89a6206a5b7347f989194e2334051714` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:20.757351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b58877-b120-4a4b-9876-084c3a8933fb None admin] RBAC: Authorizing `identity:get_project(project_id=89a6206a5b7347f989194e2334051714)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:20.758904 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b58877-b120-4a4b-9876-084c3a8933fb None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:20.760931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 110/229] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:20 2022] GET /identity/v3/projects/89a6206a5b7347f989194e2334051714 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:20.767853 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b58877-b120-4a4b-9876-084c3a8933fb None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:20.777532 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:20.805662 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdc550-ce07-43d7-a3f3-b3a837cc9305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:20.806382 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdc550-ce07-43d7-a3f3-b3a837cc9305 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:20.806668 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdc550-ce07-43d7-a3f3-b3a837cc9305 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:20.806948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfdc550-ce07-43d7-a3f3-b3a837cc9305 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:20.807717 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfdc550-ce07-43d7-a3f3-b3a837cc9305 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:20.811346 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfdc550-ce07-43d7-a3f3-b3a837cc9305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:20.812566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfdc550-ce07-43d7-a3f3-b3a837cc9305 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:20.825615 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 120/230] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:37:20.831708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdc550-ce07-43d7-a3f3-b3a837cc9305 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:20.939303 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfdc550-ce07-43d7-a3f3-b3a837cc9305 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:20.947367 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:20.976374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11b006-5248-4ea7-93f4-6686734ef3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:20.977604 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11b006-5248-4ea7-93f4-6686734ef3d5 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:20.978070 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11b006-5248-4ea7-93f4-6686734ef3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:20.978490 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11b006-5248-4ea7-93f4-6686734ef3d5 None admin] PATH_INFO: `/v3/users/edf7adf115504e10a57f09af9408e818` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:20.979910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11b006-5248-4ea7-93f4-6686734ef3d5 None admin] RBAC: Authorizing `identity:get_user(user_id=edf7adf115504e10a57f09af9408e818)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:20.981662 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11b006-5248-4ea7-93f4-6686734ef3d5 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:20.983815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 121/231] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:20 2022] GET /identity/v3/users/edf7adf115504e10a57f09af9408e818 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:37:20.989485 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11b006-5248-4ea7-93f4-6686734ef3d5 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:21.002992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b58877-b120-4a4b-9876-084c3a8933fb None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:21.047045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:21.102654 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb45e71-bec6-4702-83fe-02fd925c7af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:21.103548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb45e71-bec6-4702-83fe-02fd925c7af9 None admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:21.103832 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb45e71-bec6-4702-83fe-02fd925c7af9 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:21.104169 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb45e71-bec6-4702-83fe-02fd925c7af9 None admin] PATH_INFO: `/v3/projects/89a6206a5b7347f989194e2334051714/users/edf7adf115504e10a57f09af9408e818/roles/12fa8f67cf514b1e916afc130f0e6008` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:21.109262 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11b006-5248-4ea7-93f4-6686734ef3d5 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:21.114761 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb45e71-bec6-4702-83fe-02fd925c7af9 None admin] RBAC: Authorizing `identity:create_grant(project_id=89a6206a5b7347f989194e2334051714, user_id=edf7adf115504e10a57f09af9408e818, role_id=12fa8f67cf514b1e916afc130f0e6008)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:21.116255 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb45e71-bec6-4702-83fe-02fd925c7af9 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:21.148112 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd59ebf-b41c-402a-8cc8-b1123487142d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:21.149224 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd59ebf-b41c-402a-8cc8-b1123487142d None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:21.149655 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd59ebf-b41c-402a-8cc8-b1123487142d None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:21.150128 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd59ebf-b41c-402a-8cc8-b1123487142d None admin] PATH_INFO: `/v3/projects/89a6206a5b7347f989194e2334051714` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:21.151490 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd59ebf-b41c-402a-8cc8-b1123487142d None admin] RBAC: Authorizing `identity:get_project(project_id=89a6206a5b7347f989194e2334051714)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:21.153087 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd59ebf-b41c-402a-8cc8-b1123487142d None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:21.156203 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 122/232] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:20 2022] GET /identity/v3/projects/89a6206a5b7347f989194e2334051714 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:37:21.161880 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 111/233] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 23 15:37:20 2022] PUT /identity/v3/projects/89a6206a5b7347f989194e2334051714/users/edf7adf115504e10a57f09af9408e818/roles/12fa8f67cf514b1e916afc130f0e6008 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:37:21.169682 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd59ebf-b41c-402a-8cc8-b1123487142d None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:21.259944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568ee8d-1766-49f4-bb90-b264a2403ab7 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:21.260262 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568ee8d-1766-49f4-bb90-b264a2403ab7 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:21.260520 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e568ee8d-1766-49f4-bb90-b264a2403ab7 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:21.262124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 112/234] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:21.268203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb68eb-9787-448a-a627-3abb7fec88e7 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:21.268515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb68eb-9787-448a-a627-3abb7fec88e7 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:21.268774 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb68eb-9787-448a-a627-3abb7fec88e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:21.287664 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-fddb68eb-9787-448a-a627-3abb7fec88e7 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:21.288956 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-fddb68eb-9787-448a-a627-3abb7fec88e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:21.356473 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd59ebf-b41c-402a-8cc8-b1123487142d None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:21.382255 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 113/235] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 15:37:21.384724 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f85e10-834b-4848-8a0a-b13c427aae04 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:21.385221 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f85e10-834b-4848-8a0a-b13c427aae04 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:21.385826 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f85e10-834b-4848-8a0a-b13c427aae04 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:21.387887 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 114/236] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:21.391682 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:21.396542 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34470ad9-49d3-45c1-b66b-43b1d3958990 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:21.396840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34470ad9-49d3-45c1-b66b-43b1d3958990 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:21.397528 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34470ad9-49d3-45c1-b66b-43b1d3958990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:21.409266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682bad7-3d1e-4d84-9901-f832f086296e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:21.410197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682bad7-3d1e-4d84-9901-f832f086296e None admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:21.410480 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682bad7-3d1e-4d84-9901-f832f086296e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:21.410759 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682bad7-3d1e-4d84-9901-f832f086296e None admin] PATH_INFO: `/v3/projects/89a6206a5b7347f989194e2334051714/users/edf7adf115504e10a57f09af9408e818/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:21.412805 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682bad7-3d1e-4d84-9901-f832f086296e None admin] RBAC: Authorizing `identity:create_grant(project_id=89a6206a5b7347f989194e2334051714, user_id=edf7adf115504e10a57f09af9408e818, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:21.414296 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682bad7-3d1e-4d84-9901-f832f086296e None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:21.418090 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-34470ad9-49d3-45c1-b66b-43b1d3958990 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:21.420858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-34470ad9-49d3-45c1-b66b-43b1d3958990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:21.438092 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 123/237] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 23 15:37:21 2022] PUT /identity/v3/projects/89a6206a5b7347f989194e2334051714/users/edf7adf115504e10a57f09af9408e818/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:37:21.438890 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682bad7-3d1e-4d84-9901-f832f086296e None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:21.509383 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:21.512678 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 115/238] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 15:37:21.557580 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34470ad9-49d3-45c1-b66b-43b1d3958990 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:21.571130 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682bad7-3d1e-4d84-9901-f832f086296e None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:21.612552 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3898a47-feed-44db-b89a-2e85a16f18f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:21.614036 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3898a47-feed-44db-b89a-2e85a16f18f7 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:21.614326 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3898a47-feed-44db-b89a-2e85a16f18f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:21.614607 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3898a47-feed-44db-b89a-2e85a16f18f7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:21.627606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3898a47-feed-44db-b89a-2e85a16f18f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:21.638493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-f3898a47-feed-44db-b89a-2e85a16f18f7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 15:37:21.638493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:21.638493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:21.638493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:21.638493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:21.638493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:21.638493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:21.638493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:21.638493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:21.638493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:21.638493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:21.638493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:21.638493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:21.638493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:21.638493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:21.638493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:21.639427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:21.639427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:21.639427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:21.639427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:21.639427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:21.639427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:21.639427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:21.639427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:21.639427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:21.639427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:21.639427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:21.639427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:21.639427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:21.639427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:21.639427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:21.639427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:21.640192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:21.640192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:21.640192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:21.640192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:21.640192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:21.640192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:21.640192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:21.640192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:21.640192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:21.640192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:21.640192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 15:37:21.640192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:21.640192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 124/239] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:21.646023 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3898a47-feed-44db-b89a-2e85a16f18f7 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:21.697299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:21.725559 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34470ad9-49d3-45c1-b66b-43b1d3958990 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:21.762139 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf9870-250c-48b7-b439-4cc47998b08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:21.763087 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf9870-250c-48b7-b439-4cc47998b08c None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:21.763522 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf9870-250c-48b7-b439-4cc47998b08c None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:21.764400 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf9870-250c-48b7-b439-4cc47998b08c None admin] PATH_INFO: `/v3/domains/default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:21.765689 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf9870-250c-48b7-b439-4cc47998b08c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:21.767266 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf9870-250c-48b7-b439-4cc47998b08c None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:21.769175 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 116/240] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:37:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:21.776710 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf9870-250c-48b7-b439-4cc47998b08c None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:21.777742 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3898a47-feed-44db-b89a-2e85a16f18f7 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:21.814986 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b14082-7154-4ac4-99b9-bd37db223ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:21.815664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b14082-7154-4ac4-99b9-bd37db223ef7 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:21.815954 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b14082-7154-4ac4-99b9-bd37db223ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:21.816232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b14082-7154-4ac4-99b9-bd37db223ef7 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:21.816990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b14082-7154-4ac4-99b9-bd37db223ef7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:21.817301 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b14082-7154-4ac4-99b9-bd37db223ef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:21.818740 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b14082-7154-4ac4-99b9-bd37db223ef7 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:21.828552 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 125/241] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:37:21.834092 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b14082-7154-4ac4-99b9-bd37db223ef7 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:21.943319 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:21.947165 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b14082-7154-4ac4-99b9-bd37db223ef7 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:21.961199 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:21.986052 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac7c70-1d33-450e-afb4-3cd9996cc220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:21.986946 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac7c70-1d33-450e-afb4-3cd9996cc220 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:21.987236 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac7c70-1d33-450e-afb4-3cd9996cc220 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:21.987519 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac7c70-1d33-450e-afb4-3cd9996cc220 None admin] PATH_INFO: `/v3/users/e394f8b0cc554e398b4283478c044bbf` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:22.004048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac7c70-1d33-450e-afb4-3cd9996cc220 None admin] RBAC: Authorizing `identity:get_user(user_id=e394f8b0cc554e398b4283478c044bbf)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:22.005551 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac7c70-1d33-450e-afb4-3cd9996cc220 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:22.007787 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 126/242] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:21 2022] GET /identity/v3/users/e394f8b0cc554e398b4283478c044bbf => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:22.012899 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac7c70-1d33-450e-afb4-3cd9996cc220 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:22.064813 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf9870-250c-48b7-b439-4cc47998b08c None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:22.120749 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8a1d4-e029-495d-8885-2fff276fdf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:22.121432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8a1d4-e029-495d-8885-2fff276fdf13 None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:22.121716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8a1d4-e029-495d-8885-2fff276fdf13 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:22.122023 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8a1d4-e029-495d-8885-2fff276fdf13 None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:22.122862 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8a1d4-e029-495d-8885-2fff276fdf13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:22.124311 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8a1d4-e029-495d-8885-2fff276fdf13 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:22.153430 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 117/243] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 23 15:37:21 2022] POST /identity/v3/users => generated 293 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:37:22.155937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73baf7be-499f-41ce-810d-6866a53df59d None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:22.156621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73baf7be-499f-41ce-810d-6866a53df59d None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:22.156907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73baf7be-499f-41ce-810d-6866a53df59d None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:22.158916 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 118/244] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:22.160072 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac7c70-1d33-450e-afb4-3cd9996cc220 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:22.164631 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9b7e8-d3ee-442b-8434-6bb2efc550cb None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:22.164925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9b7e8-d3ee-442b-8434-6bb2efc550cb None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:22.165192 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9b7e8-d3ee-442b-8434-6bb2efc550cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:22.183068 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-99b9b7e8-d3ee-442b-8434-6bb2efc550cb None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:22.184399 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-99b9b7e8-d3ee-442b-8434-6bb2efc550cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:22.214546 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9771a07-b77d-45ca-9a0d-1932913eab0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:22.215340 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9771a07-b77d-45ca-9a0d-1932913eab0f None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:22.215625 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9771a07-b77d-45ca-9a0d-1932913eab0f None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:22.215900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9771a07-b77d-45ca-9a0d-1932913eab0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:22.253577 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:22.265730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 119/245] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 15:37:22.291861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9b7e8-d3ee-442b-8434-6bb2efc550cb None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:22.304661 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9771a07-b77d-45ca-9a0d-1932913eab0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:22.306554 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9771a07-b77d-45ca-9a0d-1932913eab0f None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:22.386347 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:22.451291 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9b7e8-d3ee-442b-8434-6bb2efc550cb None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:22.489286 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 127/246] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 15:37:22.494792 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9771a07-b77d-45ca-9a0d-1932913eab0f None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:22.499795 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca6087-dcb5-4f32-baed-eeca0f4ace78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:22.500595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca6087-dcb5-4f32-baed-eeca0f4ace78 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:22.500878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca6087-dcb5-4f32-baed-eeca0f4ace78 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:22.501153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca6087-dcb5-4f32-baed-eeca0f4ace78 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:22.515084 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca6087-dcb5-4f32-baed-eeca0f4ace78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:22.524787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-a5ca6087-dcb5-4f32-baed-eeca0f4ace78 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:22.524787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:22.524787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:22.524787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:22.524787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:22.524787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:22.524787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:22.524787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:22.524787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:22.524787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:22.524787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:22.524787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:22.524787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:22.524787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:22.524787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:22.524787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:22.525762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:22.525762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:22.525762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:22.525762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:22.525762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:22.525762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:22.525762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:22.525762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:22.525762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:22.525762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:22.525762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:22.525762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:22.525762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:22.525762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:22.525762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:22.525762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:22.526568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:22.526568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:22.526568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:22.526568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:22.526568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:22.526568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:22.526568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:22.526568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:22.526568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:22.526568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:22.526568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:22.526568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:22.527150 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 120/247] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:37:22.534503 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca6087-dcb5-4f32-baed-eeca0f4ace78 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:22.582648 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:22.648005 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9771a07-b77d-45ca-9a0d-1932913eab0f None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:22.677620 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca6087-dcb5-4f32-baed-eeca0f4ace78 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:22.694812 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:22.706240 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93303e9-668c-486c-a59e-00fa60753ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:22.707599 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93303e9-668c-486c-a59e-00fa60753ad8 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:22.707599 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93303e9-668c-486c-a59e-00fa60753ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:22.707944 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93303e9-668c-486c-a59e-00fa60753ad8 None admin] PATH_INFO: `/v3/projects/89a6206a5b7347f989194e2334051714` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:22.710198 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93303e9-668c-486c-a59e-00fa60753ad8 None admin] RBAC: Authorizing `identity:get_project(project_id=89a6206a5b7347f989194e2334051714)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:22.711796 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93303e9-668c-486c-a59e-00fa60753ad8 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:22.713754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 128/248] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:22 2022] GET /identity/v3/projects/89a6206a5b7347f989194e2334051714 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:22.721438 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93303e9-668c-486c-a59e-00fa60753ad8 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:22.729539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9a039-538b-43d2-9002-58d8c24c24f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:22.730474 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9a039-538b-43d2-9002-58d8c24c24f7 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:22.730924 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9a039-538b-43d2-9002-58d8c24c24f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:22.731338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9a039-538b-43d2-9002-58d8c24c24f7 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:22.732253 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9a039-538b-43d2-9002-58d8c24c24f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:22.732859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9a039-538b-43d2-9002-58d8c24c24f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:22.734710 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9a039-538b-43d2-9002-58d8c24c24f7 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:22.748943 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 121/249] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:22.750667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9a039-538b-43d2-9002-58d8c24c24f7 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:22.840083 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93303e9-668c-486c-a59e-00fa60753ad8 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:22.864577 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9a039-538b-43d2-9002-58d8c24c24f7 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:22.869809 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:22.881745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0821fb-31ce-4f5c-a64c-45d0d887d89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:22.882452 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0821fb-31ce-4f5c-a64c-45d0d887d89a None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:22.882742 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0821fb-31ce-4f5c-a64c-45d0d887d89a None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:22.883024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0821fb-31ce-4f5c-a64c-45d0d887d89a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:22.885889 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0821fb-31ce-4f5c-a64c-45d0d887d89a None admin] RBAC: Adding query filter params (role.id=a655cf8750c8442eb3cce5c771188a99, scope.project.id=89a6206a5b7347f989194e2334051714, user.id=e394f8b0cc554e398b4283478c044bbf) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:22.885889 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0821fb-31ce-4f5c-a64c-45d0d887d89a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:22.886103 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0821fb-31ce-4f5c-a64c-45d0d887d89a None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:22.894193 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 129/250] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:37:22 2022] GET /identity/v3/role_assignments?user.id=e394f8b0cc554e398b4283478c044bbf&scope.project.id=89a6206a5b7347f989194e2334051714&role.id=a655cf8750c8442eb3cce5c771188a99 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:22.932732 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bdaa5-a0ab-4997-9903-fbc9fd4a319d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:22.933916 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bdaa5-a0ab-4997-9903-fbc9fd4a319d None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:22.934365 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bdaa5-a0ab-4997-9903-fbc9fd4a319d None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:22.934777 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184bdaa5-a0ab-4997-9903-fbc9fd4a319d None admin] PATH_INFO: `/v3/users/f0bc01e871354b158a0d361e93e4c66b` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:22.942859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bdaa5-a0ab-4997-9903-fbc9fd4a319d None admin] RBAC: Authorizing `identity:get_user(user_id=f0bc01e871354b158a0d361e93e4c66b)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:22.944600 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184bdaa5-a0ab-4997-9903-fbc9fd4a319d None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:22.946595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 122/251] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:22 2022] GET /identity/v3/users/f0bc01e871354b158a0d361e93e4c66b => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:22.953131 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0821fb-31ce-4f5c-a64c-45d0d887d89a None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:23.094795 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0821fb-31ce-4f5c-a64c-45d0d887d89a None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:23.131063 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf0cff-c881-4214-8f92-59fb5b7bfd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:23.131943 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf0cff-c881-4214-8f92-59fb5b7bfd56 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:23.132233 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf0cff-c881-4214-8f92-59fb5b7bfd56 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:23.132515 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf0cff-c881-4214-8f92-59fb5b7bfd56 None admin] PATH_INFO: `/v3/projects/89a6206a5b7347f989194e2334051714` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:23.133722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf0cff-c881-4214-8f92-59fb5b7bfd56 None admin] RBAC: Authorizing `identity:get_project(project_id=89a6206a5b7347f989194e2334051714)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:23.135196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf0cff-c881-4214-8f92-59fb5b7bfd56 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:23.137264 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 130/252] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:22 2022] GET /identity/v3/projects/89a6206a5b7347f989194e2334051714 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:23.142956 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bdaa5-a0ab-4997-9903-fbc9fd4a319d None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:23.226375 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:23.313043 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184bdaa5-a0ab-4997-9903-fbc9fd4a319d None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:23.361078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5a9f4-bba9-4fc9-9bb3-aa3eb3a7f333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:23.362335 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5a9f4-bba9-4fc9-9bb3-aa3eb3a7f333 None admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:23.362814 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5a9f4-bba9-4fc9-9bb3-aa3eb3a7f333 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:23.363303 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5a9f4-bba9-4fc9-9bb3-aa3eb3a7f333 None admin] PATH_INFO: `/v3/projects/89a6206a5b7347f989194e2334051714/users/f0bc01e871354b158a0d361e93e4c66b/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:23.371370 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5a9f4-bba9-4fc9-9bb3-aa3eb3a7f333 None admin] RBAC: Authorizing `identity:create_grant(project_id=89a6206a5b7347f989194e2334051714, user_id=f0bc01e871354b158a0d361e93e4c66b, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:23.373690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5a9f4-bba9-4fc9-9bb3-aa3eb3a7f333 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:23.399542 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 123/253] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 23 15:37:23 2022] PUT /identity/v3/projects/89a6206a5b7347f989194e2334051714/users/f0bc01e871354b158a0d361e93e4c66b/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:37:24.102053 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0036c1-0e8f-4991-abce-413221f2a6b7 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:24.102578 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0036c1-0e8f-4991-abce-413221f2a6b7 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:24.102654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0036c1-0e8f-4991-abce-413221f2a6b7 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:24.104316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 131/254] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:24.110134 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093f70e-72e2-45f2-aac5-55c5e707e52d None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:24.111012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093f70e-72e2-45f2-aac5-55c5e707e52d None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:24.111504 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093f70e-72e2-45f2-aac5-55c5e707e52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:24.135137 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-d093f70e-72e2-45f2-aac5-55c5e707e52d None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:24.136694 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-d093f70e-72e2-45f2-aac5-55c5e707e52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:24.224337 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 124/255] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:24.250771 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d400bc-4fa9-42e3-89a5-f9b6af80e9a3 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:24.251068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d400bc-4fa9-42e3-89a5-f9b6af80e9a3 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:24.251514 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d400bc-4fa9-42e3-89a5-f9b6af80e9a3 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:24.253460 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 132/256] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:24.258428 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626064c4-38f7-4ea2-b657-1ab4a650e2a2 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:24.258727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626064c4-38f7-4ea2-b657-1ab4a650e2a2 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:24.259019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626064c4-38f7-4ea2-b657-1ab4a650e2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:24.265416 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d400bc-4fa9-42e3-89a5-f9b6af80e9a3 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:24.286937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-626064c4-38f7-4ea2-b657-1ab4a650e2a2 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:24.288399 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-626064c4-38f7-4ea2-b657-1ab4a650e2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:24.343555 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:24.357808 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:24.410333 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d400bc-4fa9-42e3-89a5-f9b6af80e9a3 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:24.416428 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 125/257] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:24.455149 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333da36d-34ac-4af3-b36c-3f1b0af07333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:24.456478 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333da36d-34ac-4af3-b36c-3f1b0af07333 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:24.457064 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333da36d-34ac-4af3-b36c-3f1b0af07333 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:24.457547 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333da36d-34ac-4af3-b36c-3f1b0af07333 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:24.471315 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333da36d-34ac-4af3-b36c-3f1b0af07333 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:24.478836 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626064c4-38f7-4ea2-b657-1ab4a650e2a2 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:24.481002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-333da36d-34ac-4af3-b36c-3f1b0af07333 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:37:24.481002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:24.481002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:24.481002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:24.481002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:24.481002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:24.481002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:24.481002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:24.481002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:24.481002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:24.481002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:24.481002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:24.481002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:24.481002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:24.481002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:24.481002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:24.481929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:24.481929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:24.481929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:24.481929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:24.481929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:24.481929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:24.481929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:24.481929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:24.481929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:24.481929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:24.481929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:24.481929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:24.481929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:24.481929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:24.481929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:24.481929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:24.482702 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:24.482702 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:24.482702 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:24.482702 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:24.482702 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:24.482702 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:24.482702 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:24.482702 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:24.482702 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:24.482702 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:24.482702 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:37:24.482702 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:24.485447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 133/258] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:37:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:24.490792 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333da36d-34ac-4af3-b36c-3f1b0af07333 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:24.632342 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333da36d-34ac-4af3-b36c-3f1b0af07333 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:24.669053 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:24.673289 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626064c4-38f7-4ea2-b657-1ab4a650e2a2 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:24.705775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c24c58-738f-4b5d-a7f9-31ac221bb09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:24.706500 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c24c58-738f-4b5d-a7f9-31ac221bb09a None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:24.706784 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c24c58-738f-4b5d-a7f9-31ac221bb09a None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:24.707061 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c24c58-738f-4b5d-a7f9-31ac221bb09a None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:24.707833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c24c58-738f-4b5d-a7f9-31ac221bb09a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:24.708140 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c24c58-738f-4b5d-a7f9-31ac221bb09a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:24.710823 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c24c58-738f-4b5d-a7f9-31ac221bb09a None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:24.730631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 134/259] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:37:24.736057 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c24c58-738f-4b5d-a7f9-31ac221bb09a None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:24.753223 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65cbae-7ecf-4ffc-88b4-5b86e3cab742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:24.754071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65cbae-7ecf-4ffc-88b4-5b86e3cab742 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:24.754514 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65cbae-7ecf-4ffc-88b4-5b86e3cab742 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:24.754802 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65cbae-7ecf-4ffc-88b4-5b86e3cab742 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:24.782598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65cbae-7ecf-4ffc-88b4-5b86e3cab742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:24.801099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-6f65cbae-7ecf-4ffc-88b4-5b86e3cab742 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:24.801099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:24.801099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:24.801099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:24.801099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:24.801099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:24.801099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:24.801099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:24.801099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:24.801099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:24.801099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:24.801099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:24.801099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:24.801099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:24.801099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:24.801099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:24.802041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:24.802041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:24.802041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:24.802041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:24.802041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:24.802041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:24.802041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:24.802041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:24.802041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:24.802041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:24.802041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:24.802041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:24.802041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:24.802041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:24.802041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:24.802041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:24.802885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:24.802885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:24.802885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:24.802885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:24.802885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:24.802885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:24.802885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:24.802885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:24.802885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:24.802885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:24.802885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:24.802885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:24.802885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 126/260] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 23 15:37:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:37:24.809822 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65cbae-7ecf-4ffc-88b4-5b86e3cab742 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:24.860605 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:24.941090 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c24c58-738f-4b5d-a7f9-31ac221bb09a None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:24.977767 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33ce10-6d70-40e4-80f9-e98494205deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:24.978731 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33ce10-6d70-40e4-80f9-e98494205deb None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:24.979070 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33ce10-6d70-40e4-80f9-e98494205deb None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:24.979353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33ce10-6d70-40e4-80f9-e98494205deb None admin] PATH_INFO: `/v3/users/edf7adf115504e10a57f09af9408e818` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:24.980604 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33ce10-6d70-40e4-80f9-e98494205deb None admin] RBAC: Authorizing `identity:get_user(user_id=edf7adf115504e10a57f09af9408e818)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:24.982730 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33ce10-6d70-40e4-80f9-e98494205deb None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:24.984757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 135/261] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:24 2022] GET /identity/v3/users/edf7adf115504e10a57f09af9408e818 => generated 283 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:24.992853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33ce10-6d70-40e4-80f9-e98494205deb None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:25.018301 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65cbae-7ecf-4ffc-88b4-5b86e3cab742 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:25.062317 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d0b26-afdc-4b44-a80e-c57e677babfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:25.063098 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d0b26-afdc-4b44-a80e-c57e677babfb None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:25.063455 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d0b26-afdc-4b44-a80e-c57e677babfb None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:25.063807 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d0b26-afdc-4b44-a80e-c57e677babfb None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:25.064642 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d0b26-afdc-4b44-a80e-c57e677babfb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:25.065023 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d0b26-afdc-4b44-a80e-c57e677babfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:25.066555 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1d0b26-afdc-4b44-a80e-c57e677babfb None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:25.073013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:25.075464 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 127/262] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:37:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:37:25.082914 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d0b26-afdc-4b44-a80e-c57e677babfb None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:25.131834 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33ce10-6d70-40e4-80f9-e98494205deb None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:25.171790 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0298b4-269e-4ed1-860f-27045dd19588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:25.172778 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0298b4-269e-4ed1-860f-27045dd19588 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:25.173294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0298b4-269e-4ed1-860f-27045dd19588 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:25.173750 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0298b4-269e-4ed1-860f-27045dd19588 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:25.249628 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0298b4-269e-4ed1-860f-27045dd19588 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:25.251460 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0298b4-269e-4ed1-860f-27045dd19588 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:25.307129 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:25.324368 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:25.371849 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 136/263] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 15:37:25.373526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1d0b26-afdc-4b44-a80e-c57e677babfb None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:25.378263 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0298b4-269e-4ed1-860f-27045dd19588 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:25.462577 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3156f8-be64-4e21-9850-56183cdef962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:25.463480 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3156f8-be64-4e21-9850-56183cdef962 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:25.463761 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3156f8-be64-4e21-9850-56183cdef962 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:25.464254 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3156f8-be64-4e21-9850-56183cdef962 None admin] PATH_INFO: `/v3/users/edf7adf115504e10a57f09af9408e818` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:25.465819 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3156f8-be64-4e21-9850-56183cdef962 None admin] RBAC: Authorizing `identity:get_user(user_id=edf7adf115504e10a57f09af9408e818)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:25.467368 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3156f8-be64-4e21-9850-56183cdef962 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:25.470150 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 128/264] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:25 2022] GET /identity/v3/users/edf7adf115504e10a57f09af9408e818 => generated 283 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:25.478025 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3156f8-be64-4e21-9850-56183cdef962 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:25.550565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0298b4-269e-4ed1-860f-27045dd19588 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:25.615469 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f959b42-4a01-46e2-a179-72ca463b19e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:25.616351 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f959b42-4a01-46e2-a179-72ca463b19e2 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:25.616698 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f959b42-4a01-46e2-a179-72ca463b19e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:25.616976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f959b42-4a01-46e2-a179-72ca463b19e2 None admin] PATH_INFO: `/v3/projects/89a6206a5b7347f989194e2334051714` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:25.623158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f959b42-4a01-46e2-a179-72ca463b19e2 None admin] RBAC: Authorizing `identity:get_project(project_id=89a6206a5b7347f989194e2334051714)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:25.624645 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f959b42-4a01-46e2-a179-72ca463b19e2 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:25.626794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 137/265] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:25 2022] GET /identity/v3/projects/89a6206a5b7347f989194e2334051714 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:25.628214 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6254d-12bd-4157-9138-1f5b5e317bf8 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:25.628506 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6254d-12bd-4157-9138-1f5b5e317bf8 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:25.628786 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6254d-12bd-4157-9138-1f5b5e317bf8 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:25.635596 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 138/266] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:25.636577 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863305b-5b6e-46c7-a861-4cdb9efa196b None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:25.636877 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863305b-5b6e-46c7-a861-4cdb9efa196b None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:25.637167 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9863305b-5b6e-46c7-a861-4cdb9efa196b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:25.659197 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3156f8-be64-4e21-9850-56183cdef962 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:25.666879 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-9863305b-5b6e-46c7-a861-4cdb9efa196b None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:25.668392 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-9863305b-5b6e-46c7-a861-4cdb9efa196b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:25.694217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:25.711272 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1af2af-77c6-48ad-80ba-ad44c548ccdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:25.712270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1af2af-77c6-48ad-80ba-ad44c548ccdb None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:25.712556 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1af2af-77c6-48ad-80ba-ad44c548ccdb None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:25.712901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1af2af-77c6-48ad-80ba-ad44c548ccdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:25.744139 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:25.809305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1af2af-77c6-48ad-80ba-ad44c548ccdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:25.812851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1af2af-77c6-48ad-80ba-ad44c548ccdb None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:25.854412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 139/267] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:25.855445 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863305b-5b6e-46c7-a861-4cdb9efa196b None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:25.991584 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 129/268] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 15:37:25.992435 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1af2af-77c6-48ad-80ba-ad44c548ccdb None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:26.053937 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9863305b-5b6e-46c7-a861-4cdb9efa196b None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:26.070626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:26.108135 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf82338-9a4b-4159-948b-9de2748bc896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:26.109096 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf82338-9a4b-4159-948b-9de2748bc896 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:26.109383 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf82338-9a4b-4159-948b-9de2748bc896 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:26.110231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf82338-9a4b-4159-948b-9de2748bc896 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:26.111093 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf82338-9a4b-4159-948b-9de2748bc896 None admin] RBAC: Adding query filter params (role.id=abdc0e0957534149b3653eaa33cbd054, scope.project.id=89a6206a5b7347f989194e2334051714, user.id=edf7adf115504e10a57f09af9408e818) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:26.111411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf82338-9a4b-4159-948b-9de2748bc896 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:26.113729 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf82338-9a4b-4159-948b-9de2748bc896 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:26.120643 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 140/269] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:37:25 2022] GET /identity/v3/role_assignments?user.id=edf7adf115504e10a57f09af9408e818&scope.project.id=89a6206a5b7347f989194e2334051714&role.id=abdc0e0957534149b3653eaa33cbd054 => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:26.121260 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf82338-9a4b-4159-948b-9de2748bc896 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:26.134635 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:26.140289 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1af2af-77c6-48ad-80ba-ad44c548ccdb None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:26.194687 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926b489-43d3-4f9b-ba4b-132fc06f6bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:26.195867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926b489-43d3-4f9b-ba4b-132fc06f6bfe None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:26.196356 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926b489-43d3-4f9b-ba4b-132fc06f6bfe None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:26.196840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926b489-43d3-4f9b-ba4b-132fc06f6bfe None admin] PATH_INFO: `/v3/roles/member` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:26.215540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e926b489-43d3-4f9b-ba4b-132fc06f6bfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:26.233378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-e926b489-43d3-4f9b-ba4b-132fc06f6bfe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:26.233378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:26.233378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:26.233378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:26.233378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:26.233378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:26.233378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:26.233378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:26.233378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:26.233378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:26.233378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:26.233378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:26.233378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:26.233378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:26.233378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:26.233378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:26.234351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:26.234351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:26.234351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:26.234351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:26.234351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:26.234351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:26.234351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:26.234351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:26.234351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:26.234351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:26.234351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:26.234351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:26.234351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:26.234351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:26.234351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:26.234351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:26.235131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:26.235131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:26.235131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:26.235131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:26.235131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:26.235131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:26.235131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:26.235131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:26.235131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:26.235131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:26.235131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:26.235131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:26.237176 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf82338-9a4b-4159-948b-9de2748bc896 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:26.237951 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 130/270] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:26.241911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037edd9d-4fb0-4e5f-94f8-727d6eb1d6aa None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:26.246369 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037edd9d-4fb0-4e5f-94f8-727d6eb1d6aa None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:26.246651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037edd9d-4fb0-4e5f-94f8-727d6eb1d6aa None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:26.248728 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 131/271] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:26.249511 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037edd9d-4fb0-4e5f-94f8-727d6eb1d6aa None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:26.276940 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97036647-50f4-4671-8fde-2135428f220a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:26.277983 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97036647-50f4-4671-8fde-2135428f220a None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:26.278270 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97036647-50f4-4671-8fde-2135428f220a None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:26.278552 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97036647-50f4-4671-8fde-2135428f220a None admin] PATH_INFO: `/v3/projects/89a6206a5b7347f989194e2334051714` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:26.279905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97036647-50f4-4671-8fde-2135428f220a None admin] RBAC: Authorizing `identity:get_project(project_id=89a6206a5b7347f989194e2334051714)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:26.281898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97036647-50f4-4671-8fde-2135428f220a None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:26.283687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 141/272] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:26 2022] GET /identity/v3/projects/89a6206a5b7347f989194e2334051714 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:26.285009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edce0c1-2f16-413e-8490-c70ea4e72544 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:26.285298 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edce0c1-2f16-413e-8490-c70ea4e72544 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:26.285573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edce0c1-2f16-413e-8490-c70ea4e72544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:26.312174 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-8edce0c1-2f16-413e-8490-c70ea4e72544 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:26.313424 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-8edce0c1-2f16-413e-8490-c70ea4e72544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:26.389593 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037edd9d-4fb0-4e5f-94f8-727d6eb1d6aa None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:26.400507 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 142/273] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:26.401949 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e8428-ddff-4928-98e2-dfaffbf8b7c8 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:26.402327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e8428-ddff-4928-98e2-dfaffbf8b7c8 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:26.403667 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e8428-ddff-4928-98e2-dfaffbf8b7c8 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:26.403925 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 143/274] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:26.404690 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e8428-ddff-4928-98e2-dfaffbf8b7c8 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:26.411293 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:26.416991 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:26.439361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5ad0a-e953-4e99-bd30-128c9939022a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:26.440042 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5ad0a-e953-4e99-bd30-128c9939022a None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:26.440471 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5ad0a-e953-4e99-bd30-128c9939022a None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:26.440575 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5ad0a-e953-4e99-bd30-128c9939022a None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:26.441339 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5ad0a-e953-4e99-bd30-128c9939022a None admin] RBAC: Adding query filter params (name=member) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:26.441647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5ad0a-e953-4e99-bd30-128c9939022a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:26.443073 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5ad0a-e953-4e99-bd30-128c9939022a None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:26.454280 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 132/275] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:26.455355 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ea700-b827-4566-8494-18290cdd0df3 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:26.455632 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ea700-b827-4566-8494-18290cdd0df3 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:26.455908 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ea700-b827-4566-8494-18290cdd0df3 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:26.457351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 133/276] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:26.458270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276bc71-690a-46e4-90c3-77ef7dd5045d None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:26.458567 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276bc71-690a-46e4-90c3-77ef7dd5045d None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:26.458823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276bc71-690a-46e4-90c3-77ef7dd5045d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:26.478301 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-7276bc71-690a-46e4-90c3-77ef7dd5045d None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:26.479552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-7276bc71-690a-46e4-90c3-77ef7dd5045d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:26.539560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e8428-ddff-4928-98e2-dfaffbf8b7c8 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:26.552053 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 134/277] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:26.552899 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276bc71-690a-46e4-90c3-77ef7dd5045d None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:26.577754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b658c78-3aab-4be7-ac57-ad3591290533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:26.578467 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b658c78-3aab-4be7-ac57-ad3591290533 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:26.578754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b658c78-3aab-4be7-ac57-ad3591290533 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:26.579039 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b658c78-3aab-4be7-ac57-ad3591290533 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:26.579885 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b658c78-3aab-4be7-ac57-ad3591290533 None admin] RBAC: Adding query filter params (role.id=12fa8f67cf514b1e916afc130f0e6008, scope.project.id=89a6206a5b7347f989194e2334051714, user.id=edf7adf115504e10a57f09af9408e818) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:26.580202 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b658c78-3aab-4be7-ac57-ad3591290533 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:26.581650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b658c78-3aab-4be7-ac57-ad3591290533 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:26.587824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 144/278] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:37:26 2022] GET /identity/v3/role_assignments?user.id=edf7adf115504e10a57f09af9408e818&scope.project.id=89a6206a5b7347f989194e2334051714&role.id=12fa8f67cf514b1e916afc130f0e6008 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:26.588638 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b658c78-3aab-4be7-ac57-ad3591290533 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:26.679280 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:26.686284 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276bc71-690a-46e4-90c3-77ef7dd5045d None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:26.689934 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:26.718165 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b658c78-3aab-4be7-ac57-ad3591290533 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:26.730724 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50318d4-4550-474a-b101-57b01085bfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:26.731642 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50318d4-4550-474a-b101-57b01085bfaa None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:26.732085 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50318d4-4550-474a-b101-57b01085bfaa None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:26.732378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50318d4-4550-474a-b101-57b01085bfaa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:26.744038 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50318d4-4550-474a-b101-57b01085bfaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:26.751949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-e50318d4-4550-474a-b101-57b01085bfaa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 15:37:26.751949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:26.751949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:26.751949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:26.751949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:26.751949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:26.751949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:26.751949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:26.751949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:26.751949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:26.751949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:26.751949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:26.751949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:26.751949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:26.751949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:26.751949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:26.752856 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:26.752856 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:26.752856 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:26.752856 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:26.752856 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:26.752856 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:26.752856 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:26.752856 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:26.752856 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:26.752856 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:26.752856 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:26.752856 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:26.752856 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:26.752856 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:26.752856 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:26.752856 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:26.753637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:26.753637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:26.753637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:26.753637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:26.753637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:26.753637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:26.753637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:26.753637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:26.753637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:26.753637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:26.753637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 15:37:26.753637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:26.753637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 135/279] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:26.754520 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca0596-a822-407e-8512-4e788c15dbf5 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:26.754715 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca0596-a822-407e-8512-4e788c15dbf5 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:26.754969 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca0596-a822-407e-8512-4e788c15dbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:26.772486 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11b248-c085-4292-b73c-21e123c053c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:26.773680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11b248-c085-4292-b73c-21e123c053c1 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:26.774031 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11b248-c085-4292-b73c-21e123c053c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:26.774314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11b248-c085-4292-b73c-21e123c053c1 None admin] PATH_INFO: `/v3/users/95c97886f6bd46feaf704b35c2cf0b8b` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:26.774573 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-8cca0596-a822-407e-8512-4e788c15dbf5 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:26.775775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-8cca0596-a822-407e-8512-4e788c15dbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:26.790640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11b248-c085-4292-b73c-21e123c053c1 None admin] RBAC: Authorizing `identity:get_user(user_id=95c97886f6bd46feaf704b35c2cf0b8b)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:26.792109 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11b248-c085-4292-b73c-21e123c053c1 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:26.793968 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 145/280] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:26 2022] GET /identity/v3/users/95c97886f6bd46feaf704b35c2cf0b8b => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:26.794753 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11b248-c085-4292-b73c-21e123c053c1 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:26.856158 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 136/281] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:26.857043 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca0596-a822-407e-8512-4e788c15dbf5 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:26.915548 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11b248-c085-4292-b73c-21e123c053c1 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:26.947121 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:26.955549 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a18d54-5edf-4e5e-b21a-487d42b4ec91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:26.956731 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a18d54-5edf-4e5e-b21a-487d42b4ec91 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:26.957017 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a18d54-5edf-4e5e-b21a-487d42b4ec91 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:26.957293 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a18d54-5edf-4e5e-b21a-487d42b4ec91 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:26.958505 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a18d54-5edf-4e5e-b21a-487d42b4ec91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:26.959973 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a18d54-5edf-4e5e-b21a-487d42b4ec91 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:26.960569 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:26.961755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 146/282] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:37:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:26.962550 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a18d54-5edf-4e5e-b21a-487d42b4ec91 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:26.968853 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca0596-a822-407e-8512-4e788c15dbf5 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:27.004426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae64fe3-6761-41b5-8372-13588ca08e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:27.005213 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae64fe3-6761-41b5-8372-13588ca08e91 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:27.005501 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae64fe3-6761-41b5-8372-13588ca08e91 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:27.005779 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae64fe3-6761-41b5-8372-13588ca08e91 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:27.006562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae64fe3-6761-41b5-8372-13588ca08e91 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:27.006879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae64fe3-6761-41b5-8372-13588ca08e91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:27.008275 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae64fe3-6761-41b5-8372-13588ca08e91 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:27.016976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 137/283] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:27.017789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae64fe3-6761-41b5-8372-13588ca08e91 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:27.068176 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a18d54-5edf-4e5e-b21a-487d42b4ec91 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:27.104465 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fc791-f1de-49f1-8a14-dce2e5049ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:27.105120 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fc791-f1de-49f1-8a14-dce2e5049ded None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:27.105413 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fc791-f1de-49f1-8a14-dce2e5049ded None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:27.105689 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fc791-f1de-49f1-8a14-dce2e5049ded None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:27.106552 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fc791-f1de-49f1-8a14-dce2e5049ded None admin] RBAC: Adding query filter params (role.id=2362b672eb7b474dbd341608f3993123, user.id=95c97886f6bd46feaf704b35c2cf0b8b, scope.system=all) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:27.106862 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fc791-f1de-49f1-8a14-dce2e5049ded None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:27.108919 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487fc791-f1de-49f1-8a14-dce2e5049ded None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:27.114482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 147/284] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Jun 23 15:37:26 2022] GET /identity/v3/role_assignments?user.id=95c97886f6bd46feaf704b35c2cf0b8b&scope.system=all&role.id=2362b672eb7b474dbd341608f3993123 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:27.115229 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fc791-f1de-49f1-8a14-dce2e5049ded None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:27.134477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae64fe3-6761-41b5-8372-13588ca08e91 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:27.175961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304be82-a787-4d37-9752-68a2c2abd0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:27.176829 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304be82-a787-4d37-9752-68a2c2abd0e0 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:27.177119 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304be82-a787-4d37-9752-68a2c2abd0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:27.177397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304be82-a787-4d37-9752-68a2c2abd0e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:27.190904 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6304be82-a787-4d37-9752-68a2c2abd0e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:27.192862 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:27.198850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-6304be82-a787-4d37-9752-68a2c2abd0e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:27.198850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:27.198850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:27.198850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:27.198850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:27.198850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:27.198850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:27.198850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:27.198850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:27.198850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:27.198850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:27.198850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:27.198850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:27.198850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:27.198850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:27.198850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:27.199783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:27.199783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:27.199783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:27.199783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:27.199783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:27.199783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:27.199783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:27.199783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:27.199783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:27.199783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:27.199783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:27.199783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:27.199783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:27.199783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:27.199783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:27.199783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:27.200550 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:27.200550 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:27.200550 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:27.200550 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:27.200550 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:27.200550 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:27.200550 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:27.200550 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:27.200550 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:27.200550 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:27.200550 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:27.200550 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:27.200550 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 138/285] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:27.201885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304be82-a787-4d37-9752-68a2c2abd0e0 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:27.227863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:27.251500 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fc791-f1de-49f1-8a14-dce2e5049ded None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:27.292721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac777c-9489-4538-b302-75d41945bb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:27.293431 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac777c-9489-4538-b302-75d41945bb2a None admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:27.293715 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac777c-9489-4538-b302-75d41945bb2a None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:27.294033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac777c-9489-4538-b302-75d41945bb2a None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:27.294830 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac777c-9489-4538-b302-75d41945bb2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:27.296272 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac777c-9489-4538-b302-75d41945bb2a None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:27.317767 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 148/286] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 23 15:37:27 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:37:27.326413 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac777c-9489-4538-b302-75d41945bb2a None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:27.341309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6304be82-a787-4d37-9752-68a2c2abd0e0 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:27.394104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fbfe01-0400-4009-b084-8ee3def63ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:27.395715 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbfe01-0400-4009-b084-8ee3def63ca0 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:27.396346 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbfe01-0400-4009-b084-8ee3def63ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:27.396800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fbfe01-0400-4009-b084-8ee3def63ca0 None admin] PATH_INFO: `/v3/users/e394f8b0cc554e398b4283478c044bbf` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:27.399416 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fbfe01-0400-4009-b084-8ee3def63ca0 None admin] RBAC: Authorizing `identity:get_user(user_id=e394f8b0cc554e398b4283478c044bbf)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:27.401351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fbfe01-0400-4009-b084-8ee3def63ca0 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:27.404991 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 139/287] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:27 2022] GET /identity/v3/users/e394f8b0cc554e398b4283478c044bbf => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:27.411083 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fbfe01-0400-4009-b084-8ee3def63ca0 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:27.449847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac777c-9489-4538-b302-75d41945bb2a None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:27.486893 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:27.503136 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0119b-087b-4f98-88d8-83dc039b6636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:27.503356 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0119b-087b-4f98-88d8-83dc039b6636 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:27.504234 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0119b-087b-4f98-88d8-83dc039b6636 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:27.504234 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0119b-087b-4f98-88d8-83dc039b6636 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:27.505221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0119b-087b-4f98-88d8-83dc039b6636 None admin] RBAC: Adding query filter params (name=member) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:27.505221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0119b-087b-4f98-88d8-83dc039b6636 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:27.506307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0119b-087b-4f98-88d8-83dc039b6636 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:27.516399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 149/288] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:27.521534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0119b-087b-4f98-88d8-83dc039b6636 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:27.521958 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:27.544322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fbfe01-0400-4009-b084-8ee3def63ca0 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:27.599672 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca7381-9b5f-440c-bed7-06bf668a1c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:27.600559 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca7381-9b5f-440c-bed7-06bf668a1c7e None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:27.600854 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca7381-9b5f-440c-bed7-06bf668a1c7e None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:27.601131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca7381-9b5f-440c-bed7-06bf668a1c7e None admin] PATH_INFO: `/v3/projects/89a6206a5b7347f989194e2334051714` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:27.602453 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca7381-9b5f-440c-bed7-06bf668a1c7e None admin] RBAC: Authorizing `identity:get_project(project_id=89a6206a5b7347f989194e2334051714)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:27.604071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dca7381-9b5f-440c-bed7-06bf668a1c7e None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:27.607469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 140/289] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:27 2022] GET /identity/v3/projects/89a6206a5b7347f989194e2334051714 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:27.614758 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca7381-9b5f-440c-bed7-06bf668a1c7e None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:27.656080 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0119b-087b-4f98-88d8-83dc039b6636 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:27.705304 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70c635-d39b-4aec-8c9b-439d32bdac85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:27.707140 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70c635-d39b-4aec-8c9b-439d32bdac85 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:27.707140 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70c635-d39b-4aec-8c9b-439d32bdac85 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:27.707140 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70c635-d39b-4aec-8c9b-439d32bdac85 None admin] PATH_INFO: `/v3/users/f0bc01e871354b158a0d361e93e4c66b` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:27.708541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70c635-d39b-4aec-8c9b-439d32bdac85 None admin] RBAC: Authorizing `identity:get_user(user_id=f0bc01e871354b158a0d361e93e4c66b)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:27.710970 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70c635-d39b-4aec-8c9b-439d32bdac85 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:27.712899 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 150/290] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:27 2022] GET /identity/v3/users/f0bc01e871354b158a0d361e93e4c66b => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:37:27.718490 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70c635-d39b-4aec-8c9b-439d32bdac85 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:27.746590 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca7381-9b5f-440c-bed7-06bf668a1c7e None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:27.776214 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:27.804204 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee0bdb-8288-4ebd-979a-8300373c3615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:27.805432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee0bdb-8288-4ebd-979a-8300373c3615 None admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:27.805917 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee0bdb-8288-4ebd-979a-8300373c3615 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:27.806388 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee0bdb-8288-4ebd-979a-8300373c3615 None admin] PATH_INFO: `/v3/projects/89a6206a5b7347f989194e2334051714/users/e394f8b0cc554e398b4283478c044bbf/roles/a655cf8750c8442eb3cce5c771188a99` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:27.808828 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee0bdb-8288-4ebd-979a-8300373c3615 None admin] RBAC: Authorizing `identity:create_grant(project_id=89a6206a5b7347f989194e2334051714, user_id=e394f8b0cc554e398b4283478c044bbf, role_id=a655cf8750c8442eb3cce5c771188a99)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:27.811105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee0bdb-8288-4ebd-979a-8300373c3615 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:27.831178 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 141/291] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 23 15:37:27 2022] PUT /identity/v3/projects/89a6206a5b7347f989194e2334051714/users/e394f8b0cc554e398b4283478c044bbf/roles/a655cf8750c8442eb3cce5c771188a99 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:37:27.848210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70c635-d39b-4aec-8c9b-439d32bdac85 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:27.885722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc38ee-175a-45f5-aad6-8150a093c81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:27.886525 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc38ee-175a-45f5-aad6-8150a093c81b None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:27.886879 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc38ee-175a-45f5-aad6-8150a093c81b None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:27.887227 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc38ee-175a-45f5-aad6-8150a093c81b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:27.963827 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc38ee-175a-45f5-aad6-8150a093c81b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:27.965231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cc38ee-175a-45f5-aad6-8150a093c81b None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:28.017415 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:28.072284 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 151/292] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 15:37:28.078590 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee0bdb-8288-4ebd-979a-8300373c3615 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:28.095536 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:28.190263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee0bdb-8288-4ebd-979a-8300373c3615 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:28.225089 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4af4e-0779-4542-9553-80fe9834788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:28.225887 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4af4e-0779-4542-9553-80fe9834788c None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:28.226173 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4af4e-0779-4542-9553-80fe9834788c None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:28.226444 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4af4e-0779-4542-9553-80fe9834788c None admin] PATH_INFO: `/v3/projects/89a6206a5b7347f989194e2334051714` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:28.227617 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4af4e-0779-4542-9553-80fe9834788c None admin] RBAC: Authorizing `identity:get_project(project_id=89a6206a5b7347f989194e2334051714)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:28.229079 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4af4e-0779-4542-9553-80fe9834788c None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:28.230977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 142/293] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:28 2022] GET /identity/v3/projects/89a6206a5b7347f989194e2334051714 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:28.236657 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc38ee-175a-45f5-aad6-8150a093c81b None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:28.338873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc38ee-175a-45f5-aad6-8150a093c81b None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:28.375650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a45e9f-8f97-4744-b94f-e6c394038351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:28.376314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a45e9f-8f97-4744-b94f-e6c394038351 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:28.376599 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a45e9f-8f97-4744-b94f-e6c394038351 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:28.376876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a45e9f-8f97-4744-b94f-e6c394038351 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:28.377721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a45e9f-8f97-4744-b94f-e6c394038351 None admin] RBAC: Adding query filter params (role.id=2362b672eb7b474dbd341608f3993123, scope.project.id=89a6206a5b7347f989194e2334051714, user.id=f0bc01e871354b158a0d361e93e4c66b) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:28.378072 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a45e9f-8f97-4744-b94f-e6c394038351 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:28.379504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a45e9f-8f97-4744-b94f-e6c394038351 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:28.386002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 152/294] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:37:28 2022] GET /identity/v3/role_assignments?user.id=f0bc01e871354b158a0d361e93e4c66b&scope.project.id=89a6206a5b7347f989194e2334051714&role.id=2362b672eb7b474dbd341608f3993123 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:29.523288 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485ec60-b0ca-4732-b166-c2debe130a65 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:29.524360 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485ec60-b0ca-4732-b166-c2debe130a65 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:29.524953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485ec60-b0ca-4732-b166-c2debe130a65 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:29.526817 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 143/295] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:29.533017 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e62d17-2c6c-4353-b8dc-d71a52deccfe None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:29.533813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e62d17-2c6c-4353-b8dc-d71a52deccfe None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:29.534326 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e62d17-2c6c-4353-b8dc-d71a52deccfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:29.556340 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-20e62d17-2c6c-4353-b8dc-d71a52deccfe None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:29.557808 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-20e62d17-2c6c-4353-b8dc-d71a52deccfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:29.570314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:29.632968 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 153/296] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:29.656926 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485ec60-b0ca-4732-b166-c2debe130a65 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:29.744490 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:29.765988 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485ec60-b0ca-4732-b166-c2debe130a65 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:29.802870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1107ef2-2265-451e-aed4-6da8bf27b341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:29.803593 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1107ef2-2265-451e-aed4-6da8bf27b341 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:29.803881 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1107ef2-2265-451e-aed4-6da8bf27b341 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:29.804161 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1107ef2-2265-451e-aed4-6da8bf27b341 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:29.816009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1107ef2-2265-451e-aed4-6da8bf27b341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:29.823762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-e1107ef2-2265-451e-aed4-6da8bf27b341 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:29.823762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:29.823762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:29.823762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:29.823762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:29.823762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:29.823762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:29.823762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:29.823762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:29.823762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:29.823762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:29.823762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:29.823762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:29.823762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:29.823762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:29.823762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:29.824674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:29.824674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:29.824674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:29.824674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:29.824674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:29.824674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:29.824674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:29.824674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:29.824674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:29.824674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:29.824674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:29.824674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:29.824674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:29.824674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:29.824674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:29.824674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:29.825432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:29.825432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:29.825432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:29.825432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:29.825432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:29.825432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:29.825432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:29.825432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:29.825432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:29.825432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:29.825432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:29.825432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:29.825432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 144/297] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:29.831731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1107ef2-2265-451e-aed4-6da8bf27b341 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:29.831873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596999c-4882-4666-9951-396df0495bdd None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:29.832055 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596999c-4882-4666-9951-396df0495bdd None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:29.832336 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596999c-4882-4666-9951-396df0495bdd None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:29.836835 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 154/298] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:29.838501 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93d2e5-25db-4b2a-9f85-7dd374e7cc1b None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:29.838789 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93d2e5-25db-4b2a-9f85-7dd374e7cc1b None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:29.839067 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93d2e5-25db-4b2a-9f85-7dd374e7cc1b None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:29.840528 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 155/299] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:37:29.841711 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6a1dd-6c3a-47eb-b60d-fce1e2b416ed None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:29.841711 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6a1dd-6c3a-47eb-b60d-fce1e2b416ed None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:29.844559 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6a1dd-6c3a-47eb-b60d-fce1e2b416ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:29.859503 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-a1a6a1dd-6c3a-47eb-b60d-fce1e2b416ed None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:29.860692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-a1a6a1dd-6c3a-47eb-b60d-fce1e2b416ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:29.940194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1107ef2-2265-451e-aed4-6da8bf27b341 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:29.945681 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 156/300] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:29.946993 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cc3dc-0207-41c5-8dde-459da15e5916 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:29.947280 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cc3dc-0207-41c5-8dde-459da15e5916 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:29.947558 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8cc3dc-0207-41c5-8dde-459da15e5916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:29.976408 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-4a8cc3dc-0207-41c5-8dde-459da15e5916 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:29.977586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-4a8cc3dc-0207-41c5-8dde-459da15e5916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:29.978628 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2218ef-b921-4d56-aa63-74fb12096866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:29.979301 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2218ef-b921-4d56-aa63-74fb12096866 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:29.979594 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2218ef-b921-4d56-aa63-74fb12096866 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:29.979875 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2218ef-b921-4d56-aa63-74fb12096866 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:29.980627 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2218ef-b921-4d56-aa63-74fb12096866 None admin] RBAC: Adding query filter params (name=member) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:29.980939 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2218ef-b921-4d56-aa63-74fb12096866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:29.982432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2218ef-b921-4d56-aa63-74fb12096866 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:29.991497 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 145/301] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:37:29.996474 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2218ef-b921-4d56-aa63-74fb12096866 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:30.000284 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:30.051775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 157/302] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:30.058826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cc3dc-0207-41c5-8dde-459da15e5916 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:30.064581 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:30.111514 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2218ef-b921-4d56-aa63-74fb12096866 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:30.144813 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81062d-1313-4b86-9c7f-a1b3f8b277dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:30.145615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81062d-1313-4b86-9c7f-a1b3f8b277dc None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:30.145920 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81062d-1313-4b86-9c7f-a1b3f8b277dc None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:30.146199 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f81062d-1313-4b86-9c7f-a1b3f8b277dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:30.158179 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f81062d-1313-4b86-9c7f-a1b3f8b277dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:30.165731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-6f81062d-1313-4b86-9c7f-a1b3f8b277dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 15:37:30.165731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:30.165731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:30.165731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:30.165731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:30.165731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:30.165731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:30.165731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:30.165731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:30.165731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:30.165731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:30.165731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:30.165731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:30.165731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:30.165731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:30.165731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:30.166624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:30.166624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:30.166624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:30.166624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:30.166624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:30.166624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:30.166624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:30.166624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:30.166624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:30.166624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:30.166624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:30.166624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:30.166624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:30.166624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:30.166624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:30.166624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:30.167384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:30.167384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:30.167384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:30.167384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:30.167384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:30.167384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:30.167384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:30.167384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:30.167384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:30.167384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:30.167384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 15:37:30.167384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:30.167384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 146/303] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:30.168569 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81062d-1313-4b86-9c7f-a1b3f8b277dc None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:30.180719 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8cc3dc-0207-41c5-8dde-459da15e5916 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:30.222077 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e858fc4-6e08-408d-8a76-c7aeedb31eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:30.223583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e858fc4-6e08-408d-8a76-c7aeedb31eef None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:30.224098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e858fc4-6e08-408d-8a76-c7aeedb31eef None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:30.226052 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e858fc4-6e08-408d-8a76-c7aeedb31eef None admin] PATH_INFO: `/v3/users/95c97886f6bd46feaf704b35c2cf0b8b` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:30.226803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e858fc4-6e08-408d-8a76-c7aeedb31eef None admin] RBAC: Authorizing `identity:get_user(user_id=95c97886f6bd46feaf704b35c2cf0b8b)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:30.228317 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e858fc4-6e08-408d-8a76-c7aeedb31eef None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:30.230023 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 158/304] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:30 2022] GET /identity/v3/users/95c97886f6bd46feaf704b35c2cf0b8b => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:30.230793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e858fc4-6e08-408d-8a76-c7aeedb31eef None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:30.240371 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:30.284038 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f81062d-1313-4b86-9c7f-a1b3f8b277dc None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:30.306700 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:30.318991 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448cef1-35c1-4e2f-8fbd-aa41fa729c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:30.319705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448cef1-35c1-4e2f-8fbd-aa41fa729c9a None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:30.319986 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448cef1-35c1-4e2f-8fbd-aa41fa729c9a None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:30.320260 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448cef1-35c1-4e2f-8fbd-aa41fa729c9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:30.321393 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448cef1-35c1-4e2f-8fbd-aa41fa729c9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:30.322846 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448cef1-35c1-4e2f-8fbd-aa41fa729c9a None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:30.326535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 147/305] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:37:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:30.326535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448cef1-35c1-4e2f-8fbd-aa41fa729c9a None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:30.337517 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e858fc4-6e08-408d-8a76-c7aeedb31eef None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:30.370847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f75e6-be5e-41d5-a3e6-478379db432e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:30.371512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f75e6-be5e-41d5-a3e6-478379db432e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:30.371794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f75e6-be5e-41d5-a3e6-478379db432e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:30.372077 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f75e6-be5e-41d5-a3e6-478379db432e None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:30.372848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f75e6-be5e-41d5-a3e6-478379db432e None admin] RBAC: Adding query filter params (name=reader) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:30.373157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f75e6-be5e-41d5-a3e6-478379db432e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:30.374550 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f75e6-be5e-41d5-a3e6-478379db432e None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:30.383021 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 159/306] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:30.387215 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fe82c-b6a9-437b-9e51-590ec8fd9a1a None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:30.387747 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fe82c-b6a9-437b-9e51-590ec8fd9a1a None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:30.388041 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fe82c-b6a9-437b-9e51-590ec8fd9a1a None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:30.389940 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 160/307] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:30.390779 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fe82c-b6a9-437b-9e51-590ec8fd9a1a None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:30.430189 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448cef1-35c1-4e2f-8fbd-aa41fa729c9a None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:30.458803 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:30.464642 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e0405-44fb-4085-92fe-012c8ffb9e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:30.465509 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e0405-44fb-4085-92fe-012c8ffb9e75 None admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:30.465796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e0405-44fb-4085-92fe-012c8ffb9e75 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:30.466107 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e0405-44fb-4085-92fe-012c8ffb9e75 None admin] PATH_INFO: `/v3/system/users/95c97886f6bd46feaf704b35c2cf0b8b/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:30.468199 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e0405-44fb-4085-92fe-012c8ffb9e75 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=95c97886f6bd46feaf704b35c2cf0b8b, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:30.469574 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e0405-44fb-4085-92fe-012c8ffb9e75 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:30.478278 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 148/308] 10.222.0.15 () {58 vars in 1334 bytes} [Thu Jun 23 15:37:30 2022] PUT /identity/v3/system/users/95c97886f6bd46feaf704b35c2cf0b8b/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:37:30.479082 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e0405-44fb-4085-92fe-012c8ffb9e75 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:30.503911 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fe82c-b6a9-437b-9e51-590ec8fd9a1a None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:30.548029 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:30.554790 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1abe2-162d-49d0-861b-704a159531b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:30.555843 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1abe2-162d-49d0-861b-704a159531b5 None admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:30.556274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1abe2-162d-49d0-861b-704a159531b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:30.556678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1abe2-162d-49d0-861b-704a159531b5 None admin] PATH_INFO: `/v3/groups` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:30.557530 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1abe2-162d-49d0-861b-704a159531b5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:30.559774 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1abe2-162d-49d0-861b-704a159531b5 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:30.586023 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 161/309] 10.222.0.15 () {60 vars in 1134 bytes} [Thu Jun 23 15:37:30 2022] POST /identity/v3/groups => generated 229 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:37:30.586023 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492abfed-54de-4be7-b156-f3641c4da282 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:30.586023 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492abfed-54de-4be7-b156-f3641c4da282 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:30.586023 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492abfed-54de-4be7-b156-f3641c4da282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:30.614629 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e0405-44fb-4085-92fe-012c8ffb9e75 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:30.616241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-492abfed-54de-4be7-b156-f3641c4da282 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:30.619187 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-492abfed-54de-4be7-b156-f3641c4da282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:30.667286 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e447c8-9b36-4792-b0c0-f67a77e5c6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:30.669193 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e447c8-9b36-4792-b0c0-f67a77e5c6ee None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:30.669512 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e447c8-9b36-4792-b0c0-f67a77e5c6ee None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:30.669792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e447c8-9b36-4792-b0c0-f67a77e5c6ee None admin] PATH_INFO: `/v3/users/f7269fefaae04c208ab79a97cb16b056` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:30.688741 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e447c8-9b36-4792-b0c0-f67a77e5c6ee None admin] RBAC: Authorizing `identity:get_user(user_id=f7269fefaae04c208ab79a97cb16b056)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:30.690401 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e447c8-9b36-4792-b0c0-f67a77e5c6ee None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:30.692440 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 149/310] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:30 2022] GET /identity/v3/users/f7269fefaae04c208ab79a97cb16b056 => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:30.698229 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e447c8-9b36-4792-b0c0-f67a77e5c6ee None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:30.713792 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 162/311] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:30.738694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492abfed-54de-4be7-b156-f3641c4da282 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:30.768831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:30.829735 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e447c8-9b36-4792-b0c0-f67a77e5c6ee None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:30.868912 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae84f6-25db-4861-9e1c-55282d4a3958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:30.869491 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae84f6-25db-4861-9e1c-55282d4a3958 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:30.869895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae84f6-25db-4861-9e1c-55282d4a3958 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:30.870232 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae84f6-25db-4861-9e1c-55282d4a3958 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:30.870966 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae84f6-25db-4861-9e1c-55282d4a3958 None admin] RBAC: Adding query filter params (role.id=a655cf8750c8442eb3cce5c771188a99, user.id=f7269fefaae04c208ab79a97cb16b056, scope.system=all) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:30.871255 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae84f6-25db-4861-9e1c-55282d4a3958 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:30.873226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae84f6-25db-4861-9e1c-55282d4a3958 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:30.874391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492abfed-54de-4be7-b156-f3641c4da282 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:30.879027 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 150/312] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Jun 23 15:37:30 2022] GET /identity/v3/role_assignments?user.id=f7269fefaae04c208ab79a97cb16b056&scope.system=all&role.id=a655cf8750c8442eb3cce5c771188a99 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:30.902320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:30.917793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192e67d-4f91-409f-832f-4aebcdeec8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:30.918891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192e67d-4f91-409f-832f-4aebcdeec8cd None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:30.920009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192e67d-4f91-409f-832f-4aebcdeec8cd None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:30.920560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192e67d-4f91-409f-832f-4aebcdeec8cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:30.933510 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192e67d-4f91-409f-832f-4aebcdeec8cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:30.942078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-8192e67d-4f91-409f-832f-4aebcdeec8cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 15:37:30.942078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:30.942078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:30.942078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:30.942078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:30.942078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:30.942078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:30.942078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:30.942078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:30.942078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:30.942078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:30.942078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:30.942078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:30.942078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:30.942078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:30.942078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:30.943250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:30.943250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:30.943250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:30.943250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:30.943250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:30.943250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:30.943250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:30.943250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:30.943250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:30.943250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:30.943250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:30.943250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:30.943250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:30.943250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:30.943250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:30.943250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:30.944251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:30.944251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:30.944251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:30.944251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:30.944251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:30.944251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:30.944251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:30.944251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:30.944251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:30.944251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:30.944251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 15:37:30.944251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:30.946774 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 163/313] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:37:30.953360 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae84f6-25db-4861-9e1c-55282d4a3958 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:31.068004 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae84f6-25db-4861-9e1c-55282d4a3958 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:31.086280 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:31.106031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fc303-c53a-4c51-8fcb-6ae8cce60175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:31.106981 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fc303-c53a-4c51-8fcb-6ae8cce60175 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:31.107435 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fc303-c53a-4c51-8fcb-6ae8cce60175 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:31.107860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fc303-c53a-4c51-8fcb-6ae8cce60175 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:31.108752 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1fc303-c53a-4c51-8fcb-6ae8cce60175 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:31.109205 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1fc303-c53a-4c51-8fcb-6ae8cce60175 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:31.110736 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1fc303-c53a-4c51-8fcb-6ae8cce60175 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:31.119936 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 151/314] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:31.125596 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192e67d-4f91-409f-832f-4aebcdeec8cd None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:31.232857 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192e67d-4f91-409f-832f-4aebcdeec8cd None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:31.267999 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ccdee5-c2b9-4fd9-ab2b-21140d9c0a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:31.269109 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ccdee5-c2b9-4fd9-ab2b-21140d9c0a0a None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:31.269618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ccdee5-c2b9-4fd9-ab2b-21140d9c0a0a None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:31.270068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ccdee5-c2b9-4fd9-ab2b-21140d9c0a0a None admin] PATH_INFO: `/v3/users/e394f8b0cc554e398b4283478c044bbf` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:31.271477 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ccdee5-c2b9-4fd9-ab2b-21140d9c0a0a None admin] RBAC: Authorizing `identity:get_user(user_id=e394f8b0cc554e398b4283478c044bbf)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:31.273056 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ccdee5-c2b9-4fd9-ab2b-21140d9c0a0a None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:31.275187 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 164/315] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:31 2022] GET /identity/v3/users/e394f8b0cc554e398b4283478c044bbf => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:31.281077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fc303-c53a-4c51-8fcb-6ae8cce60175 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:31.392439 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fc303-c53a-4c51-8fcb-6ae8cce60175 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:31.427754 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46efb0-914c-4d2f-af79-89869fc6de51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:31.428406 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46efb0-914c-4d2f-af79-89869fc6de51 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:31.428690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46efb0-914c-4d2f-af79-89869fc6de51 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:31.428966 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46efb0-914c-4d2f-af79-89869fc6de51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:31.487757 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:31.512371 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46efb0-914c-4d2f-af79-89869fc6de51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:31.513882 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46efb0-914c-4d2f-af79-89869fc6de51 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:31.621973 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 152/316] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:37:31.628304 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ccdee5-c2b9-4fd9-ab2b-21140d9c0a0a None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:31.684516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:31.737551 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ccdee5-c2b9-4fd9-ab2b-21140d9c0a0a None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:31.772062 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e222b66e-78bc-424d-a516-8b486cd52fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:31.772958 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222b66e-78bc-424d-a516-8b486cd52fb8 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:31.773248 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222b66e-78bc-424d-a516-8b486cd52fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:31.773530 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e222b66e-78bc-424d-a516-8b486cd52fb8 None admin] PATH_INFO: `/v3/projects/89a6206a5b7347f989194e2334051714` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:31.774944 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222b66e-78bc-424d-a516-8b486cd52fb8 None admin] RBAC: Authorizing `identity:get_project(project_id=89a6206a5b7347f989194e2334051714)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:31.776445 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e222b66e-78bc-424d-a516-8b486cd52fb8 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:31.778595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 165/317] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:31 2022] GET /identity/v3/projects/89a6206a5b7347f989194e2334051714 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:31.785439 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46efb0-914c-4d2f-af79-89869fc6de51 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:31.867161 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:31.890647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46efb0-914c-4d2f-af79-89869fc6de51 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:31.926730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e3be3-b630-420e-95f2-60fc7ebea35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:31.927398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e3be3-b630-420e-95f2-60fc7ebea35e None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:31.927688 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e3be3-b630-420e-95f2-60fc7ebea35e None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:31.927969 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e3be3-b630-420e-95f2-60fc7ebea35e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:31.928818 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e3be3-b630-420e-95f2-60fc7ebea35e None admin] RBAC: Adding query filter params (role.id=a655cf8750c8442eb3cce5c771188a99, scope.project.id=89a6206a5b7347f989194e2334051714, user.id=e394f8b0cc554e398b4283478c044bbf) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:31.929139 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e3be3-b630-420e-95f2-60fc7ebea35e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:31.930651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e3be3-b630-420e-95f2-60fc7ebea35e None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:31.938627 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 153/318] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:37:31 2022] GET /identity/v3/role_assignments?user.id=e394f8b0cc554e398b4283478c044bbf&scope.project.id=89a6206a5b7347f989194e2334051714&role.id=a655cf8750c8442eb3cce5c771188a99 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:32.597395 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fbb47-d958-4bc2-a6e9-e98b93ec3c70 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:32.597701 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fbb47-d958-4bc2-a6e9-e98b93ec3c70 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:32.597993 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fbb47-d958-4bc2-a6e9-e98b93ec3c70 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:32.599509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 166/319] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:32.604568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde9b2d-c0db-40db-8804-dfd95ea98310 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:32.604865 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde9b2d-c0db-40db-8804-dfd95ea98310 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:32.605142 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde9b2d-c0db-40db-8804-dfd95ea98310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:32.621818 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-ebde9b2d-c0db-40db-8804-dfd95ea98310 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:32.623030 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-ebde9b2d-c0db-40db-8804-dfd95ea98310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:32.691101 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 154/320] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:32.706784 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15dee1-6196-436f-b867-cc2a79f339a8 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:32.707262 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15dee1-6196-436f-b867-cc2a79f339a8 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:32.707335 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15dee1-6196-436f-b867-cc2a79f339a8 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:32.708822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 167/321] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:32.713828 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937305b9-b689-491c-9b7a-173530bc0cae None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:32.714149 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937305b9-b689-491c-9b7a-173530bc0cae None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:32.714428 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937305b9-b689-491c-9b7a-173530bc0cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:32.714586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15dee1-6196-436f-b867-cc2a79f339a8 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:32.732022 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-937305b9-b689-491c-9b7a-173530bc0cae None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:32.733193 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-937305b9-b689-491c-9b7a-173530bc0cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:32.801722 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 155/322] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:32.816677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15dee1-6196-436f-b867-cc2a79f339a8 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:32.824410 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937305b9-b689-491c-9b7a-173530bc0cae None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:32.827101 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:32.834643 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:32.852799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf1ec7-f5a9-4a94-a824-502a7c1cc21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:32.853595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf1ec7-f5a9-4a94-a824-502a7c1cc21e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:32.853905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf1ec7-f5a9-4a94-a824-502a7c1cc21e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:32.854190 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf1ec7-f5a9-4a94-a824-502a7c1cc21e None admin] PATH_INFO: `/v3/roles/member` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:32.865305 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf1ec7-f5a9-4a94-a824-502a7c1cc21e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:32.873622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-0ddf1ec7-f5a9-4a94-a824-502a7c1cc21e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:32.873622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:32.873622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:32.873622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:32.873622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:32.873622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:32.873622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:32.873622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:32.873622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:32.873622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:32.873622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:32.873622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:32.873622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:32.873622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:32.873622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:32.873622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:32.874658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:32.874658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:32.874658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:32.874658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:32.874658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:32.874658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:32.874658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:32.874658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:32.874658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:32.874658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:32.874658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:32.874658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:32.874658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:32.874658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:32.874658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:32.874658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:32.875623 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:32.875623 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:32.875623 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:32.875623 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:32.875623 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:32.875623 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:32.875623 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:32.875623 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:32.875623 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:32.875623 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:32.875623 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:32.875623 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:32.875623 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 168/323] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:32.880434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf1ec7-f5a9-4a94-a824-502a7c1cc21e None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:32.932477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937305b9-b689-491c-9b7a-173530bc0cae None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:32.969494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de430b-95b1-4e6e-9679-a346630fd6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:32.970311 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de430b-95b1-4e6e-9679-a346630fd6dd None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:32.970591 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de430b-95b1-4e6e-9679-a346630fd6dd None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:32.970861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de430b-95b1-4e6e-9679-a346630fd6dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:32.972022 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de430b-95b1-4e6e-9679-a346630fd6dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:32.973463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de430b-95b1-4e6e-9679-a346630fd6dd None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:32.975116 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 156/324] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:37:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:37:32.980544 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de430b-95b1-4e6e-9679-a346630fd6dd None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:32.990354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf1ec7-f5a9-4a94-a824-502a7c1cc21e None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:33.026202 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163e668-2f31-4278-ba2c-1e500d6bbb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:33.026860 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163e668-2f31-4278-ba2c-1e500d6bbb04 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:33.027143 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163e668-2f31-4278-ba2c-1e500d6bbb04 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:33.027419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163e668-2f31-4278-ba2c-1e500d6bbb04 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:33.028164 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163e668-2f31-4278-ba2c-1e500d6bbb04 None admin] RBAC: Adding query filter params (name=member) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:33.028564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163e668-2f31-4278-ba2c-1e500d6bbb04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:33.030740 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163e668-2f31-4278-ba2c-1e500d6bbb04 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:33.038880 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 169/325] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:37:33.040220 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b014fc-b855-4f98-8f46-0841f4ee267b None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:33.040511 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b014fc-b855-4f98-8f46-0841f4ee267b None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:33.040787 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b014fc-b855-4f98-8f46-0841f4ee267b None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:33.042030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 170/326] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:33.044071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b014fc-b855-4f98-8f46-0841f4ee267b None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:33.056225 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:33.086585 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de430b-95b1-4e6e-9679-a346630fd6dd None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:33.087407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:33.120570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd8d805-428b-4b07-ac2c-73a8608e3b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:33.121229 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8d805-428b-4b07-ac2c-73a8608e3b69 None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:33.121511 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8d805-428b-4b07-ac2c-73a8608e3b69 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:33.121786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd8d805-428b-4b07-ac2c-73a8608e3b69 None admin] PATH_INFO: `/v3/groups` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:33.122520 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8d805-428b-4b07-ac2c-73a8608e3b69 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:33.123938 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd8d805-428b-4b07-ac2c-73a8608e3b69 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:33.137591 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 157/327] 10.222.0.15 () {60 vars in 1134 bytes} [Thu Jun 23 15:37:32 2022] POST /identity/v3/groups => generated 226 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:37:33.143522 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846041ea-c2e5-421c-afd4-8ab245a32212 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:33.143863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846041ea-c2e5-421c-afd4-8ab245a32212 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:33.144207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846041ea-c2e5-421c-afd4-8ab245a32212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:33.148990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b014fc-b855-4f98-8f46-0841f4ee267b None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:33.162824 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-846041ea-c2e5-421c-afd4-8ab245a32212 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:33.164061 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-846041ea-c2e5-421c-afd4-8ab245a32212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:33.186946 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a8835-ba6e-449f-b275-047e765549c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:33.187860 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a8835-ba6e-449f-b275-047e765549c8 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:33.188146 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a8835-ba6e-449f-b275-047e765549c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:33.188425 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a8835-ba6e-449f-b275-047e765549c8 None admin] PATH_INFO: `/v3/users/95c97886f6bd46feaf704b35c2cf0b8b` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:33.189786 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a8835-ba6e-449f-b275-047e765549c8 None admin] RBAC: Authorizing `identity:get_user(user_id=95c97886f6bd46feaf704b35c2cf0b8b)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:33.191307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a8835-ba6e-449f-b275-047e765549c8 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:33.193092 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 171/328] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:33 2022] GET /identity/v3/users/95c97886f6bd46feaf704b35c2cf0b8b => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:37:33.199332 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a8835-ba6e-449f-b275-047e765549c8 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:33.248042 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 158/329] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:33.271711 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846041ea-c2e5-421c-afd4-8ab245a32212 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:33.320388 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a8835-ba6e-449f-b275-047e765549c8 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:33.332527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:33.344668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:33.359727 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c59b7a-530f-4555-ba0d-e7b8888a0a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:33.360388 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c59b7a-530f-4555-ba0d-e7b8888a0a63 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:33.360672 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c59b7a-530f-4555-ba0d-e7b8888a0a63 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:33.360950 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c59b7a-530f-4555-ba0d-e7b8888a0a63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:33.361786 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c59b7a-530f-4555-ba0d-e7b8888a0a63 None admin] RBAC: Adding query filter params (role.id=2362b672eb7b474dbd341608f3993123, user.id=95c97886f6bd46feaf704b35c2cf0b8b, scope.system=all) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:33.362130 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c59b7a-530f-4555-ba0d-e7b8888a0a63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:33.363610 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c59b7a-530f-4555-ba0d-e7b8888a0a63 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:33.380530 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 172/330] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Jun 23 15:37:33 2022] GET /identity/v3/role_assignments?user.id=95c97886f6bd46feaf704b35c2cf0b8b&scope.system=all&role.id=2362b672eb7b474dbd341608f3993123 => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:33.408275 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846041ea-c2e5-421c-afd4-8ab245a32212 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:33.453055 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5e372-0865-45ec-815f-d64ee92f5c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:33.453918 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5e372-0865-45ec-815f-d64ee92f5c17 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:33.454211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5e372-0865-45ec-815f-d64ee92f5c17 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:33.454491 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5e372-0865-45ec-815f-d64ee92f5c17 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:33.467560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5e372-0865-45ec-815f-d64ee92f5c17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:33.476463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-4cd5e372-0865-45ec-815f-d64ee92f5c17 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 15:37:33.476463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:33.476463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:33.476463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:33.476463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:33.476463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:33.476463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:33.476463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:33.476463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:33.476463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:33.476463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:33.476463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:33.476463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:33.476463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:33.476463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:33.476463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:33.477396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:33.477396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:33.477396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:33.477396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:33.477396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:33.477396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:33.477396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:33.477396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:33.477396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:33.477396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:33.477396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:33.477396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:33.477396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:33.477396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:33.477396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:33.477396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:33.478230 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:33.478230 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:33.478230 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:33.478230 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:33.478230 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:33.478230 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:33.478230 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:33.478230 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:33.478230 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:33.478230 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:33.478230 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 15:37:33.478230 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:33.478230 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 159/331] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:37:33.485902 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c59b7a-530f-4555-ba0d-e7b8888a0a63 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:33.617966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c59b7a-530f-4555-ba0d-e7b8888a0a63 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:33.664601 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7108024-bd75-4dff-b7a9-d0a057bcbe50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:33.665283 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7108024-bd75-4dff-b7a9-d0a057bcbe50 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:33.665567 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7108024-bd75-4dff-b7a9-d0a057bcbe50 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:33.665844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7108024-bd75-4dff-b7a9-d0a057bcbe50 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:33.666632 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7108024-bd75-4dff-b7a9-d0a057bcbe50 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:33.666948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7108024-bd75-4dff-b7a9-d0a057bcbe50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:33.668338 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7108024-bd75-4dff-b7a9-d0a057bcbe50 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:33.678108 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 173/332] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:33.683429 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5e372-0865-45ec-815f-d64ee92f5c17 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:33.801462 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5e372-0865-45ec-815f-d64ee92f5c17 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:33.822710 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:33.840851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c3f7d-7a33-4dbe-89f5-30a97eb2be9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:33.841826 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c3f7d-7a33-4dbe-89f5-30a97eb2be9d None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:33.842151 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c3f7d-7a33-4dbe-89f5-30a97eb2be9d None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:33.842430 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c3f7d-7a33-4dbe-89f5-30a97eb2be9d None admin] PATH_INFO: `/v3/users/f7269fefaae04c208ab79a97cb16b056` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:33.843638 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c3f7d-7a33-4dbe-89f5-30a97eb2be9d None admin] RBAC: Authorizing `identity:get_user(user_id=f7269fefaae04c208ab79a97cb16b056)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:33.845092 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c3f7d-7a33-4dbe-89f5-30a97eb2be9d None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:33.847089 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 160/333] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:33 2022] GET /identity/v3/users/f7269fefaae04c208ab79a97cb16b056 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:33.852606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7108024-bd75-4dff-b7a9-d0a057bcbe50 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:33.887571 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:33.968614 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7108024-bd75-4dff-b7a9-d0a057bcbe50 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:34.005214 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7bdb6-eab0-491c-96c0-d3c91043d2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:34.006169 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7bdb6-eab0-491c-96c0-d3c91043d2f8 None admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:34.006458 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7bdb6-eab0-491c-96c0-d3c91043d2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:34.006742 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7bdb6-eab0-491c-96c0-d3c91043d2f8 None admin] PATH_INFO: `/v3/system/users/f7269fefaae04c208ab79a97cb16b056/roles/a655cf8750c8442eb3cce5c771188a99` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:34.008274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7bdb6-eab0-491c-96c0-d3c91043d2f8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f7269fefaae04c208ab79a97cb16b056, role_id=a655cf8750c8442eb3cce5c771188a99)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:34.009669 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7bdb6-eab0-491c-96c0-d3c91043d2f8 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:34.023146 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 174/334] 10.222.0.15 () {58 vars in 1334 bytes} [Thu Jun 23 15:37:33 2022] PUT /identity/v3/system/users/f7269fefaae04c208ab79a97cb16b056/roles/a655cf8750c8442eb3cce5c771188a99 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:37:36.364065 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967aa07-9c29-4f17-b881-bd0d3e820e8b None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:36.364065 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967aa07-9c29-4f17-b881-bd0d3e820e8b None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:36.364065 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1967aa07-9c29-4f17-b881-bd0d3e820e8b None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:36.365212 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 161/335] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:36.371299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d9b90-bf74-49cd-ba5c-33a057e36edf None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:36.372203 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d9b90-bf74-49cd-ba5c-33a057e36edf None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:36.372721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d9b90-bf74-49cd-ba5c-33a057e36edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:36.399145 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-da8d9b90-bf74-49cd-ba5c-33a057e36edf None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:36.400755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-da8d9b90-bf74-49cd-ba5c-33a057e36edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:36.406118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f053f-4e53-4be5-bb11-4440b78317ee None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:36.406118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f053f-4e53-4be5-bb11-4440b78317ee None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:36.406118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f053f-4e53-4be5-bb11-4440b78317ee None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:36.407468 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 162/336] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:36.431784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41c04c-b333-4fa0-817f-6752660c66ed None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:36.432087 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41c04c-b333-4fa0-817f-6752660c66ed None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:36.432346 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41c04c-b333-4fa0-817f-6752660c66ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:36.465942 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-ae41c04c-b333-4fa0-817f-6752660c66ed None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:36.467247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-ae41c04c-b333-4fa0-817f-6752660c66ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:36.498293 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 175/337] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 15:37:36.569237 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d9b90-bf74-49cd-ba5c-33a057e36edf None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:36.594591 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 163/338] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 15:37:36.608576 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:36.630922 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41c04c-b333-4fa0-817f-6752660c66ed None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:36.738659 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d9b90-bf74-49cd-ba5c-33a057e36edf None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:36.757815 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41c04c-b333-4fa0-817f-6752660c66ed None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:36.777675 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:36.798274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23064072-a281-47c2-a231-133e3b75dc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:36.799099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23064072-a281-47c2-a231-133e3b75dc1c None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:36.799384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23064072-a281-47c2-a231-133e3b75dc1c None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:36.799667 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23064072-a281-47c2-a231-133e3b75dc1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:36.804471 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92dd91-45f4-47b3-b26d-aa73bebb85cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:36.805292 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92dd91-45f4-47b3-b26d-aa73bebb85cb None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:36.805575 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92dd91-45f4-47b3-b26d-aa73bebb85cb None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:36.805865 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92dd91-45f4-47b3-b26d-aa73bebb85cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:36.827507 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23064072-a281-47c2-a231-133e3b75dc1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:36.832127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92dd91-45f4-47b3-b26d-aa73bebb85cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:36.840283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-1a92dd91-45f4-47b3-b26d-aa73bebb85cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:36.840283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:36.840283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:36.840283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:36.840283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:36.840283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:36.840283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:36.840283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:36.840283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:36.840283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:36.840283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:36.840283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:36.840283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:36.840283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:36.840283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:36.840283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:36.841231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:36.841231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:36.841231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:36.841231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:36.841231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:36.841231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:36.841231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:36.841231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:36.841231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:36.841231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:36.841231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:36.841231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:36.841231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:36.841231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:36.841231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:36.841231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:36.842080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:36.842080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:36.842080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:36.842080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:36.842080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:36.842080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:36.842080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:36.842080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:36.842080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:36.842080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:36.842080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:36.842080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:36.842080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 164/339] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 23 15:37:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:36.846402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-23064072-a281-47c2-a231-133e3b75dc1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:36.846402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:36.846402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:36.846402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:36.846402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:36.846402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:36.846402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:36.846402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:36.846402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:36.846402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:36.846402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:36.846402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:36.846402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:36.846402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:36.846402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:36.846402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:36.847289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:36.847289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:36.847289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:36.847289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:36.847289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:36.847289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:36.847289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:36.847289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:36.847289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:36.847289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:36.847289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:36.847289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:36.847289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:36.847289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:36.847289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:36.847289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:36.848098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:36.848098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:36.848098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:36.848098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:36.848098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:36.848098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:36.848098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:36.848098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:36.848098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:36.848098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:36.848098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:36.848098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:36.848098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 176/340] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:37:36.848751 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92dd91-45f4-47b3-b26d-aa73bebb85cb None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:36.853774 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23064072-a281-47c2-a231-133e3b75dc1c None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:37.003842 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92dd91-45f4-47b3-b26d-aa73bebb85cb None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:37.051673 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b251d2b-257e-4c26-a359-43b945874acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:37.052367 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b251d2b-257e-4c26-a359-43b945874acb None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:37.052649 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b251d2b-257e-4c26-a359-43b945874acb None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:37.052924 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b251d2b-257e-4c26-a359-43b945874acb None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:37.053809 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b251d2b-257e-4c26-a359-43b945874acb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:37.054148 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b251d2b-257e-4c26-a359-43b945874acb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:37.055560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b251d2b-257e-4c26-a359-43b945874acb None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:37.077279 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 165/341] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:37:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:37.078770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c81701-02cb-42fa-9022-698df152f1c3 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:37.079057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c81701-02cb-42fa-9022-698df152f1c3 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:37.079337 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c81701-02cb-42fa-9022-698df152f1c3 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:37.083461 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 166/342] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:37.084271 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c81701-02cb-42fa-9022-698df152f1c3 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:37.098713 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:37.134884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23064072-a281-47c2-a231-133e3b75dc1c None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:37.180913 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:37.213148 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61febf1d-fd77-4cb2-9454-96efc9eab86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:37.213830 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61febf1d-fd77-4cb2-9454-96efc9eab86b None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:37.214145 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61febf1d-fd77-4cb2-9454-96efc9eab86b None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:37.214427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61febf1d-fd77-4cb2-9454-96efc9eab86b None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:37.215267 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61febf1d-fd77-4cb2-9454-96efc9eab86b None admin] RBAC: Adding query filter params (name=member) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:37.215581 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61febf1d-fd77-4cb2-9454-96efc9eab86b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:37.217570 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61febf1d-fd77-4cb2-9454-96efc9eab86b None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:37.234045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 177/343] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:37:37.236338 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcc616-9451-4e47-aa53-cd7a322a6907 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:37.236630 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcc616-9451-4e47-aa53-cd7a322a6907 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:37.236908 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcc616-9451-4e47-aa53-cd7a322a6907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:37.261647 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-1bbcc616-9451-4e47-aa53-cd7a322a6907 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:37.264015 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-1bbcc616-9451-4e47-aa53-cd7a322a6907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:37.282799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c81701-02cb-42fa-9022-698df152f1c3 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:37.331319 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d34916-5316-4f57-a58a-812641552027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:37.331990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d34916-5316-4f57-a58a-812641552027 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:37.332278 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d34916-5316-4f57-a58a-812641552027 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:37.332559 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d34916-5316-4f57-a58a-812641552027 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:37.352287 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 178/344] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:37.354064 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c425123-68b3-4b70-91f1-a903917df038 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:37.354361 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c425123-68b3-4b70-91f1-a903917df038 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:37.354801 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c425123-68b3-4b70-91f1-a903917df038 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:37.356433 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 179/345] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:37.357200 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c425123-68b3-4b70-91f1-a903917df038 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:37.442354 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d34916-5316-4f57-a58a-812641552027 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:37.443806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d34916-5316-4f57-a58a-812641552027 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:37.486371 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:37.517149 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:37.525264 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c425123-68b3-4b70-91f1-a903917df038 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:37.578328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4889e36-2cd8-44dc-a21d-59804bb06e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:37.579000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4889e36-2cd8-44dc-a21d-59804bb06e37 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:37.579292 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4889e36-2cd8-44dc-a21d-59804bb06e37 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:37.579574 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4889e36-2cd8-44dc-a21d-59804bb06e37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:37.601010 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 167/346] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:37:37.602478 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b182ac4-f4e7-4f00-9c06-8b1eb80de95d None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:37.602774 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b182ac4-f4e7-4f00-9c06-8b1eb80de95d None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:37.603052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b182ac4-f4e7-4f00-9c06-8b1eb80de95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:37.626064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-9b182ac4-f4e7-4f00-9c06-8b1eb80de95d None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:37.627275 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-9b182ac4-f4e7-4f00-9c06-8b1eb80de95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:37.680062 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4889e36-2cd8-44dc-a21d-59804bb06e37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:37.682062 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4889e36-2cd8-44dc-a21d-59804bb06e37 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:37.721894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 168/347] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:37.722564 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b182ac4-f4e7-4f00-9c06-8b1eb80de95d None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:37.792149 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:37.819912 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:37.822324 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 180/348] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:37:37.823458 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bd089-4aac-409c-af87-48b8bb2bc61f None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:37.823755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bd089-4aac-409c-af87-48b8bb2bc61f None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:37.824040 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bd089-4aac-409c-af87-48b8bb2bc61f None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:37.826047 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 181/349] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:37.829797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bd089-4aac-409c-af87-48b8bb2bc61f None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:37.876900 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b182ac4-f4e7-4f00-9c06-8b1eb80de95d None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:37.924200 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f2809-1001-466f-8d4f-be34884e3f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:37.925008 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f2809-1001-466f-8d4f-be34884e3f6a None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:37.925285 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f2809-1001-466f-8d4f-be34884e3f6a None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:37.925562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f2809-1001-466f-8d4f-be34884e3f6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:37.938995 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f2809-1001-466f-8d4f-be34884e3f6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:37.946854 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-692f2809-1001-466f-8d4f-be34884e3f6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:37.946854 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:37.946854 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:37.946854 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:37.946854 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:37.946854 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:37.946854 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:37.946854 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:37.946854 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:37.946854 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:37.946854 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:37.946854 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:37.946854 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:37.946854 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:37.946854 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:37.946854 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:37.947859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:37.947859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:37.947859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:37.947859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:37.947859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:37.947859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:37.947859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:37.947859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:37.947859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:37.947859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:37.947859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:37.947859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:37.947859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:37.947859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:37.947859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:37.947859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:37.948667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:37.948667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:37.948667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:37.948667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:37.948667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:37.948667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:37.948667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:37.948667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:37.948667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:37.948667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:37.948667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:37.948667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:37.948667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 169/350] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:37.949310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20011639-c6b5-4682-8bdb-a93f400343be None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:37.949941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20011639-c6b5-4682-8bdb-a93f400343be None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:37.949941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20011639-c6b5-4682-8bdb-a93f400343be None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:37.956526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 170/351] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:37.956526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20011639-c6b5-4682-8bdb-a93f400343be None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:37.973652 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bd089-4aac-409c-af87-48b8bb2bc61f None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:38.016059 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4960d-e7a2-49a5-ba2a-1afe61aac7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:38.018882 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4960d-e7a2-49a5-ba2a-1afe61aac7f5 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:38.019334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4960d-e7a2-49a5-ba2a-1afe61aac7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:38.021567 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4960d-e7a2-49a5-ba2a-1afe61aac7f5 None admin] PATH_INFO: `/v3/projects/16957e4778784bc187de225af6d1e1db` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:38.022028 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4960d-e7a2-49a5-ba2a-1afe61aac7f5 None admin] RBAC: Authorizing `identity:get_project(project_id=16957e4778784bc187de225af6d1e1db)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:38.023676 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c4960d-e7a2-49a5-ba2a-1afe61aac7f5 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:38.025902 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 182/352] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:37 2022] GET /identity/v3/projects/16957e4778784bc187de225af6d1e1db => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:38.026883 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d663872-5c60-45fa-b33f-4b2951bcaf1c None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:38.027168 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d663872-5c60-45fa-b33f-4b2951bcaf1c None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:38.027457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d663872-5c60-45fa-b33f-4b2951bcaf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:38.050693 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-9d663872-5c60-45fa-b33f-4b2951bcaf1c None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:38.050693 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-9d663872-5c60-45fa-b33f-4b2951bcaf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:38.090629 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:38.091680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20011639-c6b5-4682-8bdb-a93f400343be None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:38.129722 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:38.137388 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488113f-f469-488e-ae97-adaaf10085c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:38.138801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488113f-f469-488e-ae97-adaaf10085c8 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:38.139086 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488113f-f469-488e-ae97-adaaf10085c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:38.139365 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488113f-f469-488e-ae97-adaaf10085c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:38.142082 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 183/353] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:38.142536 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d663872-5c60-45fa-b33f-4b2951bcaf1c None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:38.158114 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488113f-f469-488e-ae97-adaaf10085c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:38.166747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-7488113f-f469-488e-ae97-adaaf10085c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:38.166747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:38.166747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:38.166747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:38.166747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:38.166747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:38.166747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:38.166747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:38.166747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:38.166747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:38.166747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:38.166747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:38.166747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:38.166747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:38.166747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:38.166747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:38.167867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:38.167867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:38.167867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:38.167867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:38.167867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:38.167867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:38.167867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:38.167867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:38.167867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:38.167867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:38.167867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:38.167867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:38.167867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:38.167867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:38.167867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:38.167867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:38.170078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:38.170078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:38.170078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:38.170078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:38.170078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:38.170078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:38.170078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:38.170078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:38.170078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:38.170078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:38.170078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:38.170078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:38.170078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 171/354] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 23 15:37:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:38.170729 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488113f-f469-488e-ae97-adaaf10085c8 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:38.288742 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d663872-5c60-45fa-b33f-4b2951bcaf1c None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:38.308740 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488113f-f469-488e-ae97-adaaf10085c8 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:38.340546 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4e851-c21d-476b-a8b3-87309ba19d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:38.342004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4e851-c21d-476b-a8b3-87309ba19d19 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:38.342290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4e851-c21d-476b-a8b3-87309ba19d19 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:38.342563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4e851-c21d-476b-a8b3-87309ba19d19 None admin] PATH_INFO: `/v3/projects/16957e4778784bc187de225af6d1e1db` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:38.343797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4e851-c21d-476b-a8b3-87309ba19d19 None admin] RBAC: Authorizing `identity:get_project(project_id=16957e4778784bc187de225af6d1e1db)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:38.345251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4e851-c21d-476b-a8b3-87309ba19d19 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:38.347178 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 184/355] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:38 2022] GET /identity/v3/projects/16957e4778784bc187de225af6d1e1db => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:38.348718 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5abfc-8a07-44f2-995a-65594b0f7ae3 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:38.348718 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5abfc-8a07-44f2-995a-65594b0f7ae3 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:38.348916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5abfc-8a07-44f2-995a-65594b0f7ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:38.360374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffdb50-fc6f-4ad6-a064-4d3d584ac5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:38.361063 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffdb50-fc6f-4ad6-a064-4d3d584ac5e3 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:38.361348 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffdb50-fc6f-4ad6-a064-4d3d584ac5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:38.361630 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffdb50-fc6f-4ad6-a064-4d3d584ac5e3 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:38.362441 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ffdb50-fc6f-4ad6-a064-4d3d584ac5e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:38.362752 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ffdb50-fc6f-4ad6-a064-4d3d584ac5e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:38.364160 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ffdb50-fc6f-4ad6-a064-4d3d584ac5e3 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:38.374912 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 172/356] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:38.375093 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-95e5abfc-8a07-44f2-995a-65594b0f7ae3 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:38.376097 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffdb50-fc6f-4ad6-a064-4d3d584ac5e3 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:38.376232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-95e5abfc-8a07-44f2-995a-65594b0f7ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:38.417882 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:38.459034 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 185/357] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:38.460211 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5abfc-8a07-44f2-995a-65594b0f7ae3 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:38.469288 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:38.546849 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffdb50-fc6f-4ad6-a064-4d3d584ac5e3 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:38.596713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df261483-f067-42a9-8f9a-2f587c7f614d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:38.597591 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df261483-f067-42a9-8f9a-2f587c7f614d None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:38.597917 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df261483-f067-42a9-8f9a-2f587c7f614d None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:38.598205 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df261483-f067-42a9-8f9a-2f587c7f614d None admin] PATH_INFO: `/v3/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:38.601081 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5abfc-8a07-44f2-995a-65594b0f7ae3 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:38.605063 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df261483-f067-42a9-8f9a-2f587c7f614d None admin] RBAC: Authorizing `identity:get_group(group_id=3f3819abcac24ae3b0ccdd1d8c2a7fc2)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:38.606550 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df261483-f067-42a9-8f9a-2f587c7f614d None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:38.608315 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 173/358] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 23 15:37:38 2022] GET /identity/v3/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:38.609196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df261483-f067-42a9-8f9a-2f587c7f614d None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:38.655151 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef0bd4-d889-4e86-b622-c07bc1cc8c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:38.656221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef0bd4-d889-4e86-b622-c07bc1cc8c70 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:38.656497 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef0bd4-d889-4e86-b622-c07bc1cc8c70 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:38.656783 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef0bd4-d889-4e86-b622-c07bc1cc8c70 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:38.671242 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef0bd4-d889-4e86-b622-c07bc1cc8c70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:38.679290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-c7ef0bd4-d889-4e86-b622-c07bc1cc8c70 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 15:37:38.679290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:38.679290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:38.679290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:38.679290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:38.679290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:38.679290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:38.679290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:38.679290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:38.679290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:38.679290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:38.679290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:38.679290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:38.679290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:38.679290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:38.679290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:38.680232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:38.680232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:38.680232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:38.680232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:38.680232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:38.680232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:38.680232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:38.680232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:38.680232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:38.680232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:38.680232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:38.680232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:38.680232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:38.680232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:38.680232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:38.680232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:38.681918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:38.681918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:38.681918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:38.681918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:38.681918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:38.681918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:38.681918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:38.681918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:38.681918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:38.681918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:38.681918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 15:37:38.681918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:38.681918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 186/359] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:38.681918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef0bd4-d889-4e86-b622-c07bc1cc8c70 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:38.726363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:38.748334 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df261483-f067-42a9-8f9a-2f587c7f614d None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:38.767759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:38.793488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29e2a9-d5e2-4b9f-a4dc-311be728479e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:38.794448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29e2a9-d5e2-4b9f-a4dc-311be728479e None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:38.794553 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29e2a9-d5e2-4b9f-a4dc-311be728479e None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:38.794832 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29e2a9-d5e2-4b9f-a4dc-311be728479e None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:38.795600 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29e2a9-d5e2-4b9f-a4dc-311be728479e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:38.796036 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29e2a9-d5e2-4b9f-a4dc-311be728479e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:38.797475 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29e2a9-d5e2-4b9f-a4dc-311be728479e None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:38.806606 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 174/360] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:37:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:38.807289 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29e2a9-d5e2-4b9f-a4dc-311be728479e None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:38.818892 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef0bd4-d889-4e86-b622-c07bc1cc8c70 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:38.875255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8581457-c136-4443-b6a2-9260f4347696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:38.876135 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8581457-c136-4443-b6a2-9260f4347696 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:38.876426 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8581457-c136-4443-b6a2-9260f4347696 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:38.876712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8581457-c136-4443-b6a2-9260f4347696 None admin] PATH_INFO: `/v3/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:38.878188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8581457-c136-4443-b6a2-9260f4347696 None admin] RBAC: Authorizing `identity:get_group(group_id=3f3819abcac24ae3b0ccdd1d8c2a7fc2)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:38.879684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8581457-c136-4443-b6a2-9260f4347696 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:38.881564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 187/361] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 23 15:37:38 2022] GET /identity/v3/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:38.883922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8581457-c136-4443-b6a2-9260f4347696 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:38.946129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29e2a9-d5e2-4b9f-a4dc-311be728479e None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:38.993478 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff30ff-7654-4c18-aa8b-16575f165934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:38.994199 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff30ff-7654-4c18-aa8b-16575f165934 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:38.994485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff30ff-7654-4c18-aa8b-16575f165934 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:38.994770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff30ff-7654-4c18-aa8b-16575f165934 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:39.007088 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:39.015773 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8581457-c136-4443-b6a2-9260f4347696 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:39.055846 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:39.060220 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564933cb-eb9f-444a-afa2-bd814ee64367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:39.061033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564933cb-eb9f-444a-afa2-bd814ee64367 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:39.061319 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564933cb-eb9f-444a-afa2-bd814ee64367 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:39.062170 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564933cb-eb9f-444a-afa2-bd814ee64367 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:39.080330 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564933cb-eb9f-444a-afa2-bd814ee64367 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:39.081628 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff30ff-7654-4c18-aa8b-16575f165934 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:39.083143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff30ff-7654-4c18-aa8b-16575f165934 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:39.088025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-564933cb-eb9f-444a-afa2-bd814ee64367 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:37:39.088025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:39.088025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:39.088025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:39.088025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:39.088025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:39.088025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:39.088025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:39.088025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:39.088025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:39.088025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:39.088025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:39.088025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:39.088025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:39.088025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:39.088025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:39.088922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:39.088922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:39.088922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:39.088922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:39.088922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:39.088922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:39.088922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:39.088922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:39.088922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:39.088922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:39.088922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:39.088922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:39.088922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:39.088922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:39.088922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:39.088922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:39.089696 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:39.089696 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:39.089696 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:39.089696 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:39.089696 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:39.089696 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:39.089696 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:39.089696 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:39.089696 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:39.089696 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:39.089696 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:37:39.089696 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:39.089696 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 188/362] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:37:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:39.090373 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564933cb-eb9f-444a-afa2-bd814ee64367 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:39.192835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 175/363] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:37:39.193694 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff30ff-7654-4c18-aa8b-16575f165934 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:39.203874 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564933cb-eb9f-444a-afa2-bd814ee64367 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:39.246017 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675de63f-8e8f-4da1-9d6e-a5c87d74913f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:39.246673 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675de63f-8e8f-4da1-9d6e-a5c87d74913f None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:39.246960 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675de63f-8e8f-4da1-9d6e-a5c87d74913f None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:39.247258 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675de63f-8e8f-4da1-9d6e-a5c87d74913f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:39.248095 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675de63f-8e8f-4da1-9d6e-a5c87d74913f None admin] RBAC: Adding query filter params (group.id=3f3819abcac24ae3b0ccdd1d8c2a7fc2, role.id=12fa8f67cf514b1e916afc130f0e6008, scope.project.id=16957e4778784bc187de225af6d1e1db) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:39.248406 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675de63f-8e8f-4da1-9d6e-a5c87d74913f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:39.249930 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675de63f-8e8f-4da1-9d6e-a5c87d74913f None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:39.265891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 189/364] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jun 23 15:37:39 2022] GET /identity/v3/role_assignments?group.id=3f3819abcac24ae3b0ccdd1d8c2a7fc2&scope.project.id=16957e4778784bc187de225af6d1e1db&role.id=12fa8f67cf514b1e916afc130f0e6008 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:39.265891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675de63f-8e8f-4da1-9d6e-a5c87d74913f None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:39.286573 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:39.291185 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:39.318455 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff30ff-7654-4c18-aa8b-16575f165934 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:39.364555 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11610d9e-b3c8-48aa-9d3c-e0e54547dcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:39.365251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11610d9e-b3c8-48aa-9d3c-e0e54547dcc9 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:39.365607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11610d9e-b3c8-48aa-9d3c-e0e54547dcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:39.365906 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11610d9e-b3c8-48aa-9d3c-e0e54547dcc9 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:39.366680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11610d9e-b3c8-48aa-9d3c-e0e54547dcc9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:39.366994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11610d9e-b3c8-48aa-9d3c-e0e54547dcc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:39.368412 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11610d9e-b3c8-48aa-9d3c-e0e54547dcc9 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:39.387391 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 176/365] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:39.387391 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11610d9e-b3c8-48aa-9d3c-e0e54547dcc9 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:39.403250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675de63f-8e8f-4da1-9d6e-a5c87d74913f None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:39.450950 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5613dc3-b1a5-46f9-a1d8-b65f85716a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:39.451606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5613dc3-b1a5-46f9-a1d8-b65f85716a5d None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:39.451888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5613dc3-b1a5-46f9-a1d8-b65f85716a5d None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:39.452172 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5613dc3-b1a5-46f9-a1d8-b65f85716a5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:39.512319 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11610d9e-b3c8-48aa-9d3c-e0e54547dcc9 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:39.553454 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5613dc3-b1a5-46f9-a1d8-b65f85716a5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:39.556022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5613dc3-b1a5-46f9-a1d8-b65f85716a5d None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:39.571236 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbf3e6-0faf-4149-9e17-40b6ecd37709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:39.572138 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbf3e6-0faf-4149-9e17-40b6ecd37709 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:39.572566 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbf3e6-0faf-4149-9e17-40b6ecd37709 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:39.572970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbf3e6-0faf-4149-9e17-40b6ecd37709 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:39.574272 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbf3e6-0faf-4149-9e17-40b6ecd37709 None admin] RBAC: Adding query filter params (group.id=3f3819abcac24ae3b0ccdd1d8c2a7fc2, role.id=2362b672eb7b474dbd341608f3993123, scope.project.id=16957e4778784bc187de225af6d1e1db) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:39.574716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbf3e6-0faf-4149-9e17-40b6ecd37709 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:39.576578 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbf3e6-0faf-4149-9e17-40b6ecd37709 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:39.582738 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 177/366] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jun 23 15:37:39 2022] GET /identity/v3/role_assignments?group.id=3f3819abcac24ae3b0ccdd1d8c2a7fc2&scope.project.id=16957e4778784bc187de225af6d1e1db&role.id=2362b672eb7b474dbd341608f3993123 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:39.583546 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbf3e6-0faf-4149-9e17-40b6ecd37709 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:39.588500 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:39.606318 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:39.718465 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 190/367] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:37:39.719789 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5613dc3-b1a5-46f9-a1d8-b65f85716a5d None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:39.736500 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbf3e6-0faf-4149-9e17-40b6ecd37709 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:39.781809 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c7375-820d-4ec9-a877-52c536065ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:39.782795 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c7375-820d-4ec9-a877-52c536065ce1 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:39.783081 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c7375-820d-4ec9-a877-52c536065ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:39.783353 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c7375-820d-4ec9-a877-52c536065ce1 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:39.784266 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c7375-820d-4ec9-a877-52c536065ce1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:39.784726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c7375-820d-4ec9-a877-52c536065ce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:39.786300 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c7375-820d-4ec9-a877-52c536065ce1 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:39.804045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 178/368] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:39.809901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c7375-820d-4ec9-a877-52c536065ce1 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:39.856001 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5613dc3-b1a5-46f9-a1d8-b65f85716a5d None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:39.880566 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:39.886166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:39.901738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3878fc5-0857-451b-8209-cdb7fc2714bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:39.902728 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3878fc5-0857-451b-8209-cdb7fc2714bc None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:39.903112 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3878fc5-0857-451b-8209-cdb7fc2714bc None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:39.903503 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3878fc5-0857-451b-8209-cdb7fc2714bc None admin] PATH_INFO: `/v3/projects/89a6206a5b7347f989194e2334051714` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:39.905810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3878fc5-0857-451b-8209-cdb7fc2714bc None admin] RBAC: Authorizing `identity:get_project(project_id=89a6206a5b7347f989194e2334051714)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:39.907544 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3878fc5-0857-451b-8209-cdb7fc2714bc None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:39.914110 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 191/369] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:39 2022] GET /identity/v3/projects/89a6206a5b7347f989194e2334051714 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:39.914110 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3878fc5-0857-451b-8209-cdb7fc2714bc None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:39.927851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c7375-820d-4ec9-a877-52c536065ce1 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:39.981197 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff8f71-2b0f-4db6-98f8-eeafb669391e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:39.982486 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff8f71-2b0f-4db6-98f8-eeafb669391e None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:39.982956 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff8f71-2b0f-4db6-98f8-eeafb669391e None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:39.983408 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff8f71-2b0f-4db6-98f8-eeafb669391e None admin] PATH_INFO: `/v3/users/f7269fefaae04c208ab79a97cb16b056` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:39.985091 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff8f71-2b0f-4db6-98f8-eeafb669391e None admin] RBAC: Authorizing `identity:get_user(user_id=f7269fefaae04c208ab79a97cb16b056)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:39.986848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff8f71-2b0f-4db6-98f8-eeafb669391e None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:39.989198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 179/370] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:37:39 2022] GET /identity/v3/users/f7269fefaae04c208ab79a97cb16b056 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:39.990521 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff8f71-2b0f-4db6-98f8-eeafb669391e None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:40.045959 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3878fc5-0857-451b-8209-cdb7fc2714bc None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:40.092946 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812a118-2e68-49cd-b71f-69c3d72bf584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:40.093894 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812a118-2e68-49cd-b71f-69c3d72bf584 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:40.094307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812a118-2e68-49cd-b71f-69c3d72bf584 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:40.094761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812a118-2e68-49cd-b71f-69c3d72bf584 None admin] PATH_INFO: `/v3/projects/89a6206a5b7347f989194e2334051714` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:40.096617 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812a118-2e68-49cd-b71f-69c3d72bf584 None admin] RBAC: Authorizing `identity:get_project(project_id=89a6206a5b7347f989194e2334051714)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:40.098480 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812a118-2e68-49cd-b71f-69c3d72bf584 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:40.105922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 192/371] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:39 2022] GET /identity/v3/projects/89a6206a5b7347f989194e2334051714 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:40.105922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812a118-2e68-49cd-b71f-69c3d72bf584 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:40.117930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff8f71-2b0f-4db6-98f8-eeafb669391e None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:40.162849 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac3e14-d3dc-4e27-adfc-35d38c1a2656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:40.163700 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac3e14-d3dc-4e27-adfc-35d38c1a2656 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:40.164075 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac3e14-d3dc-4e27-adfc-35d38c1a2656 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:40.164446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac3e14-d3dc-4e27-adfc-35d38c1a2656 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:40.167967 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:40.190829 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:40.244660 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812a118-2e68-49cd-b71f-69c3d72bf584 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:40.261102 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac3e14-d3dc-4e27-adfc-35d38c1a2656 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:40.266788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac3e14-d3dc-4e27-adfc-35d38c1a2656 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:40.298447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f98758-1815-4e68-9d44-31deeaf28fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:40.299456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f98758-1815-4e68-9d44-31deeaf28fad None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:40.299679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f98758-1815-4e68-9d44-31deeaf28fad None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:40.299959 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f98758-1815-4e68-9d44-31deeaf28fad None admin] PATH_INFO: `/v3/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:40.301236 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f98758-1815-4e68-9d44-31deeaf28fad None admin] RBAC: Authorizing `identity:get_group(group_id=3f3819abcac24ae3b0ccdd1d8c2a7fc2)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:40.302737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f98758-1815-4e68-9d44-31deeaf28fad None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:40.304615 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 193/372] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 23 15:37:40 2022] GET /identity/v3/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:40.310851 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f98758-1815-4e68-9d44-31deeaf28fad None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:40.412696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 180/373] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:37:40.413925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac3e14-d3dc-4e27-adfc-35d38c1a2656 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:40.443141 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f98758-1815-4e68-9d44-31deeaf28fad None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:40.458315 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:40.484316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:40.500737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d921b-459b-498c-9116-85636d20ae30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:40.502078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d921b-459b-498c-9116-85636d20ae30 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:40.502583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d921b-459b-498c-9116-85636d20ae30 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:40.503070 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d921b-459b-498c-9116-85636d20ae30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:40.504379 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d921b-459b-498c-9116-85636d20ae30 None admin] RBAC: Adding query filter params (role.id=a655cf8750c8442eb3cce5c771188a99, user.id=f7269fefaae04c208ab79a97cb16b056, scope.system=all) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:40.505491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d921b-459b-498c-9116-85636d20ae30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:40.507489 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2d921b-459b-498c-9116-85636d20ae30 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:40.528046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 194/374] 10.222.0.15 () {56 vars in 1308 bytes} [Thu Jun 23 15:37:40 2022] GET /identity/v3/role_assignments?user.id=f7269fefaae04c208ab79a97cb16b056&scope.system=all&role.id=a655cf8750c8442eb3cce5c771188a99 => generated 510 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:40.528046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d921b-459b-498c-9116-85636d20ae30 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:40.583776 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac3e14-d3dc-4e27-adfc-35d38c1a2656 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:40.662476 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd0843-f740-4cbd-9073-54928ddd4806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:40.664335 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd0843-f740-4cbd-9073-54928ddd4806 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:40.664621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd0843-f740-4cbd-9073-54928ddd4806 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:40.664899 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd0843-f740-4cbd-9073-54928ddd4806 None admin] PATH_INFO: `/v3/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:40.669024 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd0843-f740-4cbd-9073-54928ddd4806 None admin] RBAC: Authorizing `identity:get_group(group_id=3f3819abcac24ae3b0ccdd1d8c2a7fc2)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:40.671117 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd0843-f740-4cbd-9073-54928ddd4806 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:40.673082 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 181/375] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 23 15:37:40 2022] GET /identity/v3/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:40.677289 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd0843-f740-4cbd-9073-54928ddd4806 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:40.767522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d921b-459b-498c-9116-85636d20ae30 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:40.804154 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78be4ae-9b62-4828-8aca-7b6ededfb54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:40.804829 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78be4ae-9b62-4828-8aca-7b6ededfb54c None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:40.805114 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78be4ae-9b62-4828-8aca-7b6ededfb54c None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:40.805396 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78be4ae-9b62-4828-8aca-7b6ededfb54c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:40.806283 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78be4ae-9b62-4828-8aca-7b6ededfb54c None admin] RBAC: Adding query filter params (group.id=3f3819abcac24ae3b0ccdd1d8c2a7fc2, role.id=2362b672eb7b474dbd341608f3993123, scope.project.id=89a6206a5b7347f989194e2334051714) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:40.806601 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78be4ae-9b62-4828-8aca-7b6ededfb54c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:40.808088 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78be4ae-9b62-4828-8aca-7b6ededfb54c None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:40.816254 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 195/376] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jun 23 15:37:40 2022] GET /identity/v3/role_assignments?group.id=3f3819abcac24ae3b0ccdd1d8c2a7fc2&scope.project.id=89a6206a5b7347f989194e2334051714&role.id=2362b672eb7b474dbd341608f3993123 => generated 260 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:40.822927 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78be4ae-9b62-4828-8aca-7b6ededfb54c None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:40.833520 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd0843-f740-4cbd-9073-54928ddd4806 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:40.836515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:40.891401 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186c304-8cb7-44f4-94a2-4f0c5f949999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:40.892470 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186c304-8cb7-44f4-94a2-4f0c5f949999 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:40.892765 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186c304-8cb7-44f4-94a2-4f0c5f949999 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:40.893050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186c304-8cb7-44f4-94a2-4f0c5f949999 None admin] PATH_INFO: `/v3/projects/a90cb52bb0ee4522ac438c1991f3a531` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:40.894390 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186c304-8cb7-44f4-94a2-4f0c5f949999 None admin] RBAC: Authorizing `identity:get_project(project_id=a90cb52bb0ee4522ac438c1991f3a531)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:40.895934 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186c304-8cb7-44f4-94a2-4f0c5f949999 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:40.897783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 182/377] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:40 2022] GET /identity/v3/projects/a90cb52bb0ee4522ac438c1991f3a531 => generated 344 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:40.909328 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186c304-8cb7-44f4-94a2-4f0c5f949999 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:40.956077 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:41.078535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186c304-8cb7-44f4-94a2-4f0c5f949999 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:41.083840 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78be4ae-9b62-4828-8aca-7b6ededfb54c None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:41.125626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e153e5-7294-45cf-a5b1-4cec5f8fe629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:41.126523 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e153e5-7294-45cf-a5b1-4cec5f8fe629 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:41.126802 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e153e5-7294-45cf-a5b1-4cec5f8fe629 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:41.127073 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e153e5-7294-45cf-a5b1-4cec5f8fe629 None admin] PATH_INFO: `/v3/groups/ba87514ee0064059aca980dd9bef9f85` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:41.129411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3b5e5-f471-4c7e-b910-4f07eb112b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:41.133921 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3b5e5-f471-4c7e-b910-4f07eb112b40 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:41.134422 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e153e5-7294-45cf-a5b1-4cec5f8fe629 None admin] RBAC: Authorizing `identity:get_group(group_id=ba87514ee0064059aca980dd9bef9f85)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:41.134737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3b5e5-f471-4c7e-b910-4f07eb112b40 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:41.135240 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3b5e5-f471-4c7e-b910-4f07eb112b40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:41.136314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3b5e5-f471-4c7e-b910-4f07eb112b40 None admin] RBAC: Adding query filter params (group.id=3f3819abcac24ae3b0ccdd1d8c2a7fc2, role.id=12fa8f67cf514b1e916afc130f0e6008, scope.project.id=89a6206a5b7347f989194e2334051714) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:41.136746 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e153e5-7294-45cf-a5b1-4cec5f8fe629 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:41.137070 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3b5e5-f471-4c7e-b910-4f07eb112b40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:41.138840 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db3b5e5-f471-4c7e-b910-4f07eb112b40 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:41.144256 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 183/378] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 23 15:37:40 2022] GET /identity/v3/groups/ba87514ee0064059aca980dd9bef9f85 => generated 229 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:41.148307 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e153e5-7294-45cf-a5b1-4cec5f8fe629 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:41.150658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 196/379] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jun 23 15:37:40 2022] GET /identity/v3/role_assignments?group.id=3f3819abcac24ae3b0ccdd1d8c2a7fc2&scope.project.id=89a6206a5b7347f989194e2334051714&role.id=12fa8f67cf514b1e916afc130f0e6008 => generated 260 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:41.190303 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:41.261953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e153e5-7294-45cf-a5b1-4cec5f8fe629 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:41.308906 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf339f87-1057-41b3-bd6c-fbac09fbbb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:41.309591 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf339f87-1057-41b3-bd6c-fbac09fbbb3e None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:41.309924 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf339f87-1057-41b3-bd6c-fbac09fbbb3e None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:41.310203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf339f87-1057-41b3-bd6c-fbac09fbbb3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:41.311045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf339f87-1057-41b3-bd6c-fbac09fbbb3e None admin] RBAC: Adding query filter params (group.id=ba87514ee0064059aca980dd9bef9f85, role.id=abdc0e0957534149b3653eaa33cbd054, scope.project.id=a90cb52bb0ee4522ac438c1991f3a531) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:41.311362 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf339f87-1057-41b3-bd6c-fbac09fbbb3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:41.312864 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf339f87-1057-41b3-bd6c-fbac09fbbb3e None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:41.326028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 184/380] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jun 23 15:37:41 2022] GET /identity/v3/role_assignments?group.id=ba87514ee0064059aca980dd9bef9f85&scope.project.id=a90cb52bb0ee4522ac438c1991f3a531&role.id=abdc0e0957534149b3653eaa33cbd054 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:41.469888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfaa49-4b20-4df2-9b86-2359b05348f2 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:41.470233 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfaa49-4b20-4df2-9b86-2359b05348f2 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:41.470459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfaa49-4b20-4df2-9b86-2359b05348f2 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:41.472062 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 197/381] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:41.478096 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023066d2-cc5f-45e1-852a-05dab08de566 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:41.478414 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023066d2-cc5f-45e1-852a-05dab08de566 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:41.478664 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023066d2-cc5f-45e1-852a-05dab08de566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:41.498759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-023066d2-cc5f-45e1-852a-05dab08de566 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:41.500335 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-023066d2-cc5f-45e1-852a-05dab08de566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:41.587806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 185/382] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:41.610776 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfaa49-4b20-4df2-9b86-2359b05348f2 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:41.741883 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfaa49-4b20-4df2-9b86-2359b05348f2 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:41.759002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:41.791038 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5eca8a-d329-4147-92bd-19629387ee5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:41.791854 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5eca8a-d329-4147-92bd-19629387ee5f None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:41.792139 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5eca8a-d329-4147-92bd-19629387ee5f None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:41.792419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5eca8a-d329-4147-92bd-19629387ee5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:41.810581 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5eca8a-d329-4147-92bd-19629387ee5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:41.818881 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-fa5eca8a-d329-4147-92bd-19629387ee5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:41.818881 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:41.818881 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:41.818881 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:41.818881 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:41.818881 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:41.818881 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:41.818881 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:41.818881 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:41.818881 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:41.818881 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:41.818881 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:41.818881 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:41.818881 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:41.818881 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:41.818881 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:41.819853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:41.819853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:41.819853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:41.819853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:41.819853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:41.819853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:41.819853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:41.819853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:41.819853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:41.819853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:41.819853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:41.819853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:41.819853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:41.819853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:41.819853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:41.819853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:41.820692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:41.820692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:41.820692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:41.820692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:41.820692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:41.820692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:41.820692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:41.820692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:41.820692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:41.820692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:41.820692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:41.820692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:41.820692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 198/383] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 23 15:37:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:41.827729 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023066d2-cc5f-45e1-852a-05dab08de566 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:41.861767 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:41.950343 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023066d2-cc5f-45e1-852a-05dab08de566 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:41.995511 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b4496-9701-4be2-98f5-f4656b0d8c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:41.996176 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b4496-9701-4be2-98f5-f4656b0d8c0d None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:41.996457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b4496-9701-4be2-98f5-f4656b0d8c0d None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:41.996780 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b4496-9701-4be2-98f5-f4656b0d8c0d None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:41.997623 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b4496-9701-4be2-98f5-f4656b0d8c0d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:41.997960 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b4496-9701-4be2-98f5-f4656b0d8c0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:41.999397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b4496-9701-4be2-98f5-f4656b0d8c0d None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:42.014892 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 186/384] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:37:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:42.020389 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5eca8a-d329-4147-92bd-19629387ee5f None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:42.152897 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5eca8a-d329-4147-92bd-19629387ee5f None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:42.163912 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9d800-5c04-4b09-9855-e34c8678338e None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:42.164527 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9d800-5c04-4b09-9855-e34c8678338e None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:42.165048 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9d800-5c04-4b09-9855-e34c8678338e None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:42.171701 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 187/385] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:37:42.173791 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c29fd7-23ed-4875-a29c-e46ed8b99b83 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:42.174358 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c29fd7-23ed-4875-a29c-e46ed8b99b83 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:42.174834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c29fd7-23ed-4875-a29c-e46ed8b99b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:42.192460 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-99c29fd7-23ed-4875-a29c-e46ed8b99b83 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:42.194076 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-99c29fd7-23ed-4875-a29c-e46ed8b99b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:42.207764 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd859a1f-f1d2-477e-8237-7a938012c10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:42.208646 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd859a1f-f1d2-477e-8237-7a938012c10c None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:42.208940 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd859a1f-f1d2-477e-8237-7a938012c10c None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:42.209223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd859a1f-f1d2-477e-8237-7a938012c10c None admin] PATH_INFO: `/v3/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:42.211950 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd859a1f-f1d2-477e-8237-7a938012c10c None admin] RBAC: Authorizing `identity:get_group(group_id=3f3819abcac24ae3b0ccdd1d8c2a7fc2)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:42.213451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd859a1f-f1d2-477e-8237-7a938012c10c None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:42.215510 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 199/386] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 23 15:37:42 2022] GET /identity/v3/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:42.221258 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd859a1f-f1d2-477e-8237-7a938012c10c None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:42.284510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 188/387] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 15:37:42.307347 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c29fd7-23ed-4875-a29c-e46ed8b99b83 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:42.332304 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:42.358253 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:42.415156 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd859a1f-f1d2-477e-8237-7a938012c10c None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:42.465202 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c29fd7-23ed-4875-a29c-e46ed8b99b83 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:42.491551 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd5c2d-195f-4d20-95e2-bea533fbcb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:42.492433 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd5c2d-195f-4d20-95e2-bea533fbcb48 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:42.492723 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd5c2d-195f-4d20-95e2-bea533fbcb48 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:42.493008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd5c2d-195f-4d20-95e2-bea533fbcb48 None admin] PATH_INFO: `/v3/projects/16957e4778784bc187de225af6d1e1db` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:42.498692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd5c2d-195f-4d20-95e2-bea533fbcb48 None admin] RBAC: Authorizing `identity:get_project(project_id=16957e4778784bc187de225af6d1e1db)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:42.500159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd5c2d-195f-4d20-95e2-bea533fbcb48 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:42.501973 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 200/388] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:42 2022] GET /identity/v3/projects/16957e4778784bc187de225af6d1e1db => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:42.507837 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6623ff-f804-42d2-a119-02ebbad9a59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:42.508213 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd5c2d-195f-4d20-95e2-bea533fbcb48 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:42.508794 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6623ff-f804-42d2-a119-02ebbad9a59b None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:42.509144 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6623ff-f804-42d2-a119-02ebbad9a59b None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:42.509511 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6623ff-f804-42d2-a119-02ebbad9a59b None admin] PATH_INFO: `/v3/roles/member` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:42.521436 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6623ff-f804-42d2-a119-02ebbad9a59b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:42.529554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-5e6623ff-f804-42d2-a119-02ebbad9a59b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:42.529554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:42.529554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:42.529554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:42.529554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:42.529554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:42.529554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:42.529554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:42.529554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:42.529554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:42.529554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:42.529554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:42.529554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:42.529554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:42.529554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:42.529554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:42.531263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:42.531263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:42.531263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:42.531263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:42.531263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:42.531263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:42.531263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:42.531263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:42.531263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:42.531263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:42.531263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:42.531263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:42.531263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:42.531263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:42.531263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:42.531263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:42.532601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:42.532601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:42.532601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:42.532601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:42.532601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:42.532601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:42.532601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:42.532601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:42.532601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:42.532601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:42.532601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:42.532601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:42.534670 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 189/389] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:42.543412 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6623ff-f804-42d2-a119-02ebbad9a59b None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:42.638471 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:42.654858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6623ff-f804-42d2-a119-02ebbad9a59b None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:42.692127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492c422-65d4-47a5-b63c-8c7541672453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:42.693046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492c422-65d4-47a5-b63c-8c7541672453 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:42.693567 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492c422-65d4-47a5-b63c-8c7541672453 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:42.694043 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492c422-65d4-47a5-b63c-8c7541672453 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:42.695315 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492c422-65d4-47a5-b63c-8c7541672453 None admin] RBAC: Adding query filter params (name=member) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:42.695759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492c422-65d4-47a5-b63c-8c7541672453 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:42.698064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8492c422-65d4-47a5-b63c-8c7541672453 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:42.707623 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 190/390] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:37:42.714166 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492c422-65d4-47a5-b63c-8c7541672453 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:42.732924 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd5c2d-195f-4d20-95e2-bea533fbcb48 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:42.754265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:42.813914 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca9f71-3366-48f8-9d4d-2eff962e843c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:42.814727 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca9f71-3366-48f8-9d4d-2eff962e843c None admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:42.815021 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca9f71-3366-48f8-9d4d-2eff962e843c None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:42.815303 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca9f71-3366-48f8-9d4d-2eff962e843c None admin] PATH_INFO: `/v3/projects/16957e4778784bc187de225af6d1e1db/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2/roles/12fa8f67cf514b1e916afc130f0e6008` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:42.820368 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca9f71-3366-48f8-9d4d-2eff962e843c None admin] RBAC: Authorizing `identity:create_grant(project_id=16957e4778784bc187de225af6d1e1db, group_id=3f3819abcac24ae3b0ccdd1d8c2a7fc2, role_id=12fa8f67cf514b1e916afc130f0e6008)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:42.821839 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca9f71-3366-48f8-9d4d-2eff962e843c None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:42.852729 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 201/391] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Jun 23 15:37:42 2022] PUT /identity/v3/projects/16957e4778784bc187de225af6d1e1db/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2/roles/12fa8f67cf514b1e916afc130f0e6008 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:37:42.886701 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492c422-65d4-47a5-b63c-8c7541672453 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:42.935808 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bba27-8107-4609-8d2c-83ccc808ab0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:42.936729 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bba27-8107-4609-8d2c-83ccc808ab0f None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:42.937167 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bba27-8107-4609-8d2c-83ccc808ab0f None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:42.937605 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bba27-8107-4609-8d2c-83ccc808ab0f None admin] PATH_INFO: `/v3/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:42.939680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bba27-8107-4609-8d2c-83ccc808ab0f None admin] RBAC: Authorizing `identity:get_group(group_id=3f3819abcac24ae3b0ccdd1d8c2a7fc2)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:42.941307 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bba27-8107-4609-8d2c-83ccc808ab0f None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:42.946607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 191/392] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 23 15:37:42 2022] GET /identity/v3/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:42.949979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca9f71-3366-48f8-9d4d-2eff962e843c None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:43.095386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca9f71-3366-48f8-9d4d-2eff962e843c None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:43.147589 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05403658-774b-4e56-b626-d3cfa0f6c348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:43.148472 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05403658-774b-4e56-b626-d3cfa0f6c348 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:43.148757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05403658-774b-4e56-b626-d3cfa0f6c348 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:43.149090 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05403658-774b-4e56-b626-d3cfa0f6c348 None admin] PATH_INFO: `/v3/projects/16957e4778784bc187de225af6d1e1db` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:43.150270 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05403658-774b-4e56-b626-d3cfa0f6c348 None admin] RBAC: Authorizing `identity:get_project(project_id=16957e4778784bc187de225af6d1e1db)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:43.151725 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05403658-774b-4e56-b626-d3cfa0f6c348 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:43.153511 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 202/393] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:42 2022] GET /identity/v3/projects/16957e4778784bc187de225af6d1e1db => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:43.160682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bba27-8107-4609-8d2c-83ccc808ab0f None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:43.174207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:43.283372 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bba27-8107-4609-8d2c-83ccc808ab0f None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:43.319046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60809ceb-ee88-4311-9125-7c022a1549dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:43.320000 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60809ceb-ee88-4311-9125-7c022a1549dd None admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:43.320283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60809ceb-ee88-4311-9125-7c022a1549dd None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:43.320554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60809ceb-ee88-4311-9125-7c022a1549dd None admin] PATH_INFO: `/v3/projects/16957e4778784bc187de225af6d1e1db/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:43.322721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60809ceb-ee88-4311-9125-7c022a1549dd None admin] RBAC: Authorizing `identity:create_grant(project_id=16957e4778784bc187de225af6d1e1db, group_id=3f3819abcac24ae3b0ccdd1d8c2a7fc2, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:43.324160 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60809ceb-ee88-4311-9125-7c022a1549dd None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:43.344606 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 192/394] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Jun 23 15:37:43 2022] PUT /identity/v3/projects/16957e4778784bc187de225af6d1e1db/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:37:43.390068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5b579-255e-44ec-8244-97d531ebc8ac None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:43.390068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5b579-255e-44ec-8244-97d531ebc8ac None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:43.390068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5b579-255e-44ec-8244-97d531ebc8ac None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:43.391045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 203/395] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:43.396986 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ed4b6-1105-4810-b891-582255088df2 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:43.397265 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ed4b6-1105-4810-b891-582255088df2 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:43.397546 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ed4b6-1105-4810-b891-582255088df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:43.423296 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-dd0ed4b6-1105-4810-b891-582255088df2 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:43.424526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-dd0ed4b6-1105-4810-b891-582255088df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:43.522260 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:43.529470 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 193/396] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:43.566178 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5b579-255e-44ec-8244-97d531ebc8ac None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:43.643752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:43.732689 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5b579-255e-44ec-8244-97d531ebc8ac None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:43.786995 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2a435-4d80-4aaa-9d98-53a9574cc697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:43.787806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2a435-4d80-4aaa-9d98-53a9574cc697 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:43.788092 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2a435-4d80-4aaa-9d98-53a9574cc697 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:43.788369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2a435-4d80-4aaa-9d98-53a9574cc697 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:43.800238 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2a435-4d80-4aaa-9d98-53a9574cc697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:43.808069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-21b2a435-4d80-4aaa-9d98-53a9574cc697 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:43.808069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:43.808069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:43.808069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:43.808069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:43.808069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:43.808069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:43.808069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:43.808069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:43.808069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:43.808069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:43.808069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:43.808069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:43.808069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:43.808069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:43.808069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:43.808984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:43.808984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:43.808984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:43.808984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:43.808984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:43.808984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:43.808984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:43.808984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:43.808984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:43.808984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:43.808984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:43.808984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:43.808984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:43.808984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:43.808984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:43.808984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:43.809900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:43.809900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:43.809900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:43.809900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:43.809900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:43.809900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:43.809900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:43.809900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:43.809900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:43.809900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:43.809900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:43.809900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:43.811106 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 204/397] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:43.815695 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ed4b6-1105-4810-b891-582255088df2 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:43.985667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ed4b6-1105-4810-b891-582255088df2 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:44.026736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7eb1b-cd03-4c8c-9295-a790ab52d9f9 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:44.027256 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7eb1b-cd03-4c8c-9295-a790ab52d9f9 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:44.027329 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7eb1b-cd03-4c8c-9295-a790ab52d9f9 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:44.029614 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 205/398] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:44.035300 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86f057-065e-4871-af82-a61ad3a38fca None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:44.035585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86f057-065e-4871-af82-a61ad3a38fca None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:44.035868 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86f057-065e-4871-af82-a61ad3a38fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:44.038622 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd1e58-4436-4c6b-97ed-e445d48cb261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:44.039548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd1e58-4436-4c6b-97ed-e445d48cb261 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:44.040029 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd1e58-4436-4c6b-97ed-e445d48cb261 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:44.040520 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd1e58-4436-4c6b-97ed-e445d48cb261 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:44.041483 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd1e58-4436-4c6b-97ed-e445d48cb261 None admin] RBAC: Adding query filter params (name=member) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:44.042029 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd1e58-4436-4c6b-97ed-e445d48cb261 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:44.043809 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd1e58-4436-4c6b-97ed-e445d48cb261 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:44.054302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 194/399] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:44.061964 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd1e58-4436-4c6b-97ed-e445d48cb261 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:44.070406 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-bc86f057-065e-4871-af82-a61ad3a38fca None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:44.071650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-bc86f057-065e-4871-af82-a61ad3a38fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:44.187706 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 206/400] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:44.210266 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:44.230363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e01bd1-9433-4257-97a1-9128f389d2d5 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:44.230702 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e01bd1-9433-4257-97a1-9128f389d2d5 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:44.230931 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e01bd1-9433-4257-97a1-9128f389d2d5 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:44.232912 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 207/401] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:37:44.238411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7113d-fd94-4b50-92b2-d4571c6b9473 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:44.238661 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7113d-fd94-4b50-92b2-d4571c6b9473 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:44.238893 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7113d-fd94-4b50-92b2-d4571c6b9473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:44.256649 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd1e58-4436-4c6b-97ed-e445d48cb261 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:44.264118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-99d7113d-fd94-4b50-92b2-d4571c6b9473 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:44.265425 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-99d7113d-fd94-4b50-92b2-d4571c6b9473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:44.290414 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:44.301431 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102d7af-6ca4-42d6-a3b1-e8ddd05bafe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:44.303320 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102d7af-6ca4-42d6-a3b1-e8ddd05bafe0 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:44.304082 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102d7af-6ca4-42d6-a3b1-e8ddd05bafe0 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:44.304581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102d7af-6ca4-42d6-a3b1-e8ddd05bafe0 None admin] PATH_INFO: `/v3/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:44.306139 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102d7af-6ca4-42d6-a3b1-e8ddd05bafe0 None admin] RBAC: Authorizing `identity:get_group(group_id=3f3819abcac24ae3b0ccdd1d8c2a7fc2)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:44.308106 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102d7af-6ca4-42d6-a3b1-e8ddd05bafe0 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:44.311326 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 195/402] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 23 15:37:44 2022] GET /identity/v3/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2 => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:44.317381 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102d7af-6ca4-42d6-a3b1-e8ddd05bafe0 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:44.351196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 208/403] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:44.352589 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7113d-fd94-4b50-92b2-d4571c6b9473 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:44.479988 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102d7af-6ca4-42d6-a3b1-e8ddd05bafe0 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:44.504402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7113d-fd94-4b50-92b2-d4571c6b9473 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:44.510572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:44.517624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55657580-0dcb-4edb-83e1-4a1c94e34931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:44.518803 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55657580-0dcb-4edb-83e1-4a1c94e34931 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:44.519299 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55657580-0dcb-4edb-83e1-4a1c94e34931 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:44.519761 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55657580-0dcb-4edb-83e1-4a1c94e34931 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:44.531916 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55657580-0dcb-4edb-83e1-4a1c94e34931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:44.540674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-55657580-0dcb-4edb-83e1-4a1c94e34931 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:44.540674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:44.540674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:44.540674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:44.540674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:44.540674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:44.540674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:44.540674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:44.540674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:44.540674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:44.540674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:44.540674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:44.540674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:44.540674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:44.540674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:44.540674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:44.541639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:44.541639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:44.541639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:44.541639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:44.541639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:44.541639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:44.541639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:44.541639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:44.541639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:44.541639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:44.541639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:44.541639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:44.541639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:44.541639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:44.541639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:44.541639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:44.542861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:44.542861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:44.542861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:44.542861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:44.542861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:44.542861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:44.542861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:44.542861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:44.542861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:44.542861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:44.542861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:44.542861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:44.542861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 196/404] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 23 15:37:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:44.543494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55657580-0dcb-4edb-83e1-4a1c94e34931 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:44.556190 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f61db-4f9f-4a8b-b785-888ccca68f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:44.556190 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f61db-4f9f-4a8b-b785-888ccca68f6d None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:44.556190 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f61db-4f9f-4a8b-b785-888ccca68f6d None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:44.556190 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f61db-4f9f-4a8b-b785-888ccca68f6d None admin] PATH_INFO: `/v3/projects/89a6206a5b7347f989194e2334051714` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:44.556943 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f61db-4f9f-4a8b-b785-888ccca68f6d None admin] RBAC: Authorizing `identity:get_project(project_id=89a6206a5b7347f989194e2334051714)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:44.556943 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f61db-4f9f-4a8b-b785-888ccca68f6d None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:44.559514 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 209/405] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:44 2022] GET /identity/v3/projects/89a6206a5b7347f989194e2334051714 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:44.562087 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f61db-4f9f-4a8b-b785-888ccca68f6d None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:44.597809 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:44.689376 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55657580-0dcb-4edb-83e1-4a1c94e34931 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:44.710095 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f61db-4f9f-4a8b-b785-888ccca68f6d None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:44.737123 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eee425-9bfd-48b1-93e6-64fa3b8d56ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:44.738324 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eee425-9bfd-48b1-93e6-64fa3b8d56ca None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:44.738615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eee425-9bfd-48b1-93e6-64fa3b8d56ca None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:44.738893 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eee425-9bfd-48b1-93e6-64fa3b8d56ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:44.752682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eee425-9bfd-48b1-93e6-64fa3b8d56ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:44.762470 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-39eee425-9bfd-48b1-93e6-64fa3b8d56ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:37:44.762470 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:44.762470 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:44.762470 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:44.762470 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:44.762470 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:44.762470 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:44.762470 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:44.762470 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:44.762470 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:44.762470 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:44.762470 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:44.762470 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:44.762470 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:44.762470 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:44.762470 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:44.763994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:44.763994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:44.763994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:44.763994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:44.763994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:44.763994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:44.763994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:44.763994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:44.763994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:44.763994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:44.763994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:44.763994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:44.763994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:44.763994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:44.763994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:44.763994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:44.764785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:44.764785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:44.764785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:44.764785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:44.764785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:44.764785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:44.764785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:44.764785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:44.764785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:44.764785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:44.764785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:37:44.764785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:44.764785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 197/406] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:37:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:44.766005 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6a6c5-9403-4714-80de-9aca493a7780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:44.766989 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6a6c5-9403-4714-80de-9aca493a7780 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:44.767470 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6a6c5-9403-4714-80de-9aca493a7780 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:44.767940 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6a6c5-9403-4714-80de-9aca493a7780 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:44.769051 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6a6c5-9403-4714-80de-9aca493a7780 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:44.769572 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6a6c5-9403-4714-80de-9aca493a7780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:44.769995 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eee425-9bfd-48b1-93e6-64fa3b8d56ca None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:44.771419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6a6c5-9403-4714-80de-9aca493a7780 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:44.782401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 210/407] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:37:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:44.787891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6a6c5-9403-4714-80de-9aca493a7780 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:44.833844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:44.906469 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:44.909924 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eee425-9bfd-48b1-93e6-64fa3b8d56ca None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:44.926175 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6a6c5-9403-4714-80de-9aca493a7780 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:44.955028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42f673-31d1-422d-825d-a376f4b7b09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:44.961445 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42f673-31d1-422d-825d-a376f4b7b09f None admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:44.961445 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42f673-31d1-422d-825d-a376f4b7b09f None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:44.961445 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d42f673-31d1-422d-825d-a376f4b7b09f None admin] PATH_INFO: `/v3/projects/89a6206a5b7347f989194e2334051714/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:44.963720 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42f673-31d1-422d-825d-a376f4b7b09f None admin] RBAC: Authorizing `identity:create_grant(project_id=89a6206a5b7347f989194e2334051714, group_id=3f3819abcac24ae3b0ccdd1d8c2a7fc2, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:44.965631 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d42f673-31d1-422d-825d-a376f4b7b09f None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:44.982516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28f02b-1ccd-4f7f-b241-680a67c99c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:44.983473 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28f02b-1ccd-4f7f-b241-680a67c99c9c None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:44.983906 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28f02b-1ccd-4f7f-b241-680a67c99c9c None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:44.984331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28f02b-1ccd-4f7f-b241-680a67c99c9c None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:44.989515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 198/408] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Jun 23 15:37:44 2022] PUT /identity/v3/projects/89a6206a5b7347f989194e2334051714/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:37:44.989515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42f673-31d1-422d-825d-a376f4b7b09f None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:44.990761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28f02b-1ccd-4f7f-b241-680a67c99c9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:44.991275 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28f02b-1ccd-4f7f-b241-680a67c99c9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:44.993838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28f02b-1ccd-4f7f-b241-680a67c99c9c None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:45.024873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 211/409] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:45.029561 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28f02b-1ccd-4f7f-b241-680a67c99c9c None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:45.210476 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d42f673-31d1-422d-825d-a376f4b7b09f None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:45.227744 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:45.250784 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28f02b-1ccd-4f7f-b241-680a67c99c9c None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:45.266153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06bba8-cc46-4270-a1fe-c78b5abc8a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:45.267041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06bba8-cc46-4270-a1fe-c78b5abc8a07 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:45.268860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06bba8-cc46-4270-a1fe-c78b5abc8a07 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:45.268860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06bba8-cc46-4270-a1fe-c78b5abc8a07 None admin] PATH_INFO: `/v3/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:45.271313 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06bba8-cc46-4270-a1fe-c78b5abc8a07 None admin] RBAC: Authorizing `identity:get_group(group_id=3f3819abcac24ae3b0ccdd1d8c2a7fc2)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:45.272976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06bba8-cc46-4270-a1fe-c78b5abc8a07 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:45.275092 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 199/410] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 23 15:37:44 2022] GET /identity/v3/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2 => generated 226 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:45.280711 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06bba8-cc46-4270-a1fe-c78b5abc8a07 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:45.320651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13a385-9763-4311-b063-5b094a8ead54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:45.321898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13a385-9763-4311-b063-5b094a8ead54 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:45.322400 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13a385-9763-4311-b063-5b094a8ead54 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:45.322888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13a385-9763-4311-b063-5b094a8ead54 None admin] PATH_INFO: `/v3/groups/ba87514ee0064059aca980dd9bef9f85` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:45.324354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13a385-9763-4311-b063-5b094a8ead54 None admin] RBAC: Authorizing `identity:get_group(group_id=ba87514ee0064059aca980dd9bef9f85)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:45.326167 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13a385-9763-4311-b063-5b094a8ead54 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:45.328366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 212/411] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 23 15:37:45 2022] GET /identity/v3/groups/ba87514ee0064059aca980dd9bef9f85 => generated 229 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:37:45.339546 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13a385-9763-4311-b063-5b094a8ead54 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:45.379410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:45.403861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06bba8-cc46-4270-a1fe-c78b5abc8a07 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:45.451999 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf63c9-0daf-4e0a-83ea-96b5a3c50c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:45.453021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf63c9-0daf-4e0a-83ea-96b5a3c50c40 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:45.453307 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf63c9-0daf-4e0a-83ea-96b5a3c50c40 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:45.453581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf63c9-0daf-4e0a-83ea-96b5a3c50c40 None admin] PATH_INFO: `/v3/projects/89a6206a5b7347f989194e2334051714` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:45.458651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf63c9-0daf-4e0a-83ea-96b5a3c50c40 None admin] RBAC: Authorizing `identity:get_project(project_id=89a6206a5b7347f989194e2334051714)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:45.460291 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf63c9-0daf-4e0a-83ea-96b5a3c50c40 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:45.462120 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 200/412] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:45 2022] GET /identity/v3/projects/89a6206a5b7347f989194e2334051714 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:37:45.473996 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf63c9-0daf-4e0a-83ea-96b5a3c50c40 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:45.518669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:45.526294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13a385-9763-4311-b063-5b094a8ead54 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:45.589345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf63c9-0daf-4e0a-83ea-96b5a3c50c40 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:45.599659 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64e967-ad85-4b00-af45-a04d55cbbcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:45.600673 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64e967-ad85-4b00-af45-a04d55cbbcd7 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:45.601094 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64e967-ad85-4b00-af45-a04d55cbbcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:45.601361 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64e967-ad85-4b00-af45-a04d55cbbcd7 None admin] PATH_INFO: `/v3/projects/a90cb52bb0ee4522ac438c1991f3a531` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:45.603438 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64e967-ad85-4b00-af45-a04d55cbbcd7 None admin] RBAC: Authorizing `identity:get_project(project_id=a90cb52bb0ee4522ac438c1991f3a531)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:45.604950 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64e967-ad85-4b00-af45-a04d55cbbcd7 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:45.607779 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 213/413] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:45 2022] GET /identity/v3/projects/a90cb52bb0ee4522ac438c1991f3a531 => generated 344 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:45.613598 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64e967-ad85-4b00-af45-a04d55cbbcd7 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:45.643544 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df37b43-2359-4561-98a6-37c05b77c511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:45.645438 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df37b43-2359-4561-98a6-37c05b77c511 None admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:45.646260 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df37b43-2359-4561-98a6-37c05b77c511 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:45.646872 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df37b43-2359-4561-98a6-37c05b77c511 None admin] PATH_INFO: `/v3/projects/89a6206a5b7347f989194e2334051714/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2/roles/12fa8f67cf514b1e916afc130f0e6008` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:45.650554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df37b43-2359-4561-98a6-37c05b77c511 None admin] RBAC: Authorizing `identity:create_grant(project_id=89a6206a5b7347f989194e2334051714, group_id=3f3819abcac24ae3b0ccdd1d8c2a7fc2, role_id=12fa8f67cf514b1e916afc130f0e6008)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:45.652246 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df37b43-2359-4561-98a6-37c05b77c511 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:45.668563 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 201/414] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Jun 23 15:37:45 2022] PUT /identity/v3/projects/89a6206a5b7347f989194e2334051714/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2/roles/12fa8f67cf514b1e916afc130f0e6008 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:37:45.769528 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:45.792899 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64e967-ad85-4b00-af45-a04d55cbbcd7 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:45.823028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769c883-f7a1-4bcb-8f88-18c09f6a7348 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:45.823379 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769c883-f7a1-4bcb-8f88-18c09f6a7348 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:45.823633 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769c883-f7a1-4bcb-8f88-18c09f6a7348 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:45.826262 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 202/415] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:45.830757 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee558377-5870-4dad-bdf7-38e49e097911 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:45.831046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee558377-5870-4dad-bdf7-38e49e097911 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:45.831321 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee558377-5870-4dad-bdf7-38e49e097911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:45.844941 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c20fd8-b69d-4bc9-8e97-21c67264ca6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:45.846010 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c20fd8-b69d-4bc9-8e97-21c67264ca6c None admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:45.846301 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c20fd8-b69d-4bc9-8e97-21c67264ca6c None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:45.846583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c20fd8-b69d-4bc9-8e97-21c67264ca6c None admin] PATH_INFO: `/v3/projects/a90cb52bb0ee4522ac438c1991f3a531/groups/ba87514ee0064059aca980dd9bef9f85/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:45.849534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c20fd8-b69d-4bc9-8e97-21c67264ca6c None admin] RBAC: Authorizing `identity:create_grant(project_id=a90cb52bb0ee4522ac438c1991f3a531, group_id=ba87514ee0064059aca980dd9bef9f85, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:45.851045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c20fd8-b69d-4bc9-8e97-21c67264ca6c None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:45.864630 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-ee558377-5870-4dad-bdf7-38e49e097911 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:45.865516 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-ee558377-5870-4dad-bdf7-38e49e097911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:45.875546 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 214/416] 10.222.0.15 () {58 vars in 1442 bytes} [Thu Jun 23 15:37:45 2022] PUT /identity/v3/projects/a90cb52bb0ee4522ac438c1991f3a531/groups/ba87514ee0064059aca980dd9bef9f85/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:37:45.885319 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3534a4-557e-4b44-bf7d-94912a15ff93 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:45.885632 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3534a4-557e-4b44-bf7d-94912a15ff93 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:45.885993 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3534a4-557e-4b44-bf7d-94912a15ff93 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:45.887416 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 215/417] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:37:45.893689 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6c3b6-56f1-4156-8988-1d0c8fc24bdd None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:45.894062 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6c3b6-56f1-4156-8988-1d0c8fc24bdd None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:45.894320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6c3b6-56f1-4156-8988-1d0c8fc24bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:45.914717 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-27c6c3b6-56f1-4156-8988-1d0c8fc24bdd None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:45.916292 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-27c6c3b6-56f1-4156-8988-1d0c8fc24bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:45.976048 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 203/418] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 23 15:37:45.996211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee558377-5870-4dad-bdf7-38e49e097911 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:46.054050 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 216/419] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 15:37:46.079470 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:46.080676 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6c3b6-56f1-4156-8988-1d0c8fc24bdd None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:46.166043 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee558377-5870-4dad-bdf7-38e49e097911 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:46.169085 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:46.197253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6c3b6-56f1-4156-8988-1d0c8fc24bdd None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:46.214862 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02877be-165a-49a9-8032-4568674cc3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:46.217092 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02877be-165a-49a9-8032-4568674cc3d4 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:46.217813 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02877be-165a-49a9-8032-4568674cc3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:46.218553 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02877be-165a-49a9-8032-4568674cc3d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:46.233304 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02877be-165a-49a9-8032-4568674cc3d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:46.243860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-a02877be-165a-49a9-8032-4568674cc3d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:46.243860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:46.243860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:46.243860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:46.243860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:46.243860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:46.243860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:46.243860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:46.243860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:46.243860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:46.243860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:46.243860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:46.243860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:46.243860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:46.243860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:46.243860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:46.244800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:46.244800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:46.244800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:46.244800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:46.244800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:46.244800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:46.244800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:46.244800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:46.244800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:46.244800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:46.244800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:46.244800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:46.244800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:46.244800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:46.244800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:46.244800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:46.245596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:46.245596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:46.245596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:46.245596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:46.245596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:46.245596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:46.245596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:46.245596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:46.245596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:46.245596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:46.245596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:46.245596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:46.248499 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 204/420] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 23 15:37:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:37:46.257574 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02877be-165a-49a9-8032-4568674cc3d4 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:46.261755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbddfe0-4b88-4a51-a2f5-cc188b627e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:46.262622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbddfe0-4b88-4a51-a2f5-cc188b627e9f None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:46.263449 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbddfe0-4b88-4a51-a2f5-cc188b627e9f None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:46.263729 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbddfe0-4b88-4a51-a2f5-cc188b627e9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:46.286614 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbddfe0-4b88-4a51-a2f5-cc188b627e9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:46.295757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-1fbddfe0-4b88-4a51-a2f5-cc188b627e9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:46.295757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:46.295757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:46.295757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:46.295757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:46.295757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:46.295757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:46.295757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:46.295757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:46.295757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:46.295757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:46.295757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:46.295757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:46.295757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:46.295757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:46.295757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:46.296739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:46.296739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:46.296739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:46.296739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:46.296739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:46.296739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:46.296739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:46.296739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:46.296739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:46.296739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:46.296739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:46.296739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:46.296739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:46.296739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:46.296739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:46.296739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:46.297524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:46.297524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:46.297524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:46.297524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:46.297524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:46.297524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:46.297524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:46.297524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:46.297524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:46.297524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:46.297524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:46.297524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:46.302161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 217/421] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:46.308822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbddfe0-4b88-4a51-a2f5-cc188b627e9f None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:46.421682 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbddfe0-4b88-4a51-a2f5-cc188b627e9f None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:46.459108 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d0c40-a24d-4427-83d5-c9bde0b99b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:46.460274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d0c40-a24d-4427-83d5-c9bde0b99b8f None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:46.460573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d0c40-a24d-4427-83d5-c9bde0b99b8f None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:46.460860 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d0c40-a24d-4427-83d5-c9bde0b99b8f None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:46.461636 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d0c40-a24d-4427-83d5-c9bde0b99b8f None admin] RBAC: Adding query filter params (name=member) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:46.462057 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d0c40-a24d-4427-83d5-c9bde0b99b8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:46.463801 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d0c40-a24d-4427-83d5-c9bde0b99b8f None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:46.465643 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:46.470235 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:46.477347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 218/422] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:46.484094 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d0c40-a24d-4427-83d5-c9bde0b99b8f None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:46.487877 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02877be-165a-49a9-8032-4568674cc3d4 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:46.566805 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e4cb7-0665-43e4-8212-33f7c5d79ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:46.567410 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e4cb7-0665-43e4-8212-33f7c5d79ec7 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:46.567727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e4cb7-0665-43e4-8212-33f7c5d79ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:46.568075 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e4cb7-0665-43e4-8212-33f7c5d79ec7 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:46.568838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e4cb7-0665-43e4-8212-33f7c5d79ec7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:46.569145 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e4cb7-0665-43e4-8212-33f7c5d79ec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:46.570585 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e4cb7-0665-43e4-8212-33f7c5d79ec7 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:46.595506 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 205/423] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:37:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:46.607552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e4cb7-0665-43e4-8212-33f7c5d79ec7 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:46.611886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d0c40-a24d-4427-83d5-c9bde0b99b8f None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:46.651678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf4d28-38c4-497e-9707-0eeb790bc8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:46.652346 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf4d28-38c4-497e-9707-0eeb790bc8b2 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:46.652639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf4d28-38c4-497e-9707-0eeb790bc8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:46.652926 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf4d28-38c4-497e-9707-0eeb790bc8b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:46.780701 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e4cb7-0665-43e4-8212-33f7c5d79ec7 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:46.820298 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05485f0c-8e9e-43e5-9c26-db0f9c1cbca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:46.820889 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05485f0c-8e9e-43e5-9c26-db0f9c1cbca6 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:46.821182 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05485f0c-8e9e-43e5-9c26-db0f9c1cbca6 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:46.821468 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05485f0c-8e9e-43e5-9c26-db0f9c1cbca6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:46.846227 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:46.854048 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:46.864420 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf4d28-38c4-497e-9707-0eeb790bc8b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:46.866128 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf4d28-38c4-497e-9707-0eeb790bc8b2 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:46.905125 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05485f0c-8e9e-43e5-9c26-db0f9c1cbca6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:46.907330 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05485f0c-8e9e-43e5-9c26-db0f9c1cbca6 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:47.022329 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 219/424] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 15:37:47.028174 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf4d28-38c4-497e-9707-0eeb790bc8b2 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:47.093901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 206/425] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:37:47.099954 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05485f0c-8e9e-43e5-9c26-db0f9c1cbca6 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:47.173925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:47.223850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05485f0c-8e9e-43e5-9c26-db0f9c1cbca6 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:47.264920 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d914f2-119f-4d9d-9218-ad3a1fa76620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:47.265797 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d914f2-119f-4d9d-9218-ad3a1fa76620 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:47.266115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d914f2-119f-4d9d-9218-ad3a1fa76620 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:47.266397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d914f2-119f-4d9d-9218-ad3a1fa76620 None admin] PATH_INFO: `/v3/projects/16957e4778784bc187de225af6d1e1db` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:47.267618 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d914f2-119f-4d9d-9218-ad3a1fa76620 None admin] RBAC: Authorizing `identity:get_project(project_id=16957e4778784bc187de225af6d1e1db)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:47.269730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d914f2-119f-4d9d-9218-ad3a1fa76620 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:47.271926 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 207/426] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:47 2022] GET /identity/v3/projects/16957e4778784bc187de225af6d1e1db => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:47.277546 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d914f2-119f-4d9d-9218-ad3a1fa76620 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:47.318233 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:47.347938 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf4d28-38c4-497e-9707-0eeb790bc8b2 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:47.401244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d914f2-119f-4d9d-9218-ad3a1fa76620 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:47.432307 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:47.441316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fccad-63e0-4055-b526-a903a4333a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:47.442237 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fccad-63e0-4055-b526-a903a4333a58 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:47.442528 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fccad-63e0-4055-b526-a903a4333a58 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:47.442808 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fccad-63e0-4055-b526-a903a4333a58 None admin] PATH_INFO: `/v3/projects/16957e4778784bc187de225af6d1e1db` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:47.444012 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fccad-63e0-4055-b526-a903a4333a58 None admin] RBAC: Authorizing `identity:get_project(project_id=16957e4778784bc187de225af6d1e1db)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:47.444462 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b70df4-cf9a-4c5c-a000-f7c1e59c32a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:47.445327 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b70df4-cf9a-4c5c-a000-f7c1e59c32a4 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:47.445453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fccad-63e0-4055-b526-a903a4333a58 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:47.445609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b70df4-cf9a-4c5c-a000-f7c1e59c32a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:47.445916 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b70df4-cf9a-4c5c-a000-f7c1e59c32a4 None admin] PATH_INFO: `/v3/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:47.447123 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b70df4-cf9a-4c5c-a000-f7c1e59c32a4 None admin] RBAC: Authorizing `identity:get_group(group_id=3f3819abcac24ae3b0ccdd1d8c2a7fc2)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:47.447599 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 220/427] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:47 2022] GET /identity/v3/projects/16957e4778784bc187de225af6d1e1db => generated 298 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:47.448645 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b70df4-cf9a-4c5c-a000-f7c1e59c32a4 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:47.448882 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810e403-f25a-4ffe-9c93-a631668edb7c None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:47.449174 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810e403-f25a-4ffe-9c93-a631668edb7c None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:47.449459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810e403-f25a-4ffe-9c93-a631668edb7c None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:47.451191 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 208/428] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 23 15:37:47 2022] GET /identity/v3/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:47.455391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 221/429] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:47.456641 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b70df4-cf9a-4c5c-a000-f7c1e59c32a4 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:47.457223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b9895-c8dd-484c-9a2d-7dbc04c431d6 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:47.457615 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b9895-c8dd-484c-9a2d-7dbc04c431d6 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:47.458038 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b9895-c8dd-484c-9a2d-7dbc04c431d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:47.477629 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-522b9895-c8dd-484c-9a2d-7dbc04c431d6 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:47.479334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-522b9895-c8dd-484c-9a2d-7dbc04c431d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:47.589933 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 222/430] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:47.589933 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b9895-c8dd-484c-9a2d-7dbc04c431d6 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:47.619214 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b70df4-cf9a-4c5c-a000-f7c1e59c32a4 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:47.658101 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d228e4-6821-4708-802d-2695a12c089e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:47.658885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d228e4-6821-4708-802d-2695a12c089e None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:47.659171 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d228e4-6821-4708-802d-2695a12c089e None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:47.659456 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d228e4-6821-4708-802d-2695a12c089e None admin] PATH_INFO: `/v3/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:47.660782 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d228e4-6821-4708-802d-2695a12c089e None admin] RBAC: Authorizing `identity:get_group(group_id=3f3819abcac24ae3b0ccdd1d8c2a7fc2)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:47.662407 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d228e4-6821-4708-802d-2695a12c089e None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:47.664446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 209/431] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 23 15:37:47 2022] GET /identity/v3/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:47.665399 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d228e4-6821-4708-802d-2695a12c089e None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:47.718299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:47.731937 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b9895-c8dd-484c-9a2d-7dbc04c431d6 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:47.734334 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:47.774876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bdcaa6-5dc6-4622-9dab-0fb38e5a2e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:47.775419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d228e4-6821-4708-802d-2695a12c089e None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:47.776145 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdcaa6-5dc6-4622-9dab-0fb38e5a2e1b None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:47.776631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdcaa6-5dc6-4622-9dab-0fb38e5a2e1b None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:47.777192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdcaa6-5dc6-4622-9dab-0fb38e5a2e1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:47.779097 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bdcaa6-5dc6-4622-9dab-0fb38e5a2e1b None admin] RBAC: Adding query filter params (group.id=3f3819abcac24ae3b0ccdd1d8c2a7fc2, role.id=12fa8f67cf514b1e916afc130f0e6008, scope.project.id=16957e4778784bc187de225af6d1e1db) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:47.779628 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bdcaa6-5dc6-4622-9dab-0fb38e5a2e1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:47.781539 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bdcaa6-5dc6-4622-9dab-0fb38e5a2e1b None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:47.789083 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 223/432] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jun 23 15:37:47 2022] GET /identity/v3/role_assignments?group.id=3f3819abcac24ae3b0ccdd1d8c2a7fc2&scope.project.id=16957e4778784bc187de225af6d1e1db&role.id=12fa8f67cf514b1e916afc130f0e6008 => generated 611 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:47.790444 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bdcaa6-5dc6-4622-9dab-0fb38e5a2e1b None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:47.815013 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6d315-03c5-426a-974d-02bdb8c67c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:47.815933 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6d315-03c5-426a-974d-02bdb8c67c21 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:47.816145 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6d315-03c5-426a-974d-02bdb8c67c21 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:47.816378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6d315-03c5-426a-974d-02bdb8c67c21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:47.828335 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6d315-03c5-426a-974d-02bdb8c67c21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:47.836840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-e6c6d315-03c5-426a-974d-02bdb8c67c21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:47.836840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:47.836840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:47.836840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:47.836840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:47.836840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:47.836840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:47.836840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:47.836840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:47.836840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:47.836840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:47.836840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:47.836840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:47.836840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:47.836840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:47.836840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:47.837796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:47.837796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:47.837796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:47.837796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:47.837796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:47.837796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:47.837796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:47.837796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:47.837796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:47.837796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:47.837796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:47.837796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:47.837796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:47.837796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:47.837796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:47.837796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:47.838609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:47.838609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:47.838609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:47.838609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:47.838609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:47.838609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:47.838609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:47.838609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:47.838609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:47.838609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:47.838609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 15:37:47.838609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:47.838609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 210/433] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:47.850951 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6d315-03c5-426a-974d-02bdb8c67c21 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:47.926069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bdcaa6-5dc6-4622-9dab-0fb38e5a2e1b None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:47.972210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80de89-1a13-4ab4-92df-d9c7c369c96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:47.973289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80de89-1a13-4ab4-92df-d9c7c369c96e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:47.973777 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80de89-1a13-4ab4-92df-d9c7c369c96e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:47.974312 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80de89-1a13-4ab4-92df-d9c7c369c96e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:47.975648 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80de89-1a13-4ab4-92df-d9c7c369c96e None admin] RBAC: Adding query filter params (group.id=3f3819abcac24ae3b0ccdd1d8c2a7fc2, role.id=2362b672eb7b474dbd341608f3993123, scope.project.id=16957e4778784bc187de225af6d1e1db) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:47.975969 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80de89-1a13-4ab4-92df-d9c7c369c96e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:47.977476 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80de89-1a13-4ab4-92df-d9c7c369c96e None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:47.985063 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 224/434] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jun 23 15:37:47 2022] GET /identity/v3/role_assignments?group.id=3f3819abcac24ae3b0ccdd1d8c2a7fc2&scope.project.id=16957e4778784bc187de225af6d1e1db&role.id=2362b672eb7b474dbd341608f3993123 => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:48.037772 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6d315-03c5-426a-974d-02bdb8c67c21 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:48.066302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:48.080193 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d309bbe-2402-4e5e-9631-31ed0e571655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:48.080890 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d309bbe-2402-4e5e-9631-31ed0e571655 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:48.081178 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d309bbe-2402-4e5e-9631-31ed0e571655 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:48.081462 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d309bbe-2402-4e5e-9631-31ed0e571655 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:48.082276 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d309bbe-2402-4e5e-9631-31ed0e571655 None admin] RBAC: Adding query filter params (name=member) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:48.082594 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d309bbe-2402-4e5e-9631-31ed0e571655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:48.084016 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d309bbe-2402-4e5e-9631-31ed0e571655 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:48.095535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 211/435] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:37:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:48.101231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80de89-1a13-4ab4-92df-d9c7c369c96e None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:48.102665 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd43935-a01e-4970-962d-2523ff86c5eb None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:48.102959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd43935-a01e-4970-962d-2523ff86c5eb None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:48.103237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd43935-a01e-4970-962d-2523ff86c5eb None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:48.104742 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 212/436] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:48.114612 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942cf15-8b02-4c4f-ac49-d42068309522 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:48.114949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942cf15-8b02-4c4f-ac49-d42068309522 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:48.115173 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942cf15-8b02-4c4f-ac49-d42068309522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:48.138543 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-a942cf15-8b02-4c4f-ac49-d42068309522 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:48.140156 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-a942cf15-8b02-4c4f-ac49-d42068309522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:48.143455 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:48.254570 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80de89-1a13-4ab4-92df-d9c7c369c96e None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:48.256451 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 213/437] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:48.283721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942cf15-8b02-4c4f-ac49-d42068309522 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:48.304051 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fff4f8-8ae3-446e-9607-d89c116ed2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:48.304770 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fff4f8-8ae3-446e-9607-d89c116ed2d1 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:48.305962 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fff4f8-8ae3-446e-9607-d89c116ed2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:48.306279 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fff4f8-8ae3-446e-9607-d89c116ed2d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:48.410430 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942cf15-8b02-4c4f-ac49-d42068309522 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:48.413261 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fff4f8-8ae3-446e-9607-d89c116ed2d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:48.414766 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fff4f8-8ae3-446e-9607-d89c116ed2d1 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:48.433460 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:48.448532 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:48.459803 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6089a6b-1385-45c5-a7c6-af2a7b93e998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:48.459803 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6089a6b-1385-45c5-a7c6-af2a7b93e998 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:48.459803 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6089a6b-1385-45c5-a7c6-af2a7b93e998 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:48.460331 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6089a6b-1385-45c5-a7c6-af2a7b93e998 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:48.475769 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6089a6b-1385-45c5-a7c6-af2a7b93e998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:48.485477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-f6089a6b-1385-45c5-a7c6-af2a7b93e998 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:48.485477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:48.485477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:48.485477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:48.485477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:48.485477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:48.485477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:48.485477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:48.485477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:48.485477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:48.485477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:48.485477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:48.485477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:48.485477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:48.485477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:48.485477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:48.486423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:48.486423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:48.486423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:48.486423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:48.486423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:48.486423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:48.486423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:48.486423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:48.486423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:48.486423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:48.486423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:48.486423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:48.486423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:48.486423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:48.486423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:48.486423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:48.487212 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:48.487212 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:48.487212 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:48.487212 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:48.487212 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:48.487212 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:48.487212 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:48.487212 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:48.487212 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:48.487212 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:48.487212 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:48.487212 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:48.488464 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 214/438] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 23 15:37:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:48.493694 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6089a6b-1385-45c5-a7c6-af2a7b93e998 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:48.570637 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 225/439] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:37:48.583135 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fff4f8-8ae3-446e-9607-d89c116ed2d1 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:48.649344 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6089a6b-1385-45c5-a7c6-af2a7b93e998 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:48.708077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f8523-a628-4e47-93e2-623908fa80e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:48.708854 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f8523-a628-4e47-93e2-623908fa80e7 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:48.709080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f8523-a628-4e47-93e2-623908fa80e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:48.709367 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f8523-a628-4e47-93e2-623908fa80e7 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:48.710889 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f8523-a628-4e47-93e2-623908fa80e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:48.711937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f8523-a628-4e47-93e2-623908fa80e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:48.714911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f8523-a628-4e47-93e2-623908fa80e7 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:48.719527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fff4f8-8ae3-446e-9607-d89c116ed2d1 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:48.726265 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 215/440] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:37:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:48.727550 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6bf36-4aae-4527-8753-9d457f42f2d3 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:48.729154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6bf36-4aae-4527-8753-9d457f42f2d3 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:48.729154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6bf36-4aae-4527-8753-9d457f42f2d3 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:48.729840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 216/441] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:48.736664 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7990f7b-d801-48d3-b2ed-ab1c6efb5160 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:48.736958 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7990f7b-d801-48d3-b2ed-ab1c6efb5160 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:48.737225 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7990f7b-d801-48d3-b2ed-ab1c6efb5160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:48.754146 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:48.757447 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-a7990f7b-d801-48d3-b2ed-ab1c6efb5160 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:48.757447 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-a7990f7b-d801-48d3-b2ed-ab1c6efb5160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:48.770689 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc1527-086b-4d48-b7aa-13b861ebbbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:48.771557 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc1527-086b-4d48-b7aa-13b861ebbbbe None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:48.771979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc1527-086b-4d48-b7aa-13b861ebbbbe None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:48.772257 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc1527-086b-4d48-b7aa-13b861ebbbbe None admin] PATH_INFO: `/v3/projects/89a6206a5b7347f989194e2334051714` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:48.773584 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc1527-086b-4d48-b7aa-13b861ebbbbe None admin] RBAC: Authorizing `identity:get_project(project_id=89a6206a5b7347f989194e2334051714)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:48.775005 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc1527-086b-4d48-b7aa-13b861ebbbbe None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:48.776904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 226/442] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:48 2022] GET /identity/v3/projects/89a6206a5b7347f989194e2334051714 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:37:48.777551 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc1527-086b-4d48-b7aa-13b861ebbbbe None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:48.800549 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:48.841342 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 217/443] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:48.842115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7990f7b-d801-48d3-b2ed-ab1c6efb5160 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:48.891486 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc1527-086b-4d48-b7aa-13b861ebbbbe None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:48.928153 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5afc2-cc04-4907-b296-b07272d2d5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:48.928806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5afc2-cc04-4907-b296-b07272d2d5fc None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:48.929094 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5afc2-cc04-4907-b296-b07272d2d5fc None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:48.929375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5afc2-cc04-4907-b296-b07272d2d5fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:48.953176 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7990f7b-d801-48d3-b2ed-ab1c6efb5160 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:48.987807 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94710564-6707-477c-9617-8666f966edb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:48.988666 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94710564-6707-477c-9617-8666f966edb2 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:48.988947 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94710564-6707-477c-9617-8666f966edb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:48.989220 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94710564-6707-477c-9617-8666f966edb2 None admin] PATH_INFO: `/v3/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:48.989887 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:48.990429 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94710564-6707-477c-9617-8666f966edb2 None admin] RBAC: Authorizing `identity:get_group(group_id=3f3819abcac24ae3b0ccdd1d8c2a7fc2)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:48.991881 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94710564-6707-477c-9617-8666f966edb2 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:48.993523 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 218/444] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 23 15:37:48 2022] GET /identity/v3/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:48.993523 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94710564-6707-477c-9617-8666f966edb2 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:49.002990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5afc2-cc04-4907-b296-b07272d2d5fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:49.004442 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5afc2-cc04-4907-b296-b07272d2d5fc None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:49.033017 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:49.102737 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94710564-6707-477c-9617-8666f966edb2 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:49.118084 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 227/445] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:37:49.118961 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5afc2-cc04-4907-b296-b07272d2d5fc None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:49.142850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7a1d7-1453-4ad2-a1a9-fef17df3b1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:49.143653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7a1d7-1453-4ad2-a1a9-fef17df3b1e6 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:49.143934 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7a1d7-1453-4ad2-a1a9-fef17df3b1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:49.144212 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7a1d7-1453-4ad2-a1a9-fef17df3b1e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:49.155143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7a1d7-1453-4ad2-a1a9-fef17df3b1e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:49.163239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-f7d7a1d7-1453-4ad2-a1a9-fef17df3b1e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:37:49.163239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:49.163239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:49.163239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:49.163239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:49.163239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:49.163239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:49.163239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:49.163239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:49.163239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:49.163239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:49.163239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:49.163239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:49.163239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:49.163239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:49.163239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:49.164231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:49.164231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:49.164231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:49.164231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:49.164231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:49.164231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:49.164231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:49.164231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:49.164231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:49.164231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:49.164231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:49.164231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:49.164231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:49.164231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:49.164231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:49.164231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:49.165017 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:49.165017 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:49.165017 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:49.165017 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:49.165017 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:49.165017 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:49.165017 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:49.165017 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:49.165017 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:49.165017 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:49.165017 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:37:49.165017 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:49.165017 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 219/446] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:37:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:49.165699 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7a1d7-1453-4ad2-a1a9-fef17df3b1e6 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:49.217384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:49.227558 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5afc2-cc04-4907-b296-b07272d2d5fc None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:49.263170 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ebd6e-fe81-43eb-b6b3-d8da5ac81d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:49.263828 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ebd6e-fe81-43eb-b6b3-d8da5ac81d79 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:49.264112 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ebd6e-fe81-43eb-b6b3-d8da5ac81d79 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:49.264388 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ebd6e-fe81-43eb-b6b3-d8da5ac81d79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:49.265224 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ebd6e-fe81-43eb-b6b3-d8da5ac81d79 None admin] RBAC: Adding query filter params (group.id=3f3819abcac24ae3b0ccdd1d8c2a7fc2, role.id=2362b672eb7b474dbd341608f3993123, scope.project.id=89a6206a5b7347f989194e2334051714) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:49.265544 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ebd6e-fe81-43eb-b6b3-d8da5ac81d79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:49.267020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ebd6e-fe81-43eb-b6b3-d8da5ac81d79 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:49.273495 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:49.275083 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 228/447] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jun 23 15:37:49 2022] GET /identity/v3/role_assignments?group.id=3f3819abcac24ae3b0ccdd1d8c2a7fc2&scope.project.id=89a6206a5b7347f989194e2334051714&role.id=2362b672eb7b474dbd341608f3993123 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:49.276065 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ebd6e-fe81-43eb-b6b3-d8da5ac81d79 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:49.281437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7a1d7-1453-4ad2-a1a9-fef17df3b1e6 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:49.328552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77754b3f-9aff-4467-af18-8d21e11cbecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:49.328818 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77754b3f-9aff-4467-af18-8d21e11cbecd None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:49.329081 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77754b3f-9aff-4467-af18-8d21e11cbecd None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:49.329366 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77754b3f-9aff-4467-af18-8d21e11cbecd None admin] PATH_INFO: `/v3/projects/89a6206a5b7347f989194e2334051714` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:49.330792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77754b3f-9aff-4467-af18-8d21e11cbecd None admin] RBAC: Authorizing `identity:get_project(project_id=89a6206a5b7347f989194e2334051714)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:49.332278 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77754b3f-9aff-4467-af18-8d21e11cbecd None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:49.334357 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 220/448] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:49 2022] GET /identity/v3/projects/89a6206a5b7347f989194e2334051714 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:49.340120 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77754b3f-9aff-4467-af18-8d21e11cbecd None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:49.418287 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ebd6e-fe81-43eb-b6b3-d8da5ac81d79 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:49.466892 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ef33c-066a-4175-a7d5-9ab19525eb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:49.467573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ef33c-066a-4175-a7d5-9ab19525eb4c None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:49.467862 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ef33c-066a-4175-a7d5-9ab19525eb4c None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:49.468142 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ef33c-066a-4175-a7d5-9ab19525eb4c None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:49.468910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ef33c-066a-4175-a7d5-9ab19525eb4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:49.473885 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ef33c-066a-4175-a7d5-9ab19525eb4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:49.473885 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ef33c-066a-4175-a7d5-9ab19525eb4c None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:49.480406 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 229/449] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:49.480579 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77754b3f-9aff-4467-af18-8d21e11cbecd None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:49.486937 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ef33c-066a-4175-a7d5-9ab19525eb4c None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:49.512221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:49.524591 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d787ab-4ff2-46e8-846e-0cef5efdc85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:49.525466 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d787ab-4ff2-46e8-846e-0cef5efdc85e None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:49.525748 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d787ab-4ff2-46e8-846e-0cef5efdc85e None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:49.526058 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d787ab-4ff2-46e8-846e-0cef5efdc85e None admin] PATH_INFO: `/v3/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:49.527260 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d787ab-4ff2-46e8-846e-0cef5efdc85e None admin] RBAC: Authorizing `identity:get_group(group_id=3f3819abcac24ae3b0ccdd1d8c2a7fc2)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:49.529900 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d787ab-4ff2-46e8-846e-0cef5efdc85e None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:49.536193 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 221/450] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 23 15:37:49 2022] GET /identity/v3/groups/3f3819abcac24ae3b0ccdd1d8c2a7fc2 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:37:49.537345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d787ab-4ff2-46e8-846e-0cef5efdc85e None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:49.577596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:49.635408 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ef33c-066a-4175-a7d5-9ab19525eb4c None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:49.678329 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a5825-5956-4355-9ab1-3069456a800c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:49.679772 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a5825-5956-4355-9ab1-3069456a800c None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:49.679772 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a5825-5956-4355-9ab1-3069456a800c None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:49.679772 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a5825-5956-4355-9ab1-3069456a800c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:49.680638 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d787ab-4ff2-46e8-846e-0cef5efdc85e None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:49.717304 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91011a1f-4852-42d7-8ef0-d6466fde10e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:49.717993 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91011a1f-4852-42d7-8ef0-d6466fde10e9 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:49.718276 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91011a1f-4852-42d7-8ef0-d6466fde10e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:49.718548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91011a1f-4852-42d7-8ef0-d6466fde10e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:49.719457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91011a1f-4852-42d7-8ef0-d6466fde10e9 None admin] RBAC: Adding query filter params (group.id=3f3819abcac24ae3b0ccdd1d8c2a7fc2, role.id=12fa8f67cf514b1e916afc130f0e6008, scope.project.id=89a6206a5b7347f989194e2334051714) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:49.719767 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91011a1f-4852-42d7-8ef0-d6466fde10e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:49.721218 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91011a1f-4852-42d7-8ef0-d6466fde10e9 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:49.727428 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 222/451] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jun 23 15:37:49 2022] GET /identity/v3/role_assignments?group.id=3f3819abcac24ae3b0ccdd1d8c2a7fc2&scope.project.id=89a6206a5b7347f989194e2334051714&role.id=12fa8f67cf514b1e916afc130f0e6008 => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:49.761667 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a5825-5956-4355-9ab1-3069456a800c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:49.763216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a5825-5956-4355-9ab1-3069456a800c None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:49.783330 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:49.880864 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 230/452] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:37:49.887146 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91011a1f-4852-42d7-8ef0-d6466fde10e9 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:49.994966 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:50.002463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91011a1f-4852-42d7-8ef0-d6466fde10e9 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:50.044709 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd6a2b-4462-4f52-8b9f-0069b4fc85b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:50.045583 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd6a2b-4462-4f52-8b9f-0069b4fc85b5 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:50.045880 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd6a2b-4462-4f52-8b9f-0069b4fc85b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:50.046175 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd6a2b-4462-4f52-8b9f-0069b4fc85b5 None admin] PATH_INFO: `/v3/projects/a90cb52bb0ee4522ac438c1991f3a531` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:50.047397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd6a2b-4462-4f52-8b9f-0069b4fc85b5 None admin] RBAC: Authorizing `identity:get_project(project_id=a90cb52bb0ee4522ac438c1991f3a531)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:50.048827 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd6a2b-4462-4f52-8b9f-0069b4fc85b5 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:50.051334 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 223/453] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:37:49 2022] GET /identity/v3/projects/a90cb52bb0ee4522ac438c1991f3a531 => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:50.056304 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a5825-5956-4355-9ab1-3069456a800c None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:50.159032 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a5825-5956-4355-9ab1-3069456a800c None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:50.176066 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:50.193627 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc59057-3af3-4524-95a7-f6327387d16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:50.194512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc59057-3af3-4524-95a7-f6327387d16e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:50.194797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc59057-3af3-4524-95a7-f6327387d16e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:50.195076 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc59057-3af3-4524-95a7-f6327387d16e None admin] PATH_INFO: `/v3/groups/ba87514ee0064059aca980dd9bef9f85` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:50.196250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc59057-3af3-4524-95a7-f6327387d16e None admin] RBAC: Authorizing `identity:get_group(group_id=ba87514ee0064059aca980dd9bef9f85)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:50.197743 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc59057-3af3-4524-95a7-f6327387d16e None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:50.199413 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 231/454] 10.222.0.15 () {56 vars in 1180 bytes} [Thu Jun 23 15:37:50 2022] GET /identity/v3/groups/ba87514ee0064059aca980dd9bef9f85 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:50.205286 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd6a2b-4462-4f52-8b9f-0069b4fc85b5 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:50.310591 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd6a2b-4462-4f52-8b9f-0069b4fc85b5 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:50.347249 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b040091c-adff-4f35-9a7a-5229db3ff343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:50.347909 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040091c-adff-4f35-9a7a-5229db3ff343 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:50.348195 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040091c-adff-4f35-9a7a-5229db3ff343 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:50.348476 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040091c-adff-4f35-9a7a-5229db3ff343 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:50.349313 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040091c-adff-4f35-9a7a-5229db3ff343 None admin] RBAC: Adding query filter params (group.id=ba87514ee0064059aca980dd9bef9f85, role.id=abdc0e0957534149b3653eaa33cbd054, scope.project.id=a90cb52bb0ee4522ac438c1991f3a531) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:50.349631 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040091c-adff-4f35-9a7a-5229db3ff343 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:50.351103 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b040091c-adff-4f35-9a7a-5229db3ff343 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:50.358806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 224/455] 10.222.0.15 () {56 vars in 1376 bytes} [Thu Jun 23 15:37:50 2022] GET /identity/v3/role_assignments?group.id=ba87514ee0064059aca980dd9bef9f85&scope.project.id=a90cb52bb0ee4522ac438c1991f3a531&role.id=abdc0e0957534149b3653eaa33cbd054 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:52.825762 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879b804-e056-4695-a325-d59c6ab7282b None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:52.826653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879b804-e056-4695-a325-d59c6ab7282b None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:52.827104 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879b804-e056-4695-a325-d59c6ab7282b None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:52.828915 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 232/456] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:52.834839 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82d6b9-c769-4511-a777-882c18f3b995 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:52.835652 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82d6b9-c769-4511-a777-882c18f3b995 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:52.836077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82d6b9-c769-4511-a777-882c18f3b995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:52.856057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-ce82d6b9-c769-4511-a777-882c18f3b995 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:52.857617 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-ce82d6b9-c769-4511-a777-882c18f3b995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:52.885235 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:52.969265 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 225/457] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 15:37:53.002081 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879b804-e056-4695-a325-d59c6ab7282b None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:53.076342 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a057f2-ec59-4300-9f83-d991bb60bd1e None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:53.076532 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a057f2-ec59-4300-9f83-d991bb60bd1e None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:53.076822 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a057f2-ec59-4300-9f83-d991bb60bd1e None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:53.079172 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 226/458] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:53.086117 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19169e-0d44-48fe-b928-f0af855f4d07 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:53.086637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19169e-0d44-48fe-b928-f0af855f4d07 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:53.087069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19169e-0d44-48fe-b928-f0af855f4d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:53.117336 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-fe19169e-0d44-48fe-b928-f0af855f4d07 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:53.118557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-fe19169e-0d44-48fe-b928-f0af855f4d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:53.185662 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879b804-e056-4695-a325-d59c6ab7282b None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:53.269556 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd06a6-9324-4d90-a56f-ca571de00c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:53.270386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd06a6-9324-4d90-a56f-ca571de00c18 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:53.270667 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd06a6-9324-4d90-a56f-ca571de00c18 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:53.270940 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd06a6-9324-4d90-a56f-ca571de00c18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:53.284047 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd06a6-9324-4d90-a56f-ca571de00c18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:53.284582 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 227/459] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:53.286244 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd06a6-9324-4d90-a56f-ca571de00c18 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:53.308951 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-47cd06a6-9324-4d90-a56f-ca571de00c18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:37:53.308951 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:53.308951 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:53.308951 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:53.308951 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:53.308951 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:53.308951 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:53.308951 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:53.308951 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:53.308951 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:53.308951 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:53.308951 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:53.308951 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:37:53.308951 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:37:53.308951 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:37:53.310418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:37:53.310418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:53.310418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:53.310418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:53.310418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:53.310418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:53.310418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:53.310418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:53.310418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:53.310418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:53.310418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:53.310418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:53.310418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:53.310418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:53.310418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:53.310418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:53.310418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:53.311243 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:37:53.311243 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:37:53.311243 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:37:53.311243 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:53.313738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 233/460] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:53.319137 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19169e-0d44-48fe-b928-f0af855f4d07 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:53.322181 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd06a6-9324-4d90-a56f-ca571de00c18 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:53.369525 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:53.417192 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:53.436506 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19169e-0d44-48fe-b928-f0af855f4d07 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:53.447358 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd06a6-9324-4d90-a56f-ca571de00c18 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:53.484708 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f850e8-299e-4941-b4eb-65f0988f9c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:53.485900 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f850e8-299e-4941-b4eb-65f0988f9c3f None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:53.486344 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f850e8-299e-4941-b4eb-65f0988f9c3f None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:53.486822 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f850e8-299e-4941-b4eb-65f0988f9c3f None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:53.487240 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12b30a-0cb9-42a9-8b80-f4709673583e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:53.487883 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f850e8-299e-4941-b4eb-65f0988f9c3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:53.488178 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12b30a-0cb9-42a9-8b80-f4709673583e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:53.488480 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f850e8-299e-4941-b4eb-65f0988f9c3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:53.488584 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12b30a-0cb9-42a9-8b80-f4709673583e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:53.488916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12b30a-0cb9-42a9-8b80-f4709673583e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:53.490462 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f850e8-299e-4941-b4eb-65f0988f9c3f None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:53.501709 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12b30a-0cb9-42a9-8b80-f4709673583e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:53.503719 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12b30a-0cb9-42a9-8b80-f4709673583e None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:53.504576 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 228/461] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:53.506493 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb5021-d6fa-422a-a256-cea5d1231127 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:53.507224 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb5021-d6fa-422a-a256-cea5d1231127 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:53.507873 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb5021-d6fa-422a-a256-cea5d1231127 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:53.510474 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 229/462] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:53.511750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb5021-d6fa-422a-a256-cea5d1231127 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:53.524904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-8e12b30a-0cb9-42a9-8b80-f4709673583e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:37:53.524904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:53.524904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:53.524904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:53.524904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:53.524904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:53.524904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:53.524904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:53.524904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:53.524904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:53.524904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:53.524904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:53.524904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:37:53.524904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:37:53.524904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:37:53.525803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:37:53.525803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:53.525803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:53.525803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:53.525803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:53.525803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:53.525803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:53.525803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:53.525803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:53.525803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:53.525803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:53.525803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:53.525803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:53.525803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:53.525803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:53.525803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:53.525803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:53.527068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:37:53.527068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:37:53.527068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:37:53.527068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:53.527068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 234/463] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:53.535467 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d317272-4040-488d-8de3-182817c2f4c6 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:53.535924 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d317272-4040-488d-8de3-182817c2f4c6 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:53.536247 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d317272-4040-488d-8de3-182817c2f4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:53.554848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-8d317272-4040-488d-8de3-182817c2f4c6 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:53.556267 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-8d317272-4040-488d-8de3-182817c2f4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:53.633653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 235/464] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:53.634642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d317272-4040-488d-8de3-182817c2f4c6 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:53.654780 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb5021-d6fa-422a-a256-cea5d1231127 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:53.658237 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:53.692396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff50a9-b870-4c78-9a2e-4c7394ab7fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:53.693080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff50a9-b870-4c78-9a2e-4c7394ab7fc6 None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:53.693361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff50a9-b870-4c78-9a2e-4c7394ab7fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:53.693641 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff50a9-b870-4c78-9a2e-4c7394ab7fc6 None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:53.694376 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff50a9-b870-4c78-9a2e-4c7394ab7fc6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:53.695825 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff50a9-b870-4c78-9a2e-4c7394ab7fc6 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:53.719653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 230/465] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 23 15:37:53 2022] POST /identity/v3/users => generated 246 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:37:53.720557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff50a9-b870-4c78-9a2e-4c7394ab7fc6 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:53.723564 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:53.762291 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d317272-4040-488d-8de3-182817c2f4c6 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:53.814719 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f13f24-7412-4a63-ad38-e0de1f89db8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:53.815099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f13f24-7412-4a63-ad38-e0de1f89db8b None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:53.815325 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f13f24-7412-4a63-ad38-e0de1f89db8b None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:53.815612 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f13f24-7412-4a63-ad38-e0de1f89db8b None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:53.816372 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f13f24-7412-4a63-ad38-e0de1f89db8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:53.816687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f13f24-7412-4a63-ad38-e0de1f89db8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:53.818110 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f13f24-7412-4a63-ad38-e0de1f89db8b None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:53.838595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 236/466] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:53.844555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f13f24-7412-4a63-ad38-e0de1f89db8b None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:53.853956 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff50a9-b870-4c78-9a2e-4c7394ab7fc6 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:53.895107 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad8400-43b5-4ac0-9d75-5f2482182c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:53.896978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad8400-43b5-4ac0-9d75-5f2482182c00 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:53.897626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad8400-43b5-4ac0-9d75-5f2482182c00 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:53.898128 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad8400-43b5-4ac0-9d75-5f2482182c00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:53.915856 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad8400-43b5-4ac0-9d75-5f2482182c00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:53.918026 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad8400-43b5-4ac0-9d75-5f2482182c00 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:53.938885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-5dad8400-43b5-4ac0-9d75-5f2482182c00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:37:53.938885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:53.938885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:53.938885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:53.938885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:53.938885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:53.938885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:53.938885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:53.938885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:53.938885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:53.938885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:53.938885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:53.938885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:37:53.938885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:37:53.938885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:37:53.939785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:37:53.939785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:53.939785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:53.939785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:53.939785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:53.939785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:53.939785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:53.939785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:53.939785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:53.939785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:53.939785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:53.939785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:53.939785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:53.939785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:53.939785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:53.939785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:53.939785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:53.940633 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:37:53.940633 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:37:53.940633 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:37:53.940633 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:53.941900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:53.944005 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 231/467] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:53.945767 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85351431-e5a1-4507-b82e-ed89ce49831c None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:53.946455 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85351431-e5a1-4507-b82e-ed89ce49831c None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:53.946905 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85351431-e5a1-4507-b82e-ed89ce49831c None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:53.948852 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 232/468] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:53.950308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85351431-e5a1-4507-b82e-ed89ce49831c None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:53.971967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f13f24-7412-4a63-ad38-e0de1f89db8b None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:54.013784 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55964ef8-5b6f-4e80-995a-3736b4e69db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:54.014502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55964ef8-5b6f-4e80-995a-3736b4e69db6 None admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:54.014797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55964ef8-5b6f-4e80-995a-3736b4e69db6 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:54.015079 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55964ef8-5b6f-4e80-995a-3736b4e69db6 None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:54.015945 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55964ef8-5b6f-4e80-995a-3736b4e69db6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:54.017425 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55964ef8-5b6f-4e80-995a-3736b4e69db6 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:54.033655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:54.047473 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 237/469] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 23 15:37:53 2022] POST /identity/v3/users => generated 248 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:37:54.048825 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215485d-8e3c-4cef-ad9c-8a995dc37de2 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:54.049113 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215485d-8e3c-4cef-ad9c-8a995dc37de2 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:54.049476 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215485d-8e3c-4cef-ad9c-8a995dc37de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:54.086737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-e215485d-8e3c-4cef-ad9c-8a995dc37de2 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:54.087998 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e215485d-8e3c-4cef-ad9c-8a995dc37de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:54.129608 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85351431-e5a1-4507-b82e-ed89ce49831c None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:54.189623 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 238/470] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:54.210572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5eac1d-6097-4975-9654-f34d81246433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:54.211663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eac1d-6097-4975-9654-f34d81246433 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:54.212154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eac1d-6097-4975-9654-f34d81246433 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:54.212711 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5eac1d-6097-4975-9654-f34d81246433 None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:54.213713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5eac1d-6097-4975-9654-f34d81246433 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:54.214310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5eac1d-6097-4975-9654-f34d81246433 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:54.216031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5eac1d-6097-4975-9654-f34d81246433 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:54.231110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 233/471] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:54.237386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215485d-8e3c-4cef-ad9c-8a995dc37de2 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:54.241793 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5eac1d-6097-4975-9654-f34d81246433 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:54.330776 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:54.376483 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5eac1d-6097-4975-9654-f34d81246433 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:54.379237 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e215485d-8e3c-4cef-ad9c-8a995dc37de2 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:54.394851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:54.419524 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ba848-b105-4c41-9089-c411aab939f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:54.419524 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ba848-b105-4c41-9089-c411aab939f6 None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:54.419524 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ba848-b105-4c41-9089-c411aab939f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:54.419878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ba848-b105-4c41-9089-c411aab939f6 None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:54.422084 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ba848-b105-4c41-9089-c411aab939f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:54.423592 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ba848-b105-4c41-9089-c411aab939f6 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:54.423820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79538e5-b859-400c-8b22-94b5f96c2727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:54.425681 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79538e5-b859-400c-8b22-94b5f96c2727 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:54.429585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79538e5-b859-400c-8b22-94b5f96c2727 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:54.430145 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79538e5-b859-400c-8b22-94b5f96c2727 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:54.443424 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79538e5-b859-400c-8b22-94b5f96c2727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:54.445233 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79538e5-b859-400c-8b22-94b5f96c2727 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:54.456239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 234/472] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 23 15:37:54 2022] POST /identity/v3/users => generated 248 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:37:54.477967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-b79538e5-b859-400c-8b22-94b5f96c2727 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:37:54.477967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:54.477967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:54.477967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:54.477967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:54.477967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:54.477967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:54.477967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:54.477967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:54.477967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:54.477967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:54.477967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:54.477967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:37:54.477967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:37:54.477967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:37:54.478869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:37:54.478869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:54.478869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:54.478869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:54.478869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:54.478869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:54.478869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:54.478869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:54.478869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:54.478869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:54.478869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:54.478869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:54.478869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:54.478869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:54.478869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:54.478869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:54.478869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:54.479693 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:37:54.479693 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:37:54.479693 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:37:54.479693 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:54.479693 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 239/473] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:37:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:54.486173 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ba848-b105-4c41-9089-c411aab939f6 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:54.578408 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c21f6e-c6e4-49b1-9203-24cf8fd01093 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:54.578717 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c21f6e-c6e4-49b1-9203-24cf8fd01093 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:54.578977 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c21f6e-c6e4-49b1-9203-24cf8fd01093 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:54.580649 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 240/474] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:54.586667 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7241bf0-d3d1-45e9-85af-35ec30beaedf None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:54.586958 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7241bf0-d3d1-45e9-85af-35ec30beaedf None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:54.587235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7241bf0-d3d1-45e9-85af-35ec30beaedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:54.627085 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-e7241bf0-d3d1-45e9-85af-35ec30beaedf None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:54.628232 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ba848-b105-4c41-9089-c411aab939f6 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:54.628503 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e7241bf0-d3d1-45e9-85af-35ec30beaedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:54.672035 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e190f44-5279-49a7-996f-35e098bc102c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:54.672756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e190f44-5279-49a7-996f-35e098bc102c None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:54.673045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e190f44-5279-49a7-996f-35e098bc102c None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:54.673330 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e190f44-5279-49a7-996f-35e098bc102c None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:54.674378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e190f44-5279-49a7-996f-35e098bc102c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:54.674887 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e190f44-5279-49a7-996f-35e098bc102c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:54.677439 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e190f44-5279-49a7-996f-35e098bc102c None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:54.698324 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 235/475] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:54.706941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e190f44-5279-49a7-996f-35e098bc102c None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:54.743897 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:54.754212 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 241/476] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:54.778721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7241bf0-d3d1-45e9-85af-35ec30beaedf None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:54.832841 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:54.838995 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e190f44-5279-49a7-996f-35e098bc102c None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:54.881340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390870a-dfcf-4040-9b4e-d5cc2f82e01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:54.883657 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390870a-dfcf-4040-9b4e-d5cc2f82e01d None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:54.884351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390870a-dfcf-4040-9b4e-d5cc2f82e01d None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:54.884959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390870a-dfcf-4040-9b4e-d5cc2f82e01d None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:54.886469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390870a-dfcf-4040-9b4e-d5cc2f82e01d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:54.889033 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390870a-dfcf-4040-9b4e-d5cc2f82e01d None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:54.901528 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7241bf0-d3d1-45e9-85af-35ec30beaedf None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:54.919412 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 236/477] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 23 15:37:54 2022] POST /identity/v3/users => generated 249 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:37:54.956720 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a8c66-b535-4d95-8bae-aaefffa926ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:54.957826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a8c66-b535-4d95-8bae-aaefffa926ac None admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:54.958368 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a8c66-b535-4d95-8bae-aaefffa926ac None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:54.958817 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a8c66-b535-4d95-8bae-aaefffa926ac None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:54.959776 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a8c66-b535-4d95-8bae-aaefffa926ac None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:54.961440 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a8c66-b535-4d95-8bae-aaefffa926ac None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:54.968891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.sql.core [None req-f55a8c66-b535-4d95-8bae-aaefffa926ac None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 15:37:54.968891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 15:37:54.968891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [parameters: {'id': '55632345b55c413fbbd11054a76cca9c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 15:37:54.968891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91828) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 15:37:54.987869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-f55a8c66-b535-4d95-8bae-aaefffa926ac None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 15:37:54.987869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:54.987869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 15:37:54.987869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 15:37:54.987869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 15:37:54.987869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 15:37:54.987869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 15:37:54.987869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 15:37:54.987869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 15:37:54.987869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application conn.query(q) Jun 23 15:37:54.987869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 15:37:54.987869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 15:37:54.987869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 15:37:54.987869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application result.read() Jun 23 15:37:54.987869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 15:37:54.988799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 15:37:54.988799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 15:37:54.988799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 15:37:54.988799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 15:37:54.988799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 15:37:54.988799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 15:37:54.988799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 15:37:54.988799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 15:37:54.988799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:54.988799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 15:37:54.988799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:54.988799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:54.988799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 15:37:54.988799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 15:37:54.988799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 23 15:37:54.988799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return ref.to_dict() Jun 23 15:37:54.988799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 15:37:54.988799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application next(self.gen) Jun 23 15:37:54.989687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 15:37:54.989687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application yield resource Jun 23 15:37:54.989687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 15:37:54.989687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application next(self.gen) Jun 23 15:37:54.989687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 15:37:54.989687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 15:37:54.989687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 15:37:54.989687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 15:37:54.989687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 15:37:54.989687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise self.value Jun 23 15:37:54.989687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 15:37:54.989687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 15:37:54.989687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 15:37:54.989687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application session.commit() Jun 23 15:37:54.989687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 15:37:54.989687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 15:37:54.989687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 15:37:54.990565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 15:37:54.990565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 15:37:54.990565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self.session.flush() Jun 23 15:37:54.990565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 15:37:54.990565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 15:37:54.990565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 15:37:54.990565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 15:37:54.990565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 15:37:54.990565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application compat.raise_( Jun 23 15:37:54.990565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 15:37:54.990565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception Jun 23 15:37:54.990565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 15:37:54.990565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 15:37:54.990565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 15:37:54.990565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 15:37:54.990565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 15:37:54.990565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 15:37:54.991407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 15:37:54.991407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 15:37:54.991407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 15:37:54.991407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 15:37:54.991407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 15:37:54.991407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 15:37:54.991407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 15:37:54.991407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 15:37:54.991407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 15:37:54.991407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 15:37:54.991407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 15:37:54.991407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 15:37:54.991407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 15:37:54.991407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 15:37:54.991407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 15:37:54.991407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception Jun 23 15:37:54.992197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 15:37:54.992197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 15:37:54.992197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 15:37:54.992197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 15:37:54.992197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 15:37:54.992197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 15:37:54.992197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 15:37:54.992197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application conn.query(q) Jun 23 15:37:54.992197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 15:37:54.992197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 15:37:54.992197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 15:37:54.992197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application result.read() Jun 23 15:37:54.992197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 15:37:54.992197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 15:37:54.992197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 15:37:54.992197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 15:37:54.992966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 15:37:54.992966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 15:37:54.992966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 15:37:54.992966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 15:37:54.992966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 15:37:54.992966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 15:37:54.992966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [parameters: {'id': '55632345b55c413fbbd11054a76cca9c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 15:37:54.992966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 15:37:54.992966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:54.992966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:37:54.992966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:54.992966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:54.992966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:54.992966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:54.992966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:54.992966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:54.993733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:54.993733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:54.993733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:54.993733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:54.993733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:54.993733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:54.993733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 23 15:37:54.993733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 23 15:37:54.993733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:54.993733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:54.993733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 23 15:37:54.993733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 23 15:37:54.993733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 15:37:54.993733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 15:37:54.993733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 15:37:54.993733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:54.996625 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 242/478] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Jun 23 15:37:54 2022] POST /identity/v3/roles => generated 144 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:55.003044 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390870a-dfcf-4040-9b4e-d5cc2f82e01d None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:55.151961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:55.171463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390870a-dfcf-4040-9b4e-d5cc2f82e01d None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:55.214088 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf130f67-276b-4179-b3b6-bdb821a0e692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:55.214836 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf130f67-276b-4179-b3b6-bdb821a0e692 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:55.215120 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf130f67-276b-4179-b3b6-bdb821a0e692 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:55.215397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf130f67-276b-4179-b3b6-bdb821a0e692 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:55.229838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf130f67-276b-4179-b3b6-bdb821a0e692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:55.238226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-cf130f67-276b-4179-b3b6-bdb821a0e692 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:55.238226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:55.238226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:55.238226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:55.238226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:55.238226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:55.238226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:55.238226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:55.238226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:55.238226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:55.238226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:55.238226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:55.238226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:55.238226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:55.238226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:55.238226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:55.239152 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:55.239152 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:55.239152 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:55.239152 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:55.239152 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:55.239152 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:55.239152 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:55.239152 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:55.239152 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:55.239152 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:55.239152 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:55.239152 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:55.239152 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:55.239152 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:55.239152 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:55.239152 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:55.240361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:55.240361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:55.240361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:55.240361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:55.240361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:55.240361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:55.240361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:55.240361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:55.240361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:55.240361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:55.240361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 15:37:55.240361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:55.240361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 237/479] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 23 15:37:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:55.245353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a8c66-b535-4d95-8bae-aaefffa926ac None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:55.375114 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a8c66-b535-4d95-8bae-aaefffa926ac None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:55.387162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:55.423451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79138a-22d9-4c2c-887e-316fdcc2210e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:55.424504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79138a-22d9-4c2c-887e-316fdcc2210e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:55.424983 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79138a-22d9-4c2c-887e-316fdcc2210e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:55.425450 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79138a-22d9-4c2c-887e-316fdcc2210e None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:55.426466 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79138a-22d9-4c2c-887e-316fdcc2210e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:55.426980 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79138a-22d9-4c2c-887e-316fdcc2210e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:55.428907 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79138a-22d9-4c2c-887e-316fdcc2210e None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:55.439346 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 243/480] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:37:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:56.353990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47041c1-22bf-4739-83ee-fc947396480e None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:56.354534 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47041c1-22bf-4739-83ee-fc947396480e None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:56.354618 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47041c1-22bf-4739-83ee-fc947396480e None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:56.356895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 238/481] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:56.362522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b852195-90f2-458d-ab53-0be358c6ff2f None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:56.363012 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b852195-90f2-458d-ab53-0be358c6ff2f None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:56.363084 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b852195-90f2-458d-ab53-0be358c6ff2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:56.386238 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-3b852195-90f2-458d-ab53-0be358c6ff2f None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:56.387476 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-3b852195-90f2-458d-ab53-0be358c6ff2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:56.479574 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 244/482] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:56.527869 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47041c1-22bf-4739-83ee-fc947396480e None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:56.695137 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47041c1-22bf-4739-83ee-fc947396480e None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:56.743498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd92e5e-90ce-4039-bd1a-58e0ab7c79ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:56.744334 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd92e5e-90ce-4039-bd1a-58e0ab7c79ec None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:56.744693 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd92e5e-90ce-4039-bd1a-58e0ab7c79ec None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:56.744979 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd92e5e-90ce-4039-bd1a-58e0ab7c79ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:56.760665 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a8883-87d1-4f0f-8e83-652a0497233a None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:56.761003 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a8883-87d1-4f0f-8e83-652a0497233a None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:56.761226 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a8883-87d1-4f0f-8e83-652a0497233a None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:56.763563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 245/483] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:56.764315 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd92e5e-90ce-4039-bd1a-58e0ab7c79ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:56.769330 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd2be2-7500-4250-8ce7-4aedc0a41ba6 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:56.769683 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd2be2-7500-4250-8ce7-4aedc0a41ba6 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:56.769966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd2be2-7500-4250-8ce7-4aedc0a41ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:56.772485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-fbd92e5e-90ce-4039-bd1a-58e0ab7c79ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:37:56.772485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:56.772485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:56.772485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:56.772485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:56.772485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:56.772485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:56.772485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:56.772485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:56.772485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:56.772485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:56.772485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:56.772485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:56.772485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:56.772485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:56.772485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:56.773357 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:56.773357 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:56.773357 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:56.773357 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:56.773357 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:56.773357 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:56.773357 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:56.773357 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:56.773357 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:56.773357 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:56.773357 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:56.773357 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:56.773357 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:56.773357 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:56.773357 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:56.773357 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:56.774764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:56.774764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:56.774764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:56.774764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:56.774764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:56.774764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:56.774764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:56.774764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:56.774764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:56.774764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:56.774764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:37:56.774764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:56.774764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 239/484] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 23 15:37:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:56.779969 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd92e5e-90ce-4039-bd1a-58e0ab7c79ec None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:56.802249 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:56.808574 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-5ebd2be2-7500-4250-8ce7-4aedc0a41ba6 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:56.811059 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5ebd2be2-7500-4250-8ce7-4aedc0a41ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:56.953828 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 246/485] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 15:37:56.962679 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd92e5e-90ce-4039-bd1a-58e0ab7c79ec None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:56.986407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd2be2-7500-4250-8ce7-4aedc0a41ba6 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:57.008062 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e797de-684a-4c84-8bfe-d7478f76498c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:57.008741 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e797de-684a-4c84-8bfe-d7478f76498c None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:57.009019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e797de-684a-4c84-8bfe-d7478f76498c None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:57.009291 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e797de-684a-4c84-8bfe-d7478f76498c None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:57.010090 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e797de-684a-4c84-8bfe-d7478f76498c None admin] RBAC: Adding query filter params (name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:57.010403 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e797de-684a-4c84-8bfe-d7478f76498c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:57.011780 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e797de-684a-4c84-8bfe-d7478f76498c None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:57.035737 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 240/486] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 23 15:37:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:57.041581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e797de-684a-4c84-8bfe-d7478f76498c None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:57.054229 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:57.125577 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd2be2-7500-4250-8ce7-4aedc0a41ba6 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:57.168046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12356637-722b-484c-ae05-c851d38228a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:57.168884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12356637-722b-484c-ae05-c851d38228a4 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:57.169167 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12356637-722b-484c-ae05-c851d38228a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:57.169445 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12356637-722b-484c-ae05-c851d38228a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:57.180712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12356637-722b-484c-ae05-c851d38228a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:57.188651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-12356637-722b-484c-ae05-c851d38228a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:37:57.188651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:57.188651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:57.188651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:57.188651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:57.188651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:57.188651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:57.188651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:57.188651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:57.188651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:57.188651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:57.188651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:57.188651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:57.188651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:57.188651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:57.188651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:57.189590 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:57.189590 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:57.189590 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:57.189590 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:57.189590 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:57.189590 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:57.189590 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:57.189590 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:57.189590 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:57.189590 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:57.189590 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:57.189590 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:57.189590 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:57.189590 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:57.189590 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:57.189590 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:57.190410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:57.190410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:57.190410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:57.190410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:57.190410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:57.190410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:57.190410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:57.190410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:57.190410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:57.190410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:57.190410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:37:57.190410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:57.190410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 247/487] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 23 15:37:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:37:57.191562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d5085-6957-4445-98f7-151933a93f62 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:57.191756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d5085-6957-4445-98f7-151933a93f62 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:57.192035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d5085-6957-4445-98f7-151933a93f62 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:57.202481 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 248/488] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:57.202481 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d5085-6957-4445-98f7-151933a93f62 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:57.207709 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:57.259093 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e797de-684a-4c84-8bfe-d7478f76498c None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:57.316992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457a11e2-459a-420f-9916-4f08a5fb6baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:57.318464 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a11e2-459a-420f-9916-4f08a5fb6baa None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:57.318950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a11e2-459a-420f-9916-4f08a5fb6baa None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:57.319750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457a11e2-459a-420f-9916-4f08a5fb6baa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:57.320564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:57.332423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d5085-6957-4445-98f7-151933a93f62 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:57.338705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a11e2-459a-420f-9916-4f08a5fb6baa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:57.341727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457a11e2-459a-420f-9916-4f08a5fb6baa None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:57.364552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-457a11e2-459a-420f-9916-4f08a5fb6baa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:37:57.364552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:57.364552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:57.364552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:57.364552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:57.364552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:57.364552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:57.364552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:57.364552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:57.364552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:57.364552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:57.364552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:57.364552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:37:57.364552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:37:57.364552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:37:57.365886 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:37:57.365886 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:57.365886 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:57.365886 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:57.365886 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:57.365886 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:57.365886 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:57.365886 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:57.365886 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:57.365886 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:57.365886 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:57.365886 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:57.365886 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:57.365886 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:57.365886 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:57.365886 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:57.365886 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:57.366745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:37:57.366745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:37:57.366745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:37:57.366745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:57.366745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 241/489] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:57.367493 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2572ad-a35a-41a7-b2c4-21f9b8acb25c None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:57.367770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2572ad-a35a-41a7-b2c4-21f9b8acb25c None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:57.368048 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2572ad-a35a-41a7-b2c4-21f9b8acb25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:57.376643 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c24130-0c40-4c6e-b9ca-ebf22fbbab13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:57.378095 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c24130-0c40-4c6e-b9ca-ebf22fbbab13 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:57.378599 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c24130-0c40-4c6e-b9ca-ebf22fbbab13 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:57.379119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c24130-0c40-4c6e-b9ca-ebf22fbbab13 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:57.380079 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c24130-0c40-4c6e-b9ca-ebf22fbbab13 None admin] RBAC: Adding query filter params (name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:57.380761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c24130-0c40-4c6e-b9ca-ebf22fbbab13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:57.382317 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c24130-0c40-4c6e-b9ca-ebf22fbbab13 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:57.386454 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-bb2572ad-a35a-41a7-b2c4-21f9b8acb25c None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:57.388434 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-bb2572ad-a35a-41a7-b2c4-21f9b8acb25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:57.397353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 249/490] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 23 15:37:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:57.397353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c24130-0c40-4c6e-b9ca-ebf22fbbab13 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:57.482113 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 242/491] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:57.483151 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2572ad-a35a-41a7-b2c4-21f9b8acb25c None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:57.534685 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c24130-0c40-4c6e-b9ca-ebf22fbbab13 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:57.573343 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:57.582760 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5be617-2eed-4216-a23e-5fa142a1f424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:57.584418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5be617-2eed-4216-a23e-5fa142a1f424 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:57.584880 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5be617-2eed-4216-a23e-5fa142a1f424 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:57.585358 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5be617-2eed-4216-a23e-5fa142a1f424 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:57.586925 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5be617-2eed-4216-a23e-5fa142a1f424 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:57.587558 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5be617-2eed-4216-a23e-5fa142a1f424 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:57.589470 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5be617-2eed-4216-a23e-5fa142a1f424 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:57.606691 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 250/492] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:57.608255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5be617-2eed-4216-a23e-5fa142a1f424 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:57.628831 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:57.644378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2572ad-a35a-41a7-b2c4-21f9b8acb25c None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:57.697960 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9e805-66fa-4b55-b957-13ce754e61e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:57.698922 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9e805-66fa-4b55-b957-13ce754e61e7 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:57.699404 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9e805-66fa-4b55-b957-13ce754e61e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:57.699783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9e805-66fa-4b55-b957-13ce754e61e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:57.713534 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9e805-66fa-4b55-b957-13ce754e61e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:57.716254 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9e805-66fa-4b55-b957-13ce754e61e7 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:57.754838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-b1c9e805-66fa-4b55-b957-13ce754e61e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:37:57.754838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:57.754838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:57.754838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:57.754838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:57.754838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:57.754838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:57.754838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:57.754838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:57.754838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:57.754838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:57.754838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:57.754838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:37:57.754838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:37:57.754838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:37:57.756716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:37:57.756716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:57.756716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:57.756716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:57.756716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:57.756716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:57.756716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:57.756716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:57.756716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:57.756716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:57.756716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:57.756716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:57.756716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:57.756716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:57.756716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:57.756716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:57.756716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:57.758837 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:37:57.758837 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:37:57.758837 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:37:57.758837 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:57.768772 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5be617-2eed-4216-a23e-5fa142a1f424 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:57.769011 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 243/493] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:57.769011 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9e805-66fa-4b55-b957-13ce754e61e7 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:57.811097 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0a077-3ed4-4b05-abb2-a5e82813580c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:57.811915 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0a077-3ed4-4b05-abb2-a5e82813580c None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:57.812199 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0a077-3ed4-4b05-abb2-a5e82813580c None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:57.812542 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0a077-3ed4-4b05-abb2-a5e82813580c None admin] PATH_INFO: `/v3/roles/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:57.829913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0a077-3ed4-4b05-abb2-a5e82813580c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:57.838046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-79d0a077-3ed4-4b05-abb2-a5e82813580c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:37:57.838046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:57.838046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:57.838046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:57.838046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:57.838046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:57.838046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:57.838046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:57.838046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:57.838046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:57.838046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:57.838046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:57.838046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:57.838046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:57.838046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:57.838046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:57.839736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:57.839736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:57.839736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:57.839736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:57.839736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:57.839736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:57.839736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:57.839736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:57.839736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:57.839736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:57.839736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:57.839736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:57.839736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:57.839736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:57.839736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:57.839736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:57.841342 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:57.841342 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:57.841342 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:57.841342 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:57.841342 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:57.841342 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:57.841342 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:57.841342 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:57.841342 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:57.841342 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:57.841342 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:37:57.841342 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:57.844231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 251/494] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 23 15:37:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:57.845157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0a077-3ed4-4b05-abb2-a5e82813580c None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:57.925627 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9e805-66fa-4b55-b957-13ce754e61e7 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:57.927412 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:57.971518 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c7813-05b4-4c4d-aaf8-cfd4d8fabc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:57.972430 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c7813-05b4-4c4d-aaf8-cfd4d8fabc13 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:57.972800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c7813-05b4-4c4d-aaf8-cfd4d8fabc13 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:57.973153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c7813-05b4-4c4d-aaf8-cfd4d8fabc13 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:57.973286 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:57.982013 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c7813-05b4-4c4d-aaf8-cfd4d8fabc13 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:57.983558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c7813-05b4-4c4d-aaf8-cfd4d8fabc13 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:57.999970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-216c7813-05b4-4c4d-aaf8-cfd4d8fabc13 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 15:37:57.999970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:57.999970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:57.999970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:57.999970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:57.999970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:57.999970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:57.999970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:57.999970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:57.999970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:57.999970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:57.999970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:57.999970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:37:57.999970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:37:57.999970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:37:57.999970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:37:58.000923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:58.000923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:58.000923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:37:58.000923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:37:58.000923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:37:58.000923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:37:58.000923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:58.000923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:58.000923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:58.000923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:58.000923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:58.000923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:58.000923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:58.000923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:58.000923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:58.000923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:58.000923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:58.000923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:58.001789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:58.001789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:58.001789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:37:58.001789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:37:58.001789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:37:58.001789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:37:58.001789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:37:58.001789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:37:58.001789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 15:37:58.001789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:58.001789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 244/495] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jun 23 15:37:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:58.002558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c7813-05b4-4c4d-aaf8-cfd4d8fabc13 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:58.007905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0a077-3ed4-4b05-abb2-a5e82813580c None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:58.051363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294d6d1-7f99-4ed7-a65d-172b7a298cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:58.052034 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294d6d1-7f99-4ed7-a65d-172b7a298cc3 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:58.052329 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294d6d1-7f99-4ed7-a65d-172b7a298cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:58.052605 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294d6d1-7f99-4ed7-a65d-172b7a298cc3 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:58.053338 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294d6d1-7f99-4ed7-a65d-172b7a298cc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:58.053649 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294d6d1-7f99-4ed7-a65d-172b7a298cc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:58.055078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294d6d1-7f99-4ed7-a65d-172b7a298cc3 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:58.068411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 252/496] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:58.069589 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188d325-06af-4eb8-b86e-d75e99d4239e None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:58.069914 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188d325-06af-4eb8-b86e-d75e99d4239e None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:58.070203 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188d325-06af-4eb8-b86e-d75e99d4239e None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:58.075987 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 253/497] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:58.076773 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188d325-06af-4eb8-b86e-d75e99d4239e None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:58.115374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c7813-05b4-4c4d-aaf8-cfd4d8fabc13 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:58.152336 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce53dd4-a1d1-4a9e-ba4c-02b77cfa15d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:58.153763 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce53dd4-a1d1-4a9e-ba4c-02b77cfa15d5 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:58.154091 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce53dd4-a1d1-4a9e-ba4c-02b77cfa15d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:58.154571 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce53dd4-a1d1-4a9e-ba4c-02b77cfa15d5 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:58.155492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce53dd4-a1d1-4a9e-ba4c-02b77cfa15d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:58.156063 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce53dd4-a1d1-4a9e-ba4c-02b77cfa15d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:58.157452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce53dd4-a1d1-4a9e-ba4c-02b77cfa15d5 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:58.166344 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 245/498] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 23 15:37:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:58.167188 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce53dd4-a1d1-4a9e-ba4c-02b77cfa15d5 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:58.203228 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:58.223304 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188d325-06af-4eb8-b86e-d75e99d4239e None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:58.263287 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf596232-5c3f-44b3-b195-43fa087cdb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:58.263875 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf596232-5c3f-44b3-b195-43fa087cdb19 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:58.264156 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf596232-5c3f-44b3-b195-43fa087cdb19 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:58.264439 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf596232-5c3f-44b3-b195-43fa087cdb19 None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:58.265272 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf596232-5c3f-44b3-b195-43fa087cdb19 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:58.265576 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf596232-5c3f-44b3-b195-43fa087cdb19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:58.267061 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf596232-5c3f-44b3-b195-43fa087cdb19 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:58.269166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:58.288244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce53dd4-a1d1-4a9e-ba4c-02b77cfa15d5 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:58.306015 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 254/499] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jun 23 15:37:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:58.307312 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea7659-dcce-48b0-818b-19a5dc9746a3 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:58.307610 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea7659-dcce-48b0-818b-19a5dc9746a3 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:58.307892 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea7659-dcce-48b0-818b-19a5dc9746a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:58.322919 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9a843-93b7-4731-abd3-78423e5345c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:58.323715 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9a843-93b7-4731-abd3-78423e5345c1 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:58.323994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9a843-93b7-4731-abd3-78423e5345c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:58.324282 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9a843-93b7-4731-abd3-78423e5345c1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:58.326383 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-80ea7659-dcce-48b0-818b-19a5dc9746a3 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:58.327592 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-80ea7659-dcce-48b0-818b-19a5dc9746a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:58.333057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9a843-93b7-4731-abd3-78423e5345c1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:58.334540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9a843-93b7-4731-abd3-78423e5345c1 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:58.349071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-a5c9a843-93b7-4731-abd3-78423e5345c1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 15:37:58.349071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:58.349071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:58.349071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:58.349071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:58.349071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:58.349071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:58.349071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:58.349071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:58.349071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:58.349071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:58.349071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:58.349071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:37:58.349071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:37:58.349071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:37:58.349071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:37:58.350072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:58.350072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:58.350072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:37:58.350072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:37:58.350072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:37:58.350072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:37:58.350072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:58.350072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:58.350072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:58.350072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:58.350072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:58.350072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:58.350072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:58.350072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:58.350072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:58.350072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:58.350072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:58.350072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:58.350948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:58.350948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:58.350948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:37:58.350948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:37:58.350948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:37:58.350948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:37:58.350948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:37:58.350948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:37:58.350948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 15:37:58.350948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:58.350948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 246/500] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:58.351703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9a843-93b7-4731-abd3-78423e5345c1 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:58.404115 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 255/501] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:58.405436 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290f264-9503-411b-999e-35829b9a1485 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:58.406027 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290f264-9503-411b-999e-35829b9a1485 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:58.406308 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290f264-9503-411b-999e-35829b9a1485 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:58.411858 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 256/502] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:37:58.411858 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290f264-9503-411b-999e-35829b9a1485 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:58.451651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:58.470988 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9a843-93b7-4731-abd3-78423e5345c1 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:58.505277 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cea6d5-1478-4e7a-8d9a-34ef39247d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:58.506094 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cea6d5-1478-4e7a-8d9a-34ef39247d48 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:58.506375 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cea6d5-1478-4e7a-8d9a-34ef39247d48 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:58.506649 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cea6d5-1478-4e7a-8d9a-34ef39247d48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:58.518155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cea6d5-1478-4e7a-8d9a-34ef39247d48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:58.519681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cea6d5-1478-4e7a-8d9a-34ef39247d48 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:58.532679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290f264-9503-411b-999e-35829b9a1485 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:58.538186 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-29cea6d5-1478-4e7a-8d9a-34ef39247d48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:37:58.538186 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:58.538186 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:58.538186 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:58.538186 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:58.538186 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:58.538186 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:58.538186 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:58.538186 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:58.538186 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:58.538186 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:58.538186 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:58.538186 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:37:58.538186 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:37:58.538186 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:37:58.539050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:37:58.539050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:58.539050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:58.539050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:58.539050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:58.539050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:58.539050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:58.539050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:58.539050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:58.539050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:58.539050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:58.539050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:58.539050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:58.539050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:58.539050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:58.539050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:58.539050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:58.540429 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:37:58.540429 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:37:58.540429 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:37:58.540429 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:58.540429 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 247/503] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:58.540429 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cea6d5-1478-4e7a-8d9a-34ef39247d48 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:58.562558 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:58.575178 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d8a65-d8fd-4f36-8f20-3ef988da1748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:58.575827 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d8a65-d8fd-4f36-8f20-3ef988da1748 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:58.576110 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d8a65-d8fd-4f36-8f20-3ef988da1748 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:58.576387 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d8a65-d8fd-4f36-8f20-3ef988da1748 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:58.651249 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cea6d5-1478-4e7a-8d9a-34ef39247d48 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:58.660370 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d8a65-d8fd-4f36-8f20-3ef988da1748 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:58.661846 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d8a65-d8fd-4f36-8f20-3ef988da1748 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:58.687067 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb5a1b-dc1d-4395-b2ec-4d9d4161cc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:58.687744 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb5a1b-dc1d-4395-b2ec-4d9d4161cc33 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:58.688032 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb5a1b-dc1d-4395-b2ec-4d9d4161cc33 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:58.688312 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb5a1b-dc1d-4395-b2ec-4d9d4161cc33 None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:58.689155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb5a1b-dc1d-4395-b2ec-4d9d4161cc33 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:58.689463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb5a1b-dc1d-4395-b2ec-4d9d4161cc33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:58.690927 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb5a1b-dc1d-4395-b2ec-4d9d4161cc33 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:58.703287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:58.733983 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 248/504] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Jun 23 15:37:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:58.735356 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd5b6e-4550-4359-94ed-f08e04d2dc69 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:58.735650 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd5b6e-4550-4359-94ed-f08e04d2dc69 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:58.736138 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd5b6e-4550-4359-94ed-f08e04d2dc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:58.752406 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-6abd5b6e-4550-4359-94ed-f08e04d2dc69 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:37:58.753611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-6abd5b6e-4550-4359-94ed-f08e04d2dc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:37:58.783113 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 257/505] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:37:58.783889 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d8a65-d8fd-4f36-8f20-3ef988da1748 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:58.814048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:58.827638 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 249/506] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:37:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:37:58.828501 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd5b6e-4550-4359-94ed-f08e04d2dc69 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:58.900846 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d8a65-d8fd-4f36-8f20-3ef988da1748 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:58.938212 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11c79a-942b-4fab-81f8-08f14466ce16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:58.944167 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11c79a-942b-4fab-81f8-08f14466ce16 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:58.944317 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd5b6e-4550-4359-94ed-f08e04d2dc69 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:58.944407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11c79a-942b-4fab-81f8-08f14466ce16 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:58.944407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11c79a-942b-4fab-81f8-08f14466ce16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:58.950424 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11c79a-942b-4fab-81f8-08f14466ce16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:37:58.958132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-6f11c79a-942b-4fab-81f8-08f14466ce16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:37:58.958132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:58.958132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:58.958132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:58.958132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:58.958132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:58.958132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:58.958132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:58.958132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:58.958132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:58.958132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:58.958132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:58.958132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:37:58.958132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:37:58.958132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:37:58.958132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:37:58.959069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:37:58.959069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:37:58.959069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:37:58.959069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:37:58.959069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:58.959069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:58.959069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:58.959069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:58.959069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:58.959069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:58.959069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:58.959069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:58.959069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:58.959069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:58.959069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:58.959069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:58.959848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:58.959848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:58.959848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:58.959848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:58.959848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:37:58.959848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:37:58.959848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:37:58.959848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:37:58.959848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:37:58.959848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:37:58.959848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:37:58.959848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:37:58.959848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 258/507] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 23 15:37:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:58.960519 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11c79a-942b-4fab-81f8-08f14466ce16 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:58.972765 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:58.985267 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f05a22-11ad-4dd1-bc5f-289fc18c8a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:58.985960 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f05a22-11ad-4dd1-bc5f-289fc18c8a18 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:58.986243 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f05a22-11ad-4dd1-bc5f-289fc18c8a18 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:58.986515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f05a22-11ad-4dd1-bc5f-289fc18c8a18 None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:58.987238 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f05a22-11ad-4dd1-bc5f-289fc18c8a18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:58.987548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f05a22-11ad-4dd1-bc5f-289fc18c8a18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:58.988933 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f05a22-11ad-4dd1-bc5f-289fc18c8a18 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:59.001062 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 250/508] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:59.002143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f05a22-11ad-4dd1-bc5f-289fc18c8a18 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:59.060011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:59.079489 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11c79a-942b-4fab-81f8-08f14466ce16 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:59.113081 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f05a22-11ad-4dd1-bc5f-289fc18c8a18 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:59.113287 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b92832-973c-4a1f-9e1d-5e49717cafc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:59.113728 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b92832-973c-4a1f-9e1d-5e49717cafc8 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:59.114043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b92832-973c-4a1f-9e1d-5e49717cafc8 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:59.114313 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b92832-973c-4a1f-9e1d-5e49717cafc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:59.148515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01372f8-411b-479b-bebd-ca7e7ba06c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:59.149308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01372f8-411b-479b-bebd-ca7e7ba06c4a None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:59.149595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01372f8-411b-479b-bebd-ca7e7ba06c4a None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:59.149993 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01372f8-411b-479b-bebd-ca7e7ba06c4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:59.161688 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01372f8-411b-479b-bebd-ca7e7ba06c4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:59.163200 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01372f8-411b-479b-bebd-ca7e7ba06c4a None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:59.180859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-d01372f8-411b-479b-bebd-ca7e7ba06c4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:37:59.180859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:59.180859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:59.180859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:59.180859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:59.180859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:59.180859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:59.180859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:59.180859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:59.180859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:59.180859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:59.180859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:59.180859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:37:59.180859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:37:59.180859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:37:59.182651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:37:59.182651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:59.182651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:59.182651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:59.182651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:59.182651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:59.182651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:59.182651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:59.182651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:59.182651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:59.182651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:59.182651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:59.182651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:59.182651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:59.182651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:59.182651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:59.182651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:59.184406 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:37:59.184406 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:37:59.184406 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:37:59.184406 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:59.184406 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 251/509] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:59.184406 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01372f8-411b-479b-bebd-ca7e7ba06c4a None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:59.194891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b92832-973c-4a1f-9e1d-5e49717cafc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:59.196354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b92832-973c-4a1f-9e1d-5e49717cafc8 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:59.221212 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:59.281519 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:59.289045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01372f8-411b-479b-bebd-ca7e7ba06c4a None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:59.301353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 259/510] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:37:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:37:59.302247 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b92832-973c-4a1f-9e1d-5e49717cafc8 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:59.327093 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eebe75-50e8-417c-ba1b-14ab4c25a2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:59.327809 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eebe75-50e8-417c-ba1b-14ab4c25a2b0 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:59.328094 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eebe75-50e8-417c-ba1b-14ab4c25a2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:59.328370 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eebe75-50e8-417c-ba1b-14ab4c25a2b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:59.340437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eebe75-50e8-417c-ba1b-14ab4c25a2b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:59.342007 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eebe75-50e8-417c-ba1b-14ab4c25a2b0 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:59.360105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-04eebe75-50e8-417c-ba1b-14ab4c25a2b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:37:59.360105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:59.360105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:59.360105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:59.360105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:59.360105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:59.360105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:59.360105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:59.360105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:59.360105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:59.360105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:59.360105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:59.360105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:37:59.360105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:37:59.360105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:37:59.361019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:37:59.361019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:59.361019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:59.361019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:59.361019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:59.361019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:59.361019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:59.361019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:59.361019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:59.361019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:59.361019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:59.361019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:59.361019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:59.361019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:59.361019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:59.361019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:59.361019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:59.362341 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:37:59.362341 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:37:59.362341 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:37:59.362341 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:59.362341 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 252/511] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:59.362341 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eebe75-50e8-417c-ba1b-14ab4c25a2b0 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:59.420891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b92832-973c-4a1f-9e1d-5e49717cafc8 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:59.455272 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:59.472925 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4c6c8-3a56-4d68-ba15-15a1e5724cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:59.472925 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4c6c8-3a56-4d68-ba15-15a1e5724cb6 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:59.473220 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4c6c8-3a56-4d68-ba15-15a1e5724cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:59.473300 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4c6c8-3a56-4d68-ba15-15a1e5724cb6 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:59.473948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eebe75-50e8-417c-ba1b-14ab4c25a2b0 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:59.474286 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4c6c8-3a56-4d68-ba15-15a1e5724cb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:59.474592 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4c6c8-3a56-4d68-ba15-15a1e5724cb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:59.475979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4c6c8-3a56-4d68-ba15-15a1e5724cb6 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:59.489585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 260/512] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 23 15:37:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:59.490252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4c6c8-3a56-4d68-ba15-15a1e5724cb6 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:59.514646 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e1c38-9c5b-4a1c-ae84-f79c276bcc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:59.515553 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e1c38-9c5b-4a1c-ae84-f79c276bcc8b None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:59.515837 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e1c38-9c5b-4a1c-ae84-f79c276bcc8b None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:59.516109 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e1c38-9c5b-4a1c-ae84-f79c276bcc8b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:59.523873 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e1c38-9c5b-4a1c-ae84-f79c276bcc8b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:59.525317 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e1c38-9c5b-4a1c-ae84-f79c276bcc8b None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:59.535726 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:59.540840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-b67e1c38-9c5b-4a1c-ae84-f79c276bcc8b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 15:37:59.540840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:59.540840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:59.540840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:59.540840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:59.540840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:59.540840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:59.540840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:59.540840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:59.540840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:59.540840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:59.540840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:59.540840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:37:59.540840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:37:59.540840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:37:59.540840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:37:59.541730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:59.541730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:59.541730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:37:59.541730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:37:59.541730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:37:59.541730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:37:59.541730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:59.541730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:59.541730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:59.541730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:59.541730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:59.541730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:59.541730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:59.541730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:59.541730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:59.541730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:59.541730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:59.541730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:59.542660 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:59.542660 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:59.542660 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:37:59.542660 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:37:59.542660 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:37:59.542660 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:37:59.542660 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:37:59.542660 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:37:59.542660 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 15:37:59.542660 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:59.542660 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 253/513] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:37:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:59.543296 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e1c38-9c5b-4a1c-ae84-f79c276bcc8b None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:59.603432 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4c6c8-3a56-4d68-ba15-15a1e5724cb6 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:59.643267 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2df52-d3f6-4acb-8be0-f133d8c943c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:59.644212 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2df52-d3f6-4acb-8be0-f133d8c943c4 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:59.644498 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2df52-d3f6-4acb-8be0-f133d8c943c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:59.644775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2df52-d3f6-4acb-8be0-f133d8c943c4 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:59.645499 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2df52-d3f6-4acb-8be0-f133d8c943c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:59.645806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2df52-d3f6-4acb-8be0-f133d8c943c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:59.647228 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2df52-d3f6-4acb-8be0-f133d8c943c4 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:59.660183 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 261/514] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:59.660760 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2df52-d3f6-4acb-8be0-f133d8c943c4 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:59.661023 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e1c38-9c5b-4a1c-ae84-f79c276bcc8b None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:59.700485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113003c-c625-42cc-8d88-1af875e159f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:59.701274 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113003c-c625-42cc-8d88-1af875e159f4 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:59.701558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113003c-c625-42cc-8d88-1af875e159f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:59.701833 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113003c-c625-42cc-8d88-1af875e159f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:59.713507 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113003c-c625-42cc-8d88-1af875e159f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:59.715450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113003c-c625-42cc-8d88-1af875e159f4 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:59.724284 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:59.735118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-0113003c-c625-42cc-8d88-1af875e159f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:37:59.735118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:59.735118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:59.735118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:59.735118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:59.735118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:59.735118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:59.735118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:59.735118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:59.735118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:59.735118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:59.735118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:59.735118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:37:59.735118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:37:59.735118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:37:59.736163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:37:59.736163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:59.736163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:59.736163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:59.736163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:59.736163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:59.736163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:59.736163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:59.736163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:59.736163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:59.736163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:59.736163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:59.736163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:59.736163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:59.736163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:59.736163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:59.736163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:59.737111 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:37:59.737111 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:37:59.737111 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:37:59.737111 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:59.737111 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 254/515] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:59.737111 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113003c-c625-42cc-8d88-1af875e159f4 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:59.766092 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2df52-d3f6-4acb-8be0-f133d8c943c4 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:59.768470 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:59.804070 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f7ccf4-317f-43e9-8de5-173e2971b3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:59.804734 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7ccf4-317f-43e9-8de5-173e2971b3ee None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:59.805017 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7ccf4-317f-43e9-8de5-173e2971b3ee None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:59.805292 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7ccf4-317f-43e9-8de5-173e2971b3ee None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:59.806052 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f7ccf4-317f-43e9-8de5-173e2971b3ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:59.806542 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f7ccf4-317f-43e9-8de5-173e2971b3ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:59.807920 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f7ccf4-317f-43e9-8de5-173e2971b3ee None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:59.819847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 262/516] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:59.820676 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f7ccf4-317f-43e9-8de5-173e2971b3ee None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:59.858525 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113003c-c625-42cc-8d88-1af875e159f4 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:59.893252 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830965a2-a5d7-4cf7-ba74-ad5c8b49b12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:59.894068 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830965a2-a5d7-4cf7-ba74-ad5c8b49b12f None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:59.894346 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830965a2-a5d7-4cf7-ba74-ad5c8b49b12f None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:59.894616 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830965a2-a5d7-4cf7-ba74-ad5c8b49b12f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:59.906154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830965a2-a5d7-4cf7-ba74-ad5c8b49b12f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:59.907611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830965a2-a5d7-4cf7-ba74-ad5c8b49b12f None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:59.925463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-830965a2-a5d7-4cf7-ba74-ad5c8b49b12f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:37:59.925463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:37:59.925463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:37:59.925463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:37:59.925463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:37:59.925463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:37:59.925463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:37:59.925463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:37:59.925463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:37:59.925463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:37:59.925463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:37:59.925463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:37:59.925463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:37:59.925463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:37:59.925463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:37:59.926944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:37:59.926944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:37:59.926944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:37:59.926944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:37:59.926944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:37:59.926944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:37:59.926944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:37:59.926944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:37:59.926944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:37:59.926944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:37:59.926944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:37:59.926944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:37:59.926944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:37:59.926944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:37:59.926944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:37:59.926944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:37:59.926944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:37:59.927747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:37:59.927747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:37:59.927747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:37:59.927747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:37:59.927747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 255/517] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:37:59.928007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f7ccf4-317f-43e9-8de5-173e2971b3ee None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:37:59.928100 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830965a2-a5d7-4cf7-ba74-ad5c8b49b12f None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:37:59.966222 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84711f-7084-4dbe-9595-5d34d1a10595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:37:59.966898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84711f-7084-4dbe-9595-5d34d1a10595 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:37:59.967178 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84711f-7084-4dbe-9595-5d34d1a10595 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:37:59.967456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84711f-7084-4dbe-9595-5d34d1a10595 None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:37:59.968306 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84711f-7084-4dbe-9595-5d34d1a10595 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:37:59.968613 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84711f-7084-4dbe-9595-5d34d1a10595 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:37:59.974175 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84711f-7084-4dbe-9595-5d34d1a10595 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:37:59.985798 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:37:59.989046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 263/518] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Jun 23 15:37:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:37:59.989928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84711f-7084-4dbe-9595-5d34d1a10595 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:00.016925 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:00.035578 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830965a2-a5d7-4cf7-ba74-ad5c8b49b12f None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:00.070340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb128c-bda3-4a4e-90c9-3f8b02223b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:00.071140 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb128c-bda3-4a4e-90c9-3f8b02223b6d None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:00.071428 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb128c-bda3-4a4e-90c9-3f8b02223b6d None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:00.071710 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb128c-bda3-4a4e-90c9-3f8b02223b6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:00.078853 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb128c-bda3-4a4e-90c9-3f8b02223b6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:00.080320 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb128c-bda3-4a4e-90c9-3f8b02223b6d None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:00.095338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-ffcb128c-bda3-4a4e-90c9-3f8b02223b6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:00.095338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:00.095338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:00.095338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:00.095338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:00.095338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:00.095338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:00.095338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:00.095338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:00.095338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:00.095338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:00.095338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:00.095338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:00.095338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:00.095338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:00.096194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:00.096194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:00.096194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:00.096194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:00.096194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:00.096194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:00.096194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:00.096194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:00.096194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:00.096194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:00.096194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:00.096194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:00.096194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:00.096194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:00.096194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:00.096194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:00.096194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:00.097024 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:00.097024 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:00.097024 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:00.097024 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:00.097024 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:00.097024 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:00.097024 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:00.097024 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:00.097024 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 256/519] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:37:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:00.097477 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84711f-7084-4dbe-9595-5d34d1a10595 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:00.097876 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb128c-bda3-4a4e-90c9-3f8b02223b6d None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:00.134443 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e3140-89b5-4868-bceb-897f1d257111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:00.135033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e3140-89b5-4868-bceb-897f1d257111 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:00.135319 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e3140-89b5-4868-bceb-897f1d257111 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:00.135592 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e3140-89b5-4868-bceb-897f1d257111 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:00.136320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e3140-89b5-4868-bceb-897f1d257111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:00.136625 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e3140-89b5-4868-bceb-897f1d257111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:00.138532 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e3140-89b5-4868-bceb-897f1d257111 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:00.154934 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 264/520] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:00.156039 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e3140-89b5-4868-bceb-897f1d257111 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:00.216271 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb128c-bda3-4a4e-90c9-3f8b02223b6d None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:00.231075 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:00.238451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:00.253667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452140cf-18fd-495c-8ec9-e1a56b949b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:00.254367 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452140cf-18fd-495c-8ec9-e1a56b949b52 None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:00.254654 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452140cf-18fd-495c-8ec9-e1a56b949b52 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:00.254930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452140cf-18fd-495c-8ec9-e1a56b949b52 None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:00.255632 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452140cf-18fd-495c-8ec9-e1a56b949b52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:00.257063 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452140cf-18fd-495c-8ec9-e1a56b949b52 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:00.264467 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e3140-89b5-4868-bceb-897f1d257111 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:00.277813 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 257/521] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 23 15:38:00 2022] POST /identity/v3/users => generated 247 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:38:00.278699 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452140cf-18fd-495c-8ec9-e1a56b949b52 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:00.313602 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3311b33-54b1-4de6-8764-e584943f52b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:00.314328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3311b33-54b1-4de6-8764-e584943f52b7 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:00.315594 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3311b33-54b1-4de6-8764-e584943f52b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:00.315594 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3311b33-54b1-4de6-8764-e584943f52b7 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:00.315769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3311b33-54b1-4de6-8764-e584943f52b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:00.316069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3311b33-54b1-4de6-8764-e584943f52b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:00.317411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3311b33-54b1-4de6-8764-e584943f52b7 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:00.331262 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 265/522] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:00.334923 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3311b33-54b1-4de6-8764-e584943f52b7 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:00.413755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452140cf-18fd-495c-8ec9-e1a56b949b52 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:00.459810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3311b33-54b1-4de6-8764-e584943f52b7 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:00.466343 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc2a70-4678-48e9-b086-d7c95a582786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:00.467003 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc2a70-4678-48e9-b086-d7c95a582786 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:00.467285 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc2a70-4678-48e9-b086-d7c95a582786 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:00.467557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc2a70-4678-48e9-b086-d7c95a582786 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:00.509381 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4f94f-b356-4135-9559-f7ce25b27a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:00.510383 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4f94f-b356-4135-9559-f7ce25b27a5f None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:00.510924 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4f94f-b356-4135-9559-f7ce25b27a5f None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:00.511213 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4f94f-b356-4135-9559-f7ce25b27a5f None admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:00.512462 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:00.513849 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4f94f-b356-4135-9559-f7ce25b27a5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:00.514081 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4f94f-b356-4135-9559-f7ce25b27a5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:00.515645 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4f94f-b356-4135-9559-f7ce25b27a5f None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:00.537574 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 266/523] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:00.538476 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4f94f-b356-4135-9559-f7ce25b27a5f None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:00.541529 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:00.570452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc2a70-4678-48e9-b086-d7c95a582786 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:00.576766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc2a70-4678-48e9-b086-d7c95a582786 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:00.668610 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4f94f-b356-4135-9559-f7ce25b27a5f None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:00.696551 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 258/524] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:38:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:38:00.702240 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc2a70-4678-48e9-b086-d7c95a582786 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:00.708218 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f30bc6-83a5-466a-b2a2-298c931e586c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:00.708970 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f30bc6-83a5-466a-b2a2-298c931e586c None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:00.709256 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f30bc6-83a5-466a-b2a2-298c931e586c None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:00.709660 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f30bc6-83a5-466a-b2a2-298c931e586c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:00.718197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f30bc6-83a5-466a-b2a2-298c931e586c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:00.719654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f30bc6-83a5-466a-b2a2-298c931e586c None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:00.734219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-a5f30bc6-83a5-466a-b2a2-298c931e586c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:00.734219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:00.734219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:00.734219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:00.734219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:00.734219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:00.734219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:00.734219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:00.734219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:00.734219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:00.734219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:00.734219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:00.734219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:00.734219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:00.734219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:00.735132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:00.735132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:00.735132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:00.735132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:00.735132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:00.735132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:00.735132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:00.735132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:00.735132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:00.735132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:00.735132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:00.735132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:00.735132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:00.735132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:00.735132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:00.735132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:00.735132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:00.736035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:00.736035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:00.736035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:00.736035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:00.736035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:00.736035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:00.736035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:00.736035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:00.736035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 267/525] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:00.736596 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f30bc6-83a5-466a-b2a2-298c931e586c None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:00.780334 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:00.806229 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:00.822142 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc2a70-4678-48e9-b086-d7c95a582786 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:00.857293 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f30bc6-83a5-466a-b2a2-298c931e586c None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:00.864271 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e4418-6cc3-46ec-adcb-21f3f5c9a7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:00.865764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e4418-6cc3-46ec-adcb-21f3f5c9a7c2 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:00.866076 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e4418-6cc3-46ec-adcb-21f3f5c9a7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:00.866349 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e4418-6cc3-46ec-adcb-21f3f5c9a7c2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:00.876784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e4418-6cc3-46ec-adcb-21f3f5c9a7c2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:00.878295 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e4418-6cc3-46ec-adcb-21f3f5c9a7c2 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:00.892884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947a837-4871-42a4-a44f-073406bb6e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:00.893531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-531e4418-6cc3-46ec-adcb-21f3f5c9a7c2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 15:38:00.893531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:00.893531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:00.893531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:00.893531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:00.893531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:00.893531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:00.893531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:00.893531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:00.893531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:00.893531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:00.893531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:00.893531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:38:00.893531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:38:00.893531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:38:00.893531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:38:00.894557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:00.894557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:00.894557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:00.894557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:00.894557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:00.894557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:00.894557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:00.894557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:00.894557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:00.894557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:00.894557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:00.894557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:00.894557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:00.894557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:00.894557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:00.894557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:00.894557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:00.894557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:00.900492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:00.900492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:00.900492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:38:00.900492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:38:00.900492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:38:00.900492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:38:00.900492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:38:00.900492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:38:00.900492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 15:38:00.900492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:00.901003 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947a837-4871-42a4-a44f-073406bb6e28 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:00.901003 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947a837-4871-42a4-a44f-073406bb6e28 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:00.901003 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5947a837-4871-42a4-a44f-073406bb6e28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:00.901003 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947a837-4871-42a4-a44f-073406bb6e28 None admin] RBAC: Adding query filter params (role.id=e004305755a2468aa60ab6632d39207a, scope.project.id=ff90b874f5b84d28a2752bc95419ad95, user.id=d54521ea1dca44c98d6723d0b9fd6468) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:00.901236 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 259/526] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 23 15:38:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:00.901312 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947a837-4871-42a4-a44f-073406bb6e28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:00.901378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e4418-6cc3-46ec-adcb-21f3f5c9a7c2 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:00.901526 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5947a837-4871-42a4-a44f-073406bb6e28 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:00.904833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 268/527] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:38:00 2022] GET /identity/v3/role_assignments?user.id=d54521ea1dca44c98d6723d0b9fd6468&scope.project.id=ff90b874f5b84d28a2752bc95419ad95&role.id=e004305755a2468aa60ab6632d39207a => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:00.906210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947a837-4871-42a4-a44f-073406bb6e28 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:01.036004 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e4418-6cc3-46ec-adcb-21f3f5c9a7c2 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:01.062990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5947a837-4871-42a4-a44f-073406bb6e28 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:01.071891 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:01.082667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca8446-abec-4fbc-8c54-6daf67f6680c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:01.084862 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca8446-abec-4fbc-8c54-6daf67f6680c None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:01.085647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca8446-abec-4fbc-8c54-6daf67f6680c None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:01.086244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca8446-abec-4fbc-8c54-6daf67f6680c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:01.098849 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca8446-abec-4fbc-8c54-6daf67f6680c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:01.100685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca8446-abec-4fbc-8c54-6daf67f6680c None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:01.105781 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:01.118770 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5cde2-ecde-4173-bcfa-0f8f6e6a1fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:01.119447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5cde2-ecde-4173-bcfa-0f8f6e6a1fc9 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:01.119730 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5cde2-ecde-4173-bcfa-0f8f6e6a1fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:01.120009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d5cde2-ecde-4173-bcfa-0f8f6e6a1fc9 None admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:01.120808 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d5cde2-ecde-4173-bcfa-0f8f6e6a1fc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:01.121118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d5cde2-ecde-4173-bcfa-0f8f6e6a1fc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:01.123141 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d5cde2-ecde-4173-bcfa-0f8f6e6a1fc9 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:01.132069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-4dca8446-abec-4fbc-8c54-6daf67f6680c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:01.132069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:01.132069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:01.132069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:01.132069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:01.132069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:01.132069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:01.132069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:01.132069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:01.132069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:01.132069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:01.132069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:01.132069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:01.132069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:01.132069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:01.132937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:01.132937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:01.132937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:01.132937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:01.132937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:01.132937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:01.132937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:01.132937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:01.132937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:01.132937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:01.132937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:01.132937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:01.132937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:01.132937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:01.132937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:01.132937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:01.132937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:01.133825 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:01.133825 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:01.133825 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:01.133825 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:01.140436 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 260/528] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:01.140436 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca8446-abec-4fbc-8c54-6daf67f6680c None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:01.143110 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 269/529] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:01.144270 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5cde2-ecde-4173-bcfa-0f8f6e6a1fc9 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:01.265680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca8446-abec-4fbc-8c54-6daf67f6680c None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:01.281023 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d5cde2-ecde-4173-bcfa-0f8f6e6a1fc9 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:01.309814 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade92a87-8397-4ebe-a14b-f3366e42cc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:01.311015 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade92a87-8397-4ebe-a14b-f3366e42cc45 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:01.311411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade92a87-8397-4ebe-a14b-f3366e42cc45 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:01.311695 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade92a87-8397-4ebe-a14b-f3366e42cc45 None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:01.312537 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade92a87-8397-4ebe-a14b-f3366e42cc45 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:01.312853 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade92a87-8397-4ebe-a14b-f3366e42cc45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:01.315072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade92a87-8397-4ebe-a14b-f3366e42cc45 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:01.319066 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dff621-d18d-49ea-90de-a8c1ee98d24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:01.319986 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dff621-d18d-49ea-90de-a8c1ee98d24c None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:01.320503 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dff621-d18d-49ea-90de-a8c1ee98d24c None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:01.320974 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dff621-d18d-49ea-90de-a8c1ee98d24c None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:01.321941 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dff621-d18d-49ea-90de-a8c1ee98d24c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:01.322452 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dff621-d18d-49ea-90de-a8c1ee98d24c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:01.324079 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dff621-d18d-49ea-90de-a8c1ee98d24c None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:01.339712 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 261/530] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Jun 23 15:38:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:01.339712 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade92a87-8397-4ebe-a14b-f3366e42cc45 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:01.343289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 270/531] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:01.344486 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dff621-d18d-49ea-90de-a8c1ee98d24c None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:01.386396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:01.399872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:01.461376 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade92a87-8397-4ebe-a14b-f3366e42cc45 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:01.479191 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dff621-d18d-49ea-90de-a8c1ee98d24c None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:01.499272 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3130ba-17b4-4c91-8384-924f5a86ab7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:01.500620 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3130ba-17b4-4c91-8384-924f5a86ab7a None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:01.501016 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3130ba-17b4-4c91-8384-924f5a86ab7a None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:01.501398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3130ba-17b4-4c91-8384-924f5a86ab7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:01.502739 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3130ba-17b4-4c91-8384-924f5a86ab7a None admin] RBAC: Adding query filter params (role.id=e004305755a2468aa60ab6632d39207a, scope.project.id=ff90b874f5b84d28a2752bc95419ad95, user.id=79239c95306c43f0a1a0b51715440009) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:01.503177 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3130ba-17b4-4c91-8384-924f5a86ab7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:01.505423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3130ba-17b4-4c91-8384-924f5a86ab7a None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:01.521901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 262/532] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:38:01 2022] GET /identity/v3/role_assignments?user.id=79239c95306c43f0a1a0b51715440009&scope.project.id=ff90b874f5b84d28a2752bc95419ad95&role.id=e004305755a2468aa60ab6632d39207a => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:01.521901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3130ba-17b4-4c91-8384-924f5a86ab7a None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:01.545542 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb184354-af9f-40ff-bd41-18cadbf57528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:01.545542 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb184354-af9f-40ff-bd41-18cadbf57528 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:01.545542 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb184354-af9f-40ff-bd41-18cadbf57528 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:01.545872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb184354-af9f-40ff-bd41-18cadbf57528 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:01.701736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb184354-af9f-40ff-bd41-18cadbf57528 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:01.703855 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb184354-af9f-40ff-bd41-18cadbf57528 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:01.735491 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3130ba-17b4-4c91-8384-924f5a86ab7a None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:01.750257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:01.788227 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:01.814555 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2e49f-01ac-45ef-83f9-904e5e6acda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:01.816392 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2e49f-01ac-45ef-83f9-904e5e6acda7 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:01.817062 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2e49f-01ac-45ef-83f9-904e5e6acda7 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:01.818795 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2e49f-01ac-45ef-83f9-904e5e6acda7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:01.833686 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2e49f-01ac-45ef-83f9-904e5e6acda7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:01.835545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2e49f-01ac-45ef-83f9-904e5e6acda7 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:01.860248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-aeb2e49f-01ac-45ef-83f9-904e5e6acda7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:01.860248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:01.860248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:01.860248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:01.860248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:01.860248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:01.860248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:01.860248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:01.860248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:01.860248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:01.860248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:01.860248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:01.860248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:01.860248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:01.860248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:01.861153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:01.861153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:01.861153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:01.861153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:01.861153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:01.861153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:01.861153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:01.861153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:01.861153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:01.861153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:01.861153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:01.861153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:01.861153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:01.861153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:01.861153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:01.861153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:01.861153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:01.862008 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:01.862008 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:01.862008 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:01.862008 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:01.862008 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:01.862008 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:01.862008 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:01.862008 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:01.864198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 263/533] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:01.869848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2e49f-01ac-45ef-83f9-904e5e6acda7 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:01.896359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 271/534] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:38:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:38:01.903759 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb184354-af9f-40ff-bd41-18cadbf57528 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:02.069222 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2e49f-01ac-45ef-83f9-904e5e6acda7 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:02.121749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb184354-af9f-40ff-bd41-18cadbf57528 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:02.131565 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b9451-2cb4-4aa8-9ee6-bbc048d1ec96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:02.132559 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b9451-2cb4-4aa8-9ee6-bbc048d1ec96 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:02.133066 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b9451-2cb4-4aa8-9ee6-bbc048d1ec96 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:02.133565 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b9451-2cb4-4aa8-9ee6-bbc048d1ec96 None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:02.134609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b9451-2cb4-4aa8-9ee6-bbc048d1ec96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:02.135112 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b9451-2cb4-4aa8-9ee6-bbc048d1ec96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:02.137828 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b9451-2cb4-4aa8-9ee6-bbc048d1ec96 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:02.175394 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 264/535] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:02.181665 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b9451-2cb4-4aa8-9ee6-bbc048d1ec96 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:02.196408 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ba8a8-cefd-4ea6-97a3-822b7b7e5ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:02.197219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ba8a8-cefd-4ea6-97a3-822b7b7e5ae7 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:02.197500 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ba8a8-cefd-4ea6-97a3-822b7b7e5ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:02.197772 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ba8a8-cefd-4ea6-97a3-822b7b7e5ae7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:02.214472 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ba8a8-cefd-4ea6-97a3-822b7b7e5ae7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:02.216496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ba8a8-cefd-4ea6-97a3-822b7b7e5ae7 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:02.233030 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:02.243336 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:02.246266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-152ba8a8-cefd-4ea6-97a3-822b7b7e5ae7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:02.246266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:02.246266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:02.246266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:02.246266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:02.246266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:02.246266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:02.246266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:02.246266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:02.246266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:02.246266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:02.246266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:02.246266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:02.246266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:02.246266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:02.247910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:02.247910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:02.247910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:02.247910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:02.247910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:02.247910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:02.247910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:02.247910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:02.247910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:02.247910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:02.247910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:02.247910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:02.247910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:02.247910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:02.247910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:02.247910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:02.247910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:02.249303 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:02.249303 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:02.249303 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:02.249303 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:02.253368 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 272/536] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:02.254772 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ba8a8-cefd-4ea6-97a3-822b7b7e5ae7 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:02.392345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b9451-2cb4-4aa8-9ee6-bbc048d1ec96 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:02.407019 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ba8a8-cefd-4ea6-97a3-822b7b7e5ae7 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:02.443819 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad1f70-c6c3-45ce-939d-fda66bce714c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:02.444208 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad1f70-c6c3-45ce-939d-fda66bce714c None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:02.444389 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad1f70-c6c3-45ce-939d-fda66bce714c None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:02.444622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad1f70-c6c3-45ce-939d-fda66bce714c None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:02.445349 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad1f70-c6c3-45ce-939d-fda66bce714c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:02.445654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad1f70-c6c3-45ce-939d-fda66bce714c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:02.447177 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad1f70-c6c3-45ce-939d-fda66bce714c None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:02.459670 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 273/537] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:02.465129 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad1f70-c6c3-45ce-939d-fda66bce714c None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:02.497049 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe14e8-b4fe-4e53-8d12-78796492f965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:02.502140 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe14e8-b4fe-4e53-8d12-78796492f965 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:02.503126 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe14e8-b4fe-4e53-8d12-78796492f965 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:02.503553 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe14e8-b4fe-4e53-8d12-78796492f965 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:02.504593 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe14e8-b4fe-4e53-8d12-78796492f965 None admin] RBAC: Adding query filter params (role.id=e004305755a2468aa60ab6632d39207a, scope.project.id=ff90b874f5b84d28a2752bc95419ad95, user.id=b524afb3b4b24025ad8bef85aa64bd91) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:02.505066 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe14e8-b4fe-4e53-8d12-78796492f965 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:02.506688 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe14e8-b4fe-4e53-8d12-78796492f965 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:02.524969 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 265/538] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:38:02 2022] GET /identity/v3/role_assignments?user.id=b524afb3b4b24025ad8bef85aa64bd91&scope.project.id=ff90b874f5b84d28a2752bc95419ad95&role.id=e004305755a2468aa60ab6632d39207a => generated 259 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:02.542323 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:02.558223 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67af38-826f-42ae-a8ae-71fe27daa560 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:02.558836 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67af38-826f-42ae-a8ae-71fe27daa560 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:02.559369 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67af38-826f-42ae-a8ae-71fe27daa560 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:02.561165 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 266/539] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:38:02.567296 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7f8c1-42dd-4ed7-acd2-3561f821d99f None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:02.567658 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7f8c1-42dd-4ed7-acd2-3561f821d99f None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:02.568004 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7f8c1-42dd-4ed7-acd2-3561f821d99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:02.586948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-6ae7f8c1-42dd-4ed7-acd2-3561f821d99f None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:02.588645 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-6ae7f8c1-42dd-4ed7-acd2-3561f821d99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:02.623577 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad1f70-c6c3-45ce-939d-fda66bce714c None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:02.692131 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9de45-5978-4713-a8bb-378b1e2907c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:02.692885 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9de45-5978-4713-a8bb-378b1e2907c4 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:02.693169 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9de45-5978-4713-a8bb-378b1e2907c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:02.693444 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9de45-5978-4713-a8bb-378b1e2907c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:02.707611 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9de45-5978-4713-a8bb-378b1e2907c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:02.709106 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9de45-5978-4713-a8bb-378b1e2907c4 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:02.727830 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 267/540] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 15:38:02.734703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-51b9de45-5978-4713-a8bb-378b1e2907c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:02.734703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:02.734703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:02.734703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:02.734703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:02.734703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:02.734703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:02.734703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:02.734703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:02.734703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:02.734703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:02.734703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:02.734703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:02.734703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:02.734703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:02.735516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:02.735516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:02.735516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:02.735516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:02.735516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:02.735516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:02.735516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:02.735516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:02.735516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:02.735516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:02.735516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:02.735516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:02.735516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:02.735516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:02.735516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:02.735516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:02.735516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:02.736736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:02.736736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:02.736736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:02.736736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:02.736736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:02.736736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:02.736736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:02.736736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:02.736736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 274/541] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:38:02.743279 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7f8c1-42dd-4ed7-acd2-3561f821d99f None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:02.756659 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9de45-5978-4713-a8bb-378b1e2907c4 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:02.774802 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:02.926887 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9de45-5978-4713-a8bb-378b1e2907c4 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:02.954288 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:02.966432 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864a9ac-37f0-484f-b495-6886824e5fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:02.967244 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864a9ac-37f0-484f-b495-6886824e5fd8 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:02.967528 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864a9ac-37f0-484f-b495-6886824e5fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:02.967799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864a9ac-37f0-484f-b495-6886824e5fd8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:02.970465 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7f8c1-42dd-4ed7-acd2-3561f821d99f None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:02.979921 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864a9ac-37f0-484f-b495-6886824e5fd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:38:02.987997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-c864a9ac-37f0-484f-b495-6886824e5fd8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:02.987997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:02.987997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:02.987997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:02.987997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:02.987997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:02.987997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:02.987997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:02.987997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:02.987997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:02.987997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:02.987997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:02.987997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:38:02.987997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:38:02.987997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:38:02.987997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:38:02.988947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:38:02.988947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:38:02.988947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:38:02.988947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:38:02.988947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:02.988947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:02.988947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:02.988947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:02.988947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:02.988947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:02.988947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:02.988947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:02.988947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:02.988947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:02.988947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:02.988947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:02.990160 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:02.990160 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:02.990160 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:02.990160 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:02.990160 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:38:02.990160 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:38:02.990160 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:38:02.990160 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:38:02.990160 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:38:02.990160 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:38:02.990160 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:02.990160 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:02.990160 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 275/542] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 23 15:38:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:38:02.995014 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864a9ac-37f0-484f-b495-6886824e5fd8 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:03.088340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369499b-798b-4069-8c9f-49f914cef1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:03.089016 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369499b-798b-4069-8c9f-49f914cef1a7 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:03.089304 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369499b-798b-4069-8c9f-49f914cef1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:03.089582 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369499b-798b-4069-8c9f-49f914cef1a7 None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:03.090447 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369499b-798b-4069-8c9f-49f914cef1a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:03.091416 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369499b-798b-4069-8c9f-49f914cef1a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:03.092990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4369499b-798b-4069-8c9f-49f914cef1a7 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:03.101265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864a9ac-37f0-484f-b495-6886824e5fd8 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:03.105899 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 268/543] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:03.107419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c94d7-881a-404d-a9be-adf8ffa79c1c None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:03.107714 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c94d7-881a-404d-a9be-adf8ffa79c1c None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:03.107997 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c94d7-881a-404d-a9be-adf8ffa79c1c None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:03.113892 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 269/544] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:03.114839 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c94d7-881a-404d-a9be-adf8ffa79c1c None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:03.141146 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7148003-a09f-4b48-869d-9dd75b946974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:03.141833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7148003-a09f-4b48-869d-9dd75b946974 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:03.142148 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7148003-a09f-4b48-869d-9dd75b946974 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:03.142428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7148003-a09f-4b48-869d-9dd75b946974 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:03.143293 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7148003-a09f-4b48-869d-9dd75b946974 None admin] RBAC: Adding query filter params (name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:03.143484 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7148003-a09f-4b48-869d-9dd75b946974 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:03.145257 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7148003-a09f-4b48-869d-9dd75b946974 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:03.156118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 276/545] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 23 15:38:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:03.160653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0aec3c-786b-43f7-a10d-bb8b970537aa None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:03.160653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0aec3c-786b-43f7-a10d-bb8b970537aa None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:03.160653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0aec3c-786b-43f7-a10d-bb8b970537aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:03.177175 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-fc0aec3c-786b-43f7-a10d-bb8b970537aa None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:03.178483 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-fc0aec3c-786b-43f7-a10d-bb8b970537aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:03.221724 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:03.223081 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:03.248935 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c94d7-881a-404d-a9be-adf8ffa79c1c None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:03.263039 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 277/546] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:38:03.264165 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0aec3c-786b-43f7-a10d-bb8b970537aa None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:03.311803 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e199d8-0873-432b-ac3c-577be16d1dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:03.312768 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e199d8-0873-432b-ac3c-577be16d1dfa None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:03.313222 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e199d8-0873-432b-ac3c-577be16d1dfa None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:03.313693 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e199d8-0873-432b-ac3c-577be16d1dfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:03.314764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e199d8-0873-432b-ac3c-577be16d1dfa None admin] RBAC: Adding query filter params (role.id=e004305755a2468aa60ab6632d39207a, scope.project.id=ff90b874f5b84d28a2752bc95419ad95, user.id=44e9fc6def5341a589221350067bb0fa) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:03.315281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e199d8-0873-432b-ac3c-577be16d1dfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:03.316953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e199d8-0873-432b-ac3c-577be16d1dfa None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:03.323425 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 270/547] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:38:03 2022] GET /identity/v3/role_assignments?user.id=44e9fc6def5341a589221350067bb0fa&scope.project.id=ff90b874f5b84d28a2752bc95419ad95&role.id=e004305755a2468aa60ab6632d39207a => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:03.324575 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e199d8-0873-432b-ac3c-577be16d1dfa None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:03.388176 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0aec3c-786b-43f7-a10d-bb8b970537aa None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:03.428642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef6230-e83b-478e-ae8e-eb77a2f962f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:03.429475 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef6230-e83b-478e-ae8e-eb77a2f962f8 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:03.429765 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef6230-e83b-478e-ae8e-eb77a2f962f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:03.430082 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef6230-e83b-478e-ae8e-eb77a2f962f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:03.450859 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef6230-e83b-478e-ae8e-eb77a2f962f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:03.452682 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aef6230-e83b-478e-ae8e-eb77a2f962f8 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:03.461772 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e199d8-0873-432b-ac3c-577be16d1dfa None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:03.481971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-0aef6230-e83b-478e-ae8e-eb77a2f962f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:03.481971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:03.481971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:03.481971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:03.481971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:03.481971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:03.481971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:03.481971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:03.481971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:03.481971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:03.481971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:03.481971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:03.481971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:03.481971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:03.481971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:03.482838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:03.482838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:03.482838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:03.482838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:03.482838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:03.482838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:03.482838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:03.482838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:03.482838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:03.482838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:03.482838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:03.482838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:03.482838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:03.482838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:03.482838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:03.482838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:03.482838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:03.483651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:03.483651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:03.483651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:03.483651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:03.483651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 278/548] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:03.488659 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef6230-e83b-478e-ae8e-eb77a2f962f8 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:03.518199 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:03.546828 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f4d8e-41dc-4560-b979-de0946e8bd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:03.547654 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f4d8e-41dc-4560-b979-de0946e8bd93 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:03.547941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f4d8e-41dc-4560-b979-de0946e8bd93 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:03.548221 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f4d8e-41dc-4560-b979-de0946e8bd93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:03.557134 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:03.566871 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2f4d8e-41dc-4560-b979-de0946e8bd93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:38:03.575835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-fe2f4d8e-41dc-4560-b979-de0946e8bd93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:03.575835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:03.575835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:03.575835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:03.575835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:03.575835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:03.575835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:03.575835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:03.575835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:03.575835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:03.575835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:03.575835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:03.575835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:38:03.575835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:38:03.575835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:38:03.575835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:38:03.576953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:38:03.576953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:38:03.576953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:38:03.576953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:38:03.576953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:03.576953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:03.576953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:03.576953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:03.576953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:03.576953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:03.576953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:03.576953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:03.576953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:03.576953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:03.576953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:03.576953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:03.578865 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:03.578865 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:03.578865 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:03.578865 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:03.578865 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:38:03.578865 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:38:03.578865 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:38:03.578865 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:38:03.578865 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:38:03.578865 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:38:03.578865 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:03.578865 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:03.578865 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 271/549] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 23 15:38:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:03.590652 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f4d8e-41dc-4560-b979-de0946e8bd93 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:03.626916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aef6230-e83b-478e-ae8e-eb77a2f962f8 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:03.663994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df73d3d-4d2c-464e-aa6c-99942a51a576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:03.664767 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df73d3d-4d2c-464e-aa6c-99942a51a576 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:03.665063 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df73d3d-4d2c-464e-aa6c-99942a51a576 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:03.665362 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df73d3d-4d2c-464e-aa6c-99942a51a576 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:03.666317 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df73d3d-4d2c-464e-aa6c-99942a51a576 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:03.666533 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df73d3d-4d2c-464e-aa6c-99942a51a576 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:03.667932 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df73d3d-4d2c-464e-aa6c-99942a51a576 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:03.682455 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 279/550] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:03.688127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df73d3d-4d2c-464e-aa6c-99942a51a576 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:03.717389 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2f4d8e-41dc-4560-b979-de0946e8bd93 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:03.766045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a209ff-a20b-43cc-a334-c01dacb751b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:03.767163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a209ff-a20b-43cc-a334-c01dacb751b4 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:03.767739 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a209ff-a20b-43cc-a334-c01dacb751b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:03.768229 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a209ff-a20b-43cc-a334-c01dacb751b4 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:03.769194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a209ff-a20b-43cc-a334-c01dacb751b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:03.769695 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a209ff-a20b-43cc-a334-c01dacb751b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:03.771280 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a209ff-a20b-43cc-a334-c01dacb751b4 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:03.781202 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:03.795082 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 272/551] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 23 15:38:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:03.803859 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df73d3d-4d2c-464e-aa6c-99942a51a576 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:03.807895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a209ff-a20b-43cc-a334-c01dacb751b4 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:03.842907 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc06bd-bbe2-4396-9ff9-d6b1427d6a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:03.843750 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc06bd-bbe2-4396-9ff9-d6b1427d6a6a None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:03.844039 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc06bd-bbe2-4396-9ff9-d6b1427d6a6a None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:03.844366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc06bd-bbe2-4396-9ff9-d6b1427d6a6a None admin] PATH_INFO: `/v3/users/swift` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:03.853813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc06bd-bbe2-4396-9ff9-d6b1427d6a6a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:03.855470 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc06bd-bbe2-4396-9ff9-d6b1427d6a6a None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:03.872788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-f1bc06bd-bbe2-4396-9ff9-d6b1427d6a6a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 15:38:03.872788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:03.872788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:03.872788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:03.872788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:03.872788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:03.872788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:03.872788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:03.872788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:03.872788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:03.872788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:03.872788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:03.872788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:38:03.872788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:38:03.872788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:38:03.872788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:38:03.873844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:03.873844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:03.873844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:03.873844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:03.873844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:03.873844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:03.873844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:03.873844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:03.873844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:03.873844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:03.873844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:03.873844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:03.873844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:03.873844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:03.873844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:03.873844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:03.873844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:03.873844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:03.874884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:03.874884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:03.874884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:38:03.874884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:38:03.874884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:38:03.874884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:38:03.874884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:38:03.874884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:38:03.874884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 15:38:03.874884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:03.874884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 280/552] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:38:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:03.881927 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc06bd-bbe2-4396-9ff9-d6b1427d6a6a None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:03.970340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:04.030801 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc06bd-bbe2-4396-9ff9-d6b1427d6a6a None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:04.054703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a209ff-a20b-43cc-a334-c01dacb751b4 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:04.093938 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3c02c-b1fd-4ea1-ac10-785b0901b3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:04.096050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3c02c-b1fd-4ea1-ac10-785b0901b3be None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:04.096531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3c02c-b1fd-4ea1-ac10-785b0901b3be None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:04.097642 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3c02c-b1fd-4ea1-ac10-785b0901b3be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:04.109534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5acd2fe-f6d2-4e7b-94b8-52050f6789fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:04.110468 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acd2fe-f6d2-4e7b-94b8-52050f6789fd None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:04.110902 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acd2fe-f6d2-4e7b-94b8-52050f6789fd None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:04.111327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5acd2fe-f6d2-4e7b-94b8-52050f6789fd None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:04.112314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5acd2fe-f6d2-4e7b-94b8-52050f6789fd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:04.112794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5acd2fe-f6d2-4e7b-94b8-52050f6789fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:04.114417 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5acd2fe-f6d2-4e7b-94b8-52050f6789fd None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:04.120483 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3c02c-b1fd-4ea1-ac10-785b0901b3be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:04.123614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3c02c-b1fd-4ea1-ac10-785b0901b3be None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:04.145395 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:04.153498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-2fb3c02c-b1fd-4ea1-ac10-785b0901b3be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:04.153498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:04.153498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:04.153498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:04.153498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:04.153498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:04.153498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:04.153498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:04.153498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:04.153498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:04.153498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:04.153498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:04.153498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:04.153498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:04.153498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:04.154494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:04.154494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:04.154494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:04.154494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:04.154494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:04.154494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:04.154494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:04.154494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:04.154494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:04.154494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:04.154494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:04.154494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:04.154494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:04.154494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:04.154494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:04.154494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:04.154494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:04.155338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:04.155338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:04.155338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:04.155338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:04.155808 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 281/553] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Jun 23 15:38:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:04.158853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67013ca-e52d-4e09-ab8e-f58a93827985 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:04.158853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67013ca-e52d-4e09-ab8e-f58a93827985 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:04.158853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67013ca-e52d-4e09-ab8e-f58a93827985 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:04.160731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 273/555] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:04.165018 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 282/555] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:04.166192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67013ca-e52d-4e09-ab8e-f58a93827985 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:04.167019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d19284-b000-427d-a487-6c7efaa05c58 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:04.167565 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d19284-b000-427d-a487-6c7efaa05c58 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:04.167989 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d19284-b000-427d-a487-6c7efaa05c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:04.190458 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-45d19284-b000-427d-a487-6c7efaa05c58 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:04.191949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-45d19284-b000-427d-a487-6c7efaa05c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:04.274207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 274/556] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:38:04.275688 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d19284-b000-427d-a487-6c7efaa05c58 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:04.279935 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67013ca-e52d-4e09-ab8e-f58a93827985 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:04.322965 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c05683-e306-44f6-b91b-67ac7fa6864f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:04.323505 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c05683-e306-44f6-b91b-67ac7fa6864f None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:04.323794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c05683-e306-44f6-b91b-67ac7fa6864f None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:04.324076 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c05683-e306-44f6-b91b-67ac7fa6864f None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:04.324902 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c05683-e306-44f6-b91b-67ac7fa6864f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:04.325723 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c05683-e306-44f6-b91b-67ac7fa6864f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:04.327136 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c05683-e306-44f6-b91b-67ac7fa6864f None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:04.339487 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 283/557] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:04.344159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c05683-e306-44f6-b91b-67ac7fa6864f None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:04.346085 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:04.407754 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d19284-b000-427d-a487-6c7efaa05c58 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:04.408763 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:04.447043 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53961118-f798-422c-99a4-36b714f27386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:04.448129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53961118-f798-422c-99a4-36b714f27386 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:04.448710 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53961118-f798-422c-99a4-36b714f27386 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:04.449193 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53961118-f798-422c-99a4-36b714f27386 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:04.455407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c05683-e306-44f6-b91b-67ac7fa6864f None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:04.492877 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f69e9-2b51-4d56-a2b2-c7bbf2312518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:04.493429 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f69e9-2b51-4d56-a2b2-c7bbf2312518 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:04.493717 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f69e9-2b51-4d56-a2b2-c7bbf2312518 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:04.494030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f69e9-2b51-4d56-a2b2-c7bbf2312518 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:04.506369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f69e9-2b51-4d56-a2b2-c7bbf2312518 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:38:04.514428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-e68f69e9-2b51-4d56-a2b2-c7bbf2312518 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:04.514428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:04.514428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:04.514428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:04.514428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:04.514428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:04.514428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:04.514428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:04.514428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:04.514428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:04.514428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:04.514428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:04.514428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:38:04.514428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:38:04.514428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:38:04.514428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:38:04.515826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:38:04.515826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:38:04.515826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:38:04.515826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:38:04.515826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:04.515826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:04.515826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:04.515826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:04.515826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:04.515826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:04.515826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:04.515826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:04.515826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:04.515826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:04.515826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:04.515826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:04.516640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:04.516640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:04.516640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:04.516640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:04.516640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:38:04.516640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:38:04.516640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:38:04.516640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:38:04.516640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:38:04.516640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:38:04.516640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:04.516640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:04.520952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 284/558] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 23 15:38:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:04.521913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f69e9-2b51-4d56-a2b2-c7bbf2312518 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:04.535474 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53961118-f798-422c-99a4-36b714f27386 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:04.537450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53961118-f798-422c-99a4-36b714f27386 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:04.587628 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:04.630867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f69e9-2b51-4d56-a2b2-c7bbf2312518 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:04.649981 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 275/559] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:38:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:38:04.651189 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53961118-f798-422c-99a4-36b714f27386 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:04.657632 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:04.676282 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298c23c-15ac-4094-abc6-badb355f3c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:04.678166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298c23c-15ac-4094-abc6-badb355f3c9b None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:04.678166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298c23c-15ac-4094-abc6-badb355f3c9b None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:04.678373 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298c23c-15ac-4094-abc6-badb355f3c9b None admin] PATH_INFO: `/v3/users/nova` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:04.689569 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298c23c-15ac-4094-abc6-badb355f3c9b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:04.691533 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298c23c-15ac-4094-abc6-badb355f3c9b None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:04.709972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-f298c23c-15ac-4094-abc6-badb355f3c9b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 15:38:04.709972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:04.709972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:04.709972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:04.709972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:04.709972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:04.709972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:04.709972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:04.709972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:04.709972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:04.709972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:04.709972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:04.709972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:38:04.709972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:38:04.709972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:38:04.709972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:38:04.711071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:04.711071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:04.711071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:04.711071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:04.711071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:04.711071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:04.711071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:04.711071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:04.711071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:04.711071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:04.711071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:04.711071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:04.711071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:04.711071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:04.711071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:04.711071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:04.711071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:04.711071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:04.711987 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:04.711987 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:04.711987 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:38:04.711987 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:38:04.711987 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:38:04.711987 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:38:04.711987 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:38:04.711987 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:38:04.711987 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 15:38:04.711987 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:04.717613 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 285/560] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jun 23 15:38:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:04.718682 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298c23c-15ac-4094-abc6-badb355f3c9b None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:04.781397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53961118-f798-422c-99a4-36b714f27386 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:04.823445 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c94c1-51dc-4e8a-a9d1-68557e718341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:04.824515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c94c1-51dc-4e8a-a9d1-68557e718341 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:04.825568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c94c1-51dc-4e8a-a9d1-68557e718341 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:04.826111 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c94c1-51dc-4e8a-a9d1-68557e718341 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:04.827070 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c94c1-51dc-4e8a-a9d1-68557e718341 None admin] RBAC: Adding query filter params (name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:04.827578 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c94c1-51dc-4e8a-a9d1-68557e718341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:04.829154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c94c1-51dc-4e8a-a9d1-68557e718341 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:04.838499 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298c23c-15ac-4094-abc6-badb355f3c9b None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:04.839155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 276/561] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 23 15:38:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:04.840197 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c94c1-51dc-4e8a-a9d1-68557e718341 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:04.853838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:04.890548 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e655d52-a5c3-48e4-8152-657ef970e0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:04.891404 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e655d52-a5c3-48e4-8152-657ef970e0dc None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:04.891694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e655d52-a5c3-48e4-8152-657ef970e0dc None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:04.891975 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e655d52-a5c3-48e4-8152-657ef970e0dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:04.906871 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e655d52-a5c3-48e4-8152-657ef970e0dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:04.909094 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e655d52-a5c3-48e4-8152-657ef970e0dc None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:04.927708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-9e655d52-a5c3-48e4-8152-657ef970e0dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:04.927708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:04.927708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:04.927708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:04.927708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:04.927708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:04.927708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:04.927708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:04.927708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:04.927708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:04.927708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:04.927708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:04.927708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:04.927708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:04.927708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:04.928738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:04.928738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:04.928738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:04.928738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:04.928738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:04.928738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:04.928738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:04.928738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:04.928738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:04.928738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:04.928738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:04.928738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:04.928738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:04.928738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:04.928738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:04.928738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:04.928738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:04.929635 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:04.929635 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:04.929635 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:04.929635 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:04.929635 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 286/562] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:04.929934 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e655d52-a5c3-48e4-8152-657ef970e0dc None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:04.968585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:04.970423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c94c1-51dc-4e8a-a9d1-68557e718341 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:05.011550 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6eeeb-7871-41dc-be00-67b227bf84b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:05.012223 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6eeeb-7871-41dc-be00-67b227bf84b9 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:05.012611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6eeeb-7871-41dc-be00-67b227bf84b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:05.012843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6eeeb-7871-41dc-be00-67b227bf84b9 None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:05.013664 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6eeeb-7871-41dc-be00-67b227bf84b9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:05.014044 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6eeeb-7871-41dc-be00-67b227bf84b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:05.015477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6eeeb-7871-41dc-be00-67b227bf84b9 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:05.035513 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 277/563] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jun 23 15:38:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:05.036846 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab5340-f871-4546-ba32-b9e3b8f47eb6 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:05.037169 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab5340-f871-4546-ba32-b9e3b8f47eb6 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:05.037415 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab5340-f871-4546-ba32-b9e3b8f47eb6 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:05.039434 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 278/564] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:05.040509 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab5340-f871-4546-ba32-b9e3b8f47eb6 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:05.064977 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e655d52-a5c3-48e4-8152-657ef970e0dc None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:05.103227 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06814e-cb92-48b5-a0b9-de3f2678caca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:05.104071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06814e-cb92-48b5-a0b9-de3f2678caca None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:05.104355 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06814e-cb92-48b5-a0b9-de3f2678caca None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:05.104638 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06814e-cb92-48b5-a0b9-de3f2678caca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:05.117007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06814e-cb92-48b5-a0b9-de3f2678caca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:05.118497 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06814e-cb92-48b5-a0b9-de3f2678caca None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:05.124835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:05.138274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-3f06814e-cb92-48b5-a0b9-de3f2678caca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:05.138274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:05.138274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:05.138274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:05.138274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:05.138274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:05.138274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:05.138274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:05.138274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:05.138274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:05.138274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:05.138274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:05.138274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:05.138274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:05.138274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:05.139259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:05.139259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:05.139259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:05.139259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:05.139259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:05.139259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:05.139259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:05.139259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:05.139259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:05.139259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:05.139259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:05.139259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:05.139259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:05.139259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:05.139259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:05.139259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:05.139259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:05.146434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:05.146434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:05.146434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:05.146434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:05.146434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 287/565] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:05.146434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b28a7-538f-4c4a-937d-6d9f59792faa None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:05.146434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b28a7-538f-4c4a-937d-6d9f59792faa None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:05.146434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3b28a7-538f-4c4a-937d-6d9f59792faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:05.163331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-ef3b28a7-538f-4c4a-937d-6d9f59792faa None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:05.164536 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ef3b28a7-538f-4c4a-937d-6d9f59792faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:05.186656 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab5340-f871-4546-ba32-b9e3b8f47eb6 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:05.228452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d9cee-12b3-44fd-acaa-da7918bc05f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:05.229131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d9cee-12b3-44fd-acaa-da7918bc05f8 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:05.229587 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d9cee-12b3-44fd-acaa-da7918bc05f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:05.229895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d9cee-12b3-44fd-acaa-da7918bc05f8 None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:05.230760 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d9cee-12b3-44fd-acaa-da7918bc05f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:05.231103 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d9cee-12b3-44fd-acaa-da7918bc05f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:05.232660 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d9cee-12b3-44fd-acaa-da7918bc05f8 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:05.245898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 288/566] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:38:05.245898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b28a7-538f-4c4a-937d-6d9f59792faa None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:05.256644 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 279/567] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:05.257692 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d9cee-12b3-44fd-acaa-da7918bc05f8 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:05.268631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:05.365313 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3b28a7-538f-4c4a-937d-6d9f59792faa None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:05.375623 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d9cee-12b3-44fd-acaa-da7918bc05f8 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:05.402733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07cedd7-06bd-4bf6-8786-587581c33cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:05.404106 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cedd7-06bd-4bf6-8786-587581c33cbd None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:05.404425 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cedd7-06bd-4bf6-8786-587581c33cbd None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:05.404663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:05.404781 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cedd7-06bd-4bf6-8786-587581c33cbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:05.417863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d25743-6e12-4fda-8cd2-f89a97d3c390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:05.418997 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d25743-6e12-4fda-8cd2-f89a97d3c390 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:05.418997 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d25743-6e12-4fda-8cd2-f89a97d3c390 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:05.419312 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d25743-6e12-4fda-8cd2-f89a97d3c390 None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:05.419998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d25743-6e12-4fda-8cd2-f89a97d3c390 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:05.420651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d25743-6e12-4fda-8cd2-f89a97d3c390 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:05.421804 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d25743-6e12-4fda-8cd2-f89a97d3c390 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:05.422550 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07cedd7-06bd-4bf6-8786-587581c33cbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:05.424270 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07cedd7-06bd-4bf6-8786-587581c33cbd None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:05.436077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 280/568] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:05.441000 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d25743-6e12-4fda-8cd2-f89a97d3c390 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:05.449359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-c07cedd7-06bd-4bf6-8786-587581c33cbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:05.449359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:05.449359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:05.449359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:05.449359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:05.449359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:05.449359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:05.449359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:05.449359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:05.449359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:05.449359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:05.449359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:05.449359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:05.449359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:05.449359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:05.450806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:05.450806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:05.450806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:05.450806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:05.450806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:05.450806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:05.450806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:05.450806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:05.450806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:05.450806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:05.450806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:05.450806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:05.450806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:05.450806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:05.450806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:05.450806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:05.450806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:05.456259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:05.456259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:05.456259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:05.456259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:05.456259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 289/569] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:05.456259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07cedd7-06bd-4bf6-8786-587581c33cbd None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:05.533609 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:05.564302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d25743-6e12-4fda-8cd2-f89a97d3c390 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:05.585974 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07cedd7-06bd-4bf6-8786-587581c33cbd None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:05.604931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad4be2-6cb2-4a26-a9ea-c86ca1749b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:05.605736 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad4be2-6cb2-4a26-a9ea-c86ca1749b88 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:05.606079 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad4be2-6cb2-4a26-a9ea-c86ca1749b88 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:05.606359 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad4be2-6cb2-4a26-a9ea-c86ca1749b88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:05.613964 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad4be2-6cb2-4a26-a9ea-c86ca1749b88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:05.615438 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad4be2-6cb2-4a26-a9ea-c86ca1749b88 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:05.625895 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897175ce-a43e-40ef-a3ff-8a9ad5e390af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:05.627622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897175ce-a43e-40ef-a3ff-8a9ad5e390af None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:05.627622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897175ce-a43e-40ef-a3ff-8a9ad5e390af None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:05.627791 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897175ce-a43e-40ef-a3ff-8a9ad5e390af None admin] PATH_INFO: `/v3/roles/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:05.632034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-6fad4be2-6cb2-4a26-a9ea-c86ca1749b88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:05.632034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:05.632034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:05.632034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:05.632034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:05.632034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:05.632034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:05.632034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:05.632034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:05.632034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:05.632034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:05.632034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:05.632034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:05.632034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:05.632034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:05.632972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:05.632972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:05.632972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:05.632972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:05.632972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:05.632972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:05.632972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:05.632972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:05.632972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:05.632972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:05.632972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:05.632972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:05.632972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:05.632972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:05.632972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:05.632972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:05.632972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:05.634369 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:05.634369 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:05.634369 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:05.634369 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:05.634369 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:05.634369 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:05.634369 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:05.634369 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:05.634369 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 281/570] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:05.638989 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad4be2-6cb2-4a26-a9ea-c86ca1749b88 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:05.643744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897175ce-a43e-40ef-a3ff-8a9ad5e390af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:38:05.660331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-897175ce-a43e-40ef-a3ff-8a9ad5e390af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:05.660331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:05.660331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:05.660331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:05.660331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:05.660331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:05.660331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:05.660331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:05.660331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:05.660331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:05.660331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:05.660331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:05.660331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:38:05.660331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:38:05.660331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:38:05.660331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:38:05.661411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:38:05.661411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:38:05.661411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:38:05.661411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:38:05.661411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:05.661411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:05.661411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:05.661411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:05.661411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:05.661411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:05.661411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:05.661411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:05.661411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:05.661411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:05.661411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:05.661411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:05.662262 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:05.662262 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:05.662262 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:05.662262 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:05.662262 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:38:05.662262 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:38:05.662262 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:38:05.662262 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:38:05.662262 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:38:05.662262 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:38:05.662262 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:05.662262 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:05.662880 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 290/571] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 23 15:38:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:05.663874 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897175ce-a43e-40ef-a3ff-8a9ad5e390af None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:05.694379 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:05.757772 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad4be2-6cb2-4a26-a9ea-c86ca1749b88 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:05.781283 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897175ce-a43e-40ef-a3ff-8a9ad5e390af None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:05.791409 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342f10f-1188-4199-8118-442511105954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:05.792204 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342f10f-1188-4199-8118-442511105954 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:05.792482 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342f10f-1188-4199-8118-442511105954 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:05.792752 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342f10f-1188-4199-8118-442511105954 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:05.800688 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342f10f-1188-4199-8118-442511105954 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:05.802352 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342f10f-1188-4199-8118-442511105954 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:05.806783 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:05.816106 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25d8d4-493d-458f-a1ef-0c578438b837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:05.816770 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25d8d4-493d-458f-a1ef-0c578438b837 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:05.817056 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25d8d4-493d-458f-a1ef-0c578438b837 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:05.817198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-1342f10f-1188-4199-8118-442511105954 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 15:38:05.817198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:05.817198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:05.817198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:05.817198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:05.817198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:05.817198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:05.817198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:05.817198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:05.817198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:05.817198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:05.817198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:05.817198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:38:05.817198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:38:05.817198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:38:05.817198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:38:05.818237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:05.818237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:05.818237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:05.818237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:05.818237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:05.818237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:05.818237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:05.818237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:05.818237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:05.818237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:05.818237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:05.818237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:05.818237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:05.818237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:05.818237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:05.818237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:05.818237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:05.818237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:05.819177 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:05.819177 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:05.819177 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:38:05.819177 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:38:05.819177 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:38:05.819177 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:38:05.819177 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:38:05.819177 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:38:05.819177 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 15:38:05.819177 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:05.819690 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25d8d4-493d-458f-a1ef-0c578438b837 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:05.819690 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25d8d4-493d-458f-a1ef-0c578438b837 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:05.819690 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25d8d4-493d-458f-a1ef-0c578438b837 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:05.819865 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 282/572] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:38:05 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:05.819865 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342f10f-1188-4199-8118-442511105954 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:05.819989 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25d8d4-493d-458f-a1ef-0c578438b837 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:05.832995 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 291/573] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:05.833834 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25d8d4-493d-458f-a1ef-0c578438b837 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:05.938697 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25d8d4-493d-458f-a1ef-0c578438b837 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:05.942458 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342f10f-1188-4199-8118-442511105954 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:05.944786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:05.973265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619c5fb-14eb-4b6a-bca7-0e921f164c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:05.973999 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619c5fb-14eb-4b6a-bca7-0e921f164c11 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:05.974292 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619c5fb-14eb-4b6a-bca7-0e921f164c11 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:05.974570 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619c5fb-14eb-4b6a-bca7-0e921f164c11 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:05.975321 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619c5fb-14eb-4b6a-bca7-0e921f164c11 None admin] RBAC: Adding query filter params (name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:05.975627 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619c5fb-14eb-4b6a-bca7-0e921f164c11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:05.976990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619c5fb-14eb-4b6a-bca7-0e921f164c11 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:05.977815 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc37ac-61c0-4cae-b67a-f6de0f3a831e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:05.978508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc37ac-61c0-4cae-b67a-f6de0f3a831e None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:05.978795 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc37ac-61c0-4cae-b67a-f6de0f3a831e None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:05.979091 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc37ac-61c0-4cae-b67a-f6de0f3a831e None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:05.979870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc37ac-61c0-4cae-b67a-f6de0f3a831e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:05.980183 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc37ac-61c0-4cae-b67a-f6de0f3a831e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:05.981657 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dc37ac-61c0-4cae-b67a-f6de0f3a831e None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:05.985050 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 292/574] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 23 15:38:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:05.986348 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763425c-6341-42b3-9b6f-6a4eda29236a None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:05.986643 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763425c-6341-42b3-9b6f-6a4eda29236a None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:05.986925 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763425c-6341-42b3-9b6f-6a4eda29236a None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:05.988330 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 293/575] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:05.988874 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763425c-6341-42b3-9b6f-6a4eda29236a None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:05.996336 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 283/576] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:05.997207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc37ac-61c0-4cae-b67a-f6de0f3a831e None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:06.042460 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:06.094305 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763425c-6341-42b3-9b6f-6a4eda29236a None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:06.096698 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc37ac-61c0-4cae-b67a-f6de0f3a831e None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:06.128764 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c2416-9ae3-47f3-a1ac-be851692903f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:06.133100 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c2416-9ae3-47f3-a1ac-be851692903f None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:06.133100 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c2416-9ae3-47f3-a1ac-be851692903f None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:06.133100 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c2416-9ae3-47f3-a1ac-be851692903f None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:06.133100 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c2416-9ae3-47f3-a1ac-be851692903f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:06.133100 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c2416-9ae3-47f3-a1ac-be851692903f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:06.133484 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79276239-0aaf-4060-9266-e3fb7bd98d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:06.133573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c2416-9ae3-47f3-a1ac-be851692903f None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:06.133642 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79276239-0aaf-4060-9266-e3fb7bd98d4e None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:06.133642 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79276239-0aaf-4060-9266-e3fb7bd98d4e None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:06.134173 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79276239-0aaf-4060-9266-e3fb7bd98d4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:06.143968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79276239-0aaf-4060-9266-e3fb7bd98d4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:06.145592 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79276239-0aaf-4060-9266-e3fb7bd98d4e None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:06.155506 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 294/577] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Jun 23 15:38:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:06.156606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c2416-9ae3-47f3-a1ac-be851692903f None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:06.161696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-79276239-0aaf-4060-9266-e3fb7bd98d4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:06.161696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:06.161696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:06.161696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:06.161696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:06.161696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:06.161696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:06.161696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:06.161696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:06.161696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:06.161696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:06.161696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:06.161696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:06.161696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:06.161696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:06.162750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:06.162750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:06.162750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:06.162750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:06.162750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:06.162750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:06.162750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:06.162750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:06.162750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:06.162750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:06.162750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:06.162750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:06.162750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:06.162750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:06.162750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:06.162750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:06.162750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:06.163618 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:06.163618 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:06.163618 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:06.163618 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:06.163618 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:06.163618 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:06.163618 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:06.163618 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:06.163618 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 284/578] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:06.164281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99046f5-41e3-41dc-861c-61c40e3e1e35 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:06.164511 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99046f5-41e3-41dc-861c-61c40e3e1e35 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:06.164799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99046f5-41e3-41dc-861c-61c40e3e1e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:06.182893 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-b99046f5-41e3-41dc-861c-61c40e3e1e35 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:06.184170 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-b99046f5-41e3-41dc-861c-61c40e3e1e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:06.202572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:06.254213 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 285/579] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:38:06.255072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99046f5-41e3-41dc-861c-61c40e3e1e35 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:06.272284 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c2416-9ae3-47f3-a1ac-be851692903f None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:06.281711 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:06.308880 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aab3d9-26fb-4d81-9ef2-223b7101e3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:06.309871 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aab3d9-26fb-4d81-9ef2-223b7101e3c2 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:06.310183 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aab3d9-26fb-4d81-9ef2-223b7101e3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:06.310482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aab3d9-26fb-4d81-9ef2-223b7101e3c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:06.320620 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aab3d9-26fb-4d81-9ef2-223b7101e3c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:06.322088 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aab3d9-26fb-4d81-9ef2-223b7101e3c2 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:06.339997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-f3aab3d9-26fb-4d81-9ef2-223b7101e3c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:06.339997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:06.339997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:06.339997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:06.339997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:06.339997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:06.339997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:06.339997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:06.339997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:06.339997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:06.339997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:06.339997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:06.339997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:06.339997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:06.339997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:06.341761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:06.341761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:06.341761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:06.341761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:06.341761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:06.341761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:06.341761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:06.341761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:06.341761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:06.341761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:06.341761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:06.341761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:06.341761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:06.341761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:06.341761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:06.341761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:06.341761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:06.342813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:06.342813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:06.342813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:06.342813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:06.342813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 295/580] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:06.342813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aab3d9-26fb-4d81-9ef2-223b7101e3c2 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:06.356131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99046f5-41e3-41dc-861c-61c40e3e1e35 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:06.390374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70b7ba-716f-4926-8015-3725745d6496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:06.391125 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70b7ba-716f-4926-8015-3725745d6496 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:06.391475 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70b7ba-716f-4926-8015-3725745d6496 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:06.391825 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70b7ba-716f-4926-8015-3725745d6496 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:06.392727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70b7ba-716f-4926-8015-3725745d6496 None admin] RBAC: Adding query filter params (role.id=e004305755a2468aa60ab6632d39207a, scope.project.id=ff90b874f5b84d28a2752bc95419ad95, user.id=5824ee17e276483faf20db88a93545f3) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:06.393111 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70b7ba-716f-4926-8015-3725745d6496 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:06.394574 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70b7ba-716f-4926-8015-3725745d6496 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:06.400394 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 286/581] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:38:06 2022] GET /identity/v3/role_assignments?user.id=5824ee17e276483faf20db88a93545f3&scope.project.id=ff90b874f5b84d28a2752bc95419ad95&role.id=e004305755a2468aa60ab6632d39207a => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:06.401171 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70b7ba-716f-4926-8015-3725745d6496 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:06.425325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:06.451254 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aab3d9-26fb-4d81-9ef2-223b7101e3c2 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:06.492273 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc967d-4e11-4852-866e-facafa9bd3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:06.493006 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc967d-4e11-4852-866e-facafa9bd3c1 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:06.493300 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc967d-4e11-4852-866e-facafa9bd3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:06.493586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc967d-4e11-4852-866e-facafa9bd3c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:06.505188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc967d-4e11-4852-866e-facafa9bd3c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:06.507290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc967d-4e11-4852-866e-facafa9bd3c1 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:06.535347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-e0bc967d-4e11-4852-866e-facafa9bd3c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:06.535347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:06.535347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:06.535347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:06.535347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:06.535347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:06.535347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:06.535347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:06.535347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:06.535347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:06.535347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:06.535347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:06.535347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:06.535347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:06.535347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:06.537105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:06.537105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:06.537105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:06.537105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:06.537105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:06.537105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:06.537105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:06.537105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:06.537105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:06.537105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:06.537105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:06.537105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:06.537105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:06.537105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:06.537105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:06.537105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:06.537105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:06.538049 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:06.538049 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:06.538049 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:06.538049 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:06.538049 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 296/582] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:06.538049 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc967d-4e11-4852-866e-facafa9bd3c1 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:06.540026 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70b7ba-716f-4926-8015-3725745d6496 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:06.555277 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:06.588539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147b8b8-b682-492d-9af2-a77041fe68a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:06.589310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147b8b8-b682-492d-9af2-a77041fe68a8 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:06.589603 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147b8b8-b682-492d-9af2-a77041fe68a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:06.589906 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147b8b8-b682-492d-9af2-a77041fe68a8 None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:06.591358 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147b8b8-b682-492d-9af2-a77041fe68a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:06.591674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147b8b8-b682-492d-9af2-a77041fe68a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:06.593136 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1147b8b8-b682-492d-9af2-a77041fe68a8 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:06.611882 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 287/583] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:06.611882 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147b8b8-b682-492d-9af2-a77041fe68a8 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:06.663444 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc967d-4e11-4852-866e-facafa9bd3c1 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:06.698484 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:06.704768 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce1bd0-3d70-413a-8b83-331da5660956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:06.705573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce1bd0-3d70-413a-8b83-331da5660956 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:06.705889 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce1bd0-3d70-413a-8b83-331da5660956 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:06.706172 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce1bd0-3d70-413a-8b83-331da5660956 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:06.717992 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce1bd0-3d70-413a-8b83-331da5660956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:38:06.723110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147b8b8-b682-492d-9af2-a77041fe68a8 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:06.725679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-69ce1bd0-3d70-413a-8b83-331da5660956 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:06.725679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:06.725679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:06.725679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:06.725679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:06.725679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:06.725679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:06.725679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:06.725679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:06.725679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:06.725679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:06.725679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:06.725679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:38:06.725679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:38:06.725679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:38:06.725679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:38:06.726752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:38:06.726752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:38:06.726752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:38:06.726752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:38:06.726752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:06.726752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:06.726752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:06.726752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:06.726752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:06.726752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:06.726752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:06.726752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:06.726752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:06.726752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:06.726752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:06.726752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:06.727586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:06.727586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:06.727586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:06.727586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:06.727586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:38:06.727586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:38:06.727586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:38:06.727586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:38:06.727586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:38:06.727586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:38:06.727586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:06.727586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:06.727586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 297/584] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 23 15:38:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:06.728303 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce1bd0-3d70-413a-8b83-331da5660956 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:06.765238 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bae32-bc3d-4296-971a-c452034ddb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:06.765826 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bae32-bc3d-4296-971a-c452034ddb5e None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:06.766141 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bae32-bc3d-4296-971a-c452034ddb5e None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:06.766420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bae32-bc3d-4296-971a-c452034ddb5e None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:06.767147 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bae32-bc3d-4296-971a-c452034ddb5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:06.767459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bae32-bc3d-4296-971a-c452034ddb5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:06.768837 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bae32-bc3d-4296-971a-c452034ddb5e None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:06.781368 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 288/585] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:06.782431 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bae32-bc3d-4296-971a-c452034ddb5e None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:06.803757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:06.837489 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce1bd0-3d70-413a-8b83-331da5660956 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:06.875431 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34f29f-669a-4d66-9e3b-6a30500243d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:06.876104 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34f29f-669a-4d66-9e3b-6a30500243d3 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:06.876388 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34f29f-669a-4d66-9e3b-6a30500243d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:06.876670 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34f29f-669a-4d66-9e3b-6a30500243d3 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:06.877400 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34f29f-669a-4d66-9e3b-6a30500243d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:06.877715 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34f29f-669a-4d66-9e3b-6a30500243d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:06.879581 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34f29f-669a-4d66-9e3b-6a30500243d3 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:06.897902 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 298/586] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:06.897902 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34f29f-669a-4d66-9e3b-6a30500243d3 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:06.916879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bae32-bc3d-4296-971a-c452034ddb5e None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:06.953008 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863fa9a-0c9a-4f3a-ab03-df78213e9ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:06.954272 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863fa9a-0c9a-4f3a-ab03-df78213e9ef7 None admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:06.954734 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863fa9a-0c9a-4f3a-ab03-df78213e9ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:06.955199 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863fa9a-0c9a-4f3a-ab03-df78213e9ef7 None admin] PATH_INFO: `/v3/projects/ff90b874f5b84d28a2752bc95419ad95/users/d54521ea1dca44c98d6723d0b9fd6468/roles/e004305755a2468aa60ab6632d39207a` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:06.964123 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:06.972206 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863fa9a-0c9a-4f3a-ab03-df78213e9ef7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff90b874f5b84d28a2752bc95419ad95, user_id=d54521ea1dca44c98d6723d0b9fd6468, role_id=e004305755a2468aa60ab6632d39207a)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:06.973662 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863fa9a-0c9a-4f3a-ab03-df78213e9ef7 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:06.997892 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 289/587] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 23 15:38:06 2022] PUT /identity/v3/projects/ff90b874f5b84d28a2752bc95419ad95/users/d54521ea1dca44c98d6723d0b9fd6468/roles/e004305755a2468aa60ab6632d39207a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:38:06.997892 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863fa9a-0c9a-4f3a-ab03-df78213e9ef7 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:07.024214 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34f29f-669a-4d66-9e3b-6a30500243d3 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:07.057977 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:07.067280 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107e0dc-a01d-409e-bbef-3e81ce4100ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:07.068428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107e0dc-a01d-409e-bbef-3e81ce4100ff None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:07.068819 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107e0dc-a01d-409e-bbef-3e81ce4100ff None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:07.069202 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107e0dc-a01d-409e-bbef-3e81ce4100ff None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:07.070726 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107e0dc-a01d-409e-bbef-3e81ce4100ff None admin] RBAC: Adding query filter params (name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:07.071176 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107e0dc-a01d-409e-bbef-3e81ce4100ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:07.073797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107e0dc-a01d-409e-bbef-3e81ce4100ff None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:07.090017 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 299/588] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 23 15:38:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:07.091775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107e0dc-a01d-409e-bbef-3e81ce4100ff None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:07.124979 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863fa9a-0c9a-4f3a-ab03-df78213e9ef7 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:07.167756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3082e-b07d-41b1-b511-e12ada2a0dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:07.169539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3082e-b07d-41b1-b511-e12ada2a0dde None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:07.170040 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3082e-b07d-41b1-b511-e12ada2a0dde None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:07.170455 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3082e-b07d-41b1-b511-e12ada2a0dde None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:07.179831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3082e-b07d-41b1-b511-e12ada2a0dde None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:07.181719 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e3082e-b07d-41b1-b511-e12ada2a0dde None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:07.197745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-66e3082e-b07d-41b1-b511-e12ada2a0dde None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 15:38:07.197745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:07.197745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:07.197745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:07.197745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:07.197745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:07.197745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:07.197745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:07.197745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:07.197745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:07.197745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:07.197745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:07.197745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:38:07.197745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:38:07.197745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:38:07.197745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:38:07.198723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:07.198723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:07.198723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:07.198723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:07.198723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:07.198723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:07.198723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:07.198723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:07.198723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:07.198723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:07.198723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:07.198723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:07.198723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:07.198723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:07.198723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:07.198723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:07.198723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:07.198723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:07.199624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:07.199624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:07.199624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:38:07.199624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:38:07.199624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:38:07.199624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:38:07.199624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:38:07.199624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:38:07.199624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 15:38:07.199624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:07.199624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 290/589] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:38:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:07.200249 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3082e-b07d-41b1-b511-e12ada2a0dde None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:07.228202 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107e0dc-a01d-409e-bbef-3e81ce4100ff None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:07.266269 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:07.269695 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5e8dc-ae90-4b39-9d0c-c017554d3d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:07.270650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5e8dc-ae90-4b39-9d0c-c017554d3d1e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:07.271067 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5e8dc-ae90-4b39-9d0c-c017554d3d1e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:07.271806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5e8dc-ae90-4b39-9d0c-c017554d3d1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:07.281796 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5e8dc-ae90-4b39-9d0c-c017554d3d1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:07.283978 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d5e8dc-ae90-4b39-9d0c-c017554d3d1e None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:07.306252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-b8d5e8dc-ae90-4b39-9d0c-c017554d3d1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:07.306252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:07.306252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:07.306252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:07.306252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:07.306252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:07.306252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:07.306252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:07.306252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:07.306252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:07.306252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:07.306252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:07.306252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:07.306252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:07.306252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:07.307255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:07.307255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:07.307255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:07.307255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:07.307255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:07.307255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:07.307255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:07.307255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:07.307255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:07.307255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:07.307255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:07.307255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:07.307255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:07.307255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:07.307255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:07.307255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:07.307255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:07.308122 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:07.308122 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:07.308122 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:07.308122 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:07.308122 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:07.308122 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:07.308122 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:07.308122 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:07.308535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 300/590] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:07.309067 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5e8dc-ae90-4b39-9d0c-c017554d3d1e None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:07.328088 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3082e-b07d-41b1-b511-e12ada2a0dde None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:07.368849 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5c51e-8261-4c09-9bb3-9bf9e79735f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:07.370348 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5c51e-8261-4c09-9bb3-9bf9e79735f3 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:07.370637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5c51e-8261-4c09-9bb3-9bf9e79735f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:07.370915 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5c51e-8261-4c09-9bb3-9bf9e79735f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:07.380463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:07.388325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5c51e-8261-4c09-9bb3-9bf9e79735f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:07.390602 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5c51e-8261-4c09-9bb3-9bf9e79735f3 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:07.415848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-adc5c51e-8261-4c09-9bb3-9bf9e79735f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:07.415848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:07.415848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:07.415848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:07.415848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:07.415848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:07.415848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:07.415848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:07.415848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:07.415848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:07.415848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:07.415848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:07.415848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:07.415848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:07.415848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:07.417450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:07.417450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:07.417450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:07.417450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:07.417450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:07.417450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:07.417450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:07.417450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:07.417450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:07.417450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:07.417450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:07.417450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:07.417450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:07.417450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:07.417450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:07.417450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:07.417450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:07.419569 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:07.419569 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:07.419569 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:07.419569 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:07.419569 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 291/591] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:07.419569 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5c51e-8261-4c09-9bb3-9bf9e79735f3 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:07.439393 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5e8dc-ae90-4b39-9d0c-c017554d3d1e None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:07.475618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791de886-af4f-453c-b148-1a67686fa330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:07.476449 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791de886-af4f-453c-b148-1a67686fa330 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:07.476797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791de886-af4f-453c-b148-1a67686fa330 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:07.477176 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791de886-af4f-453c-b148-1a67686fa330 None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:07.478130 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791de886-af4f-453c-b148-1a67686fa330 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:07.478529 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791de886-af4f-453c-b148-1a67686fa330 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:07.480047 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791de886-af4f-453c-b148-1a67686fa330 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:07.505200 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 301/592] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Jun 23 15:38:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:07.506167 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791de886-af4f-453c-b148-1a67686fa330 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:07.548766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5c51e-8261-4c09-9bb3-9bf9e79735f3 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:07.574236 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:07.596233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998f9d3-6d58-4087-af76-a21fb44e440f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:07.597175 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998f9d3-6d58-4087-af76-a21fb44e440f None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:07.597610 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998f9d3-6d58-4087-af76-a21fb44e440f None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:07.598051 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998f9d3-6d58-4087-af76-a21fb44e440f None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:07.598980 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998f9d3-6d58-4087-af76-a21fb44e440f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:07.599895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998f9d3-6d58-4087-af76-a21fb44e440f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:07.601873 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998f9d3-6d58-4087-af76-a21fb44e440f None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:07.617844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 292/593] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:07.619405 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998f9d3-6d58-4087-af76-a21fb44e440f None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:07.631825 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791de886-af4f-453c-b148-1a67686fa330 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:07.643979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:07.675630 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fef7d-7bb5-41a6-bb1b-8082a2dd7883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:07.677526 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fef7d-7bb5-41a6-bb1b-8082a2dd7883 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:07.678266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fef7d-7bb5-41a6-bb1b-8082a2dd7883 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:07.678719 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fef7d-7bb5-41a6-bb1b-8082a2dd7883 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:07.679867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fef7d-7bb5-41a6-bb1b-8082a2dd7883 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:07.680720 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fef7d-7bb5-41a6-bb1b-8082a2dd7883 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:07.682350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fef7d-7bb5-41a6-bb1b-8082a2dd7883 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:07.700815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 302/594] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:07.701981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fef7d-7bb5-41a6-bb1b-8082a2dd7883 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:07.739560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998f9d3-6d58-4087-af76-a21fb44e440f None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:07.777547 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c61da4-acf3-4300-9ccd-edb91bf27595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:07.778527 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c61da4-acf3-4300-9ccd-edb91bf27595 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:07.778885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c61da4-acf3-4300-9ccd-edb91bf27595 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:07.779333 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c61da4-acf3-4300-9ccd-edb91bf27595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:07.791117 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c61da4-acf3-4300-9ccd-edb91bf27595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:07.792745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c61da4-acf3-4300-9ccd-edb91bf27595 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:07.811823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-a2c61da4-acf3-4300-9ccd-edb91bf27595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:07.811823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:07.811823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:07.811823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:07.811823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:07.811823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:07.811823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:07.811823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:07.811823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:07.811823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:07.811823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:07.811823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:07.811823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:07.811823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:07.811823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:07.812734 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:07.812734 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:07.812734 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:07.812734 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:07.812734 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:07.812734 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:07.812734 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:07.812734 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:07.812734 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:07.812734 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:07.812734 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:07.812734 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:07.812734 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:07.812734 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:07.812734 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:07.812734 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:07.812734 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:07.813641 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:07.813641 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:07.813641 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:07.813641 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:07.817686 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 293/595] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:07.818659 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c61da4-acf3-4300-9ccd-edb91bf27595 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:07.840984 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:07.841621 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fef7d-7bb5-41a6-bb1b-8082a2dd7883 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:07.886886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8aa12-8d5f-4fa0-ab99-e9a57cf2aefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:07.887964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8aa12-8d5f-4fa0-ab99-e9a57cf2aefe None admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:07.888346 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8aa12-8d5f-4fa0-ab99-e9a57cf2aefe None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:07.888627 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8aa12-8d5f-4fa0-ab99-e9a57cf2aefe None admin] PATH_INFO: `/v3/projects/ff90b874f5b84d28a2752bc95419ad95/users/79239c95306c43f0a1a0b51715440009/roles/e004305755a2468aa60ab6632d39207a` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:07.904606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8aa12-8d5f-4fa0-ab99-e9a57cf2aefe None admin] RBAC: Authorizing `identity:create_grant(project_id=ff90b874f5b84d28a2752bc95419ad95, user_id=79239c95306c43f0a1a0b51715440009, role_id=e004305755a2468aa60ab6632d39207a)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:07.906546 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8aa12-8d5f-4fa0-ab99-e9a57cf2aefe None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:07.933821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 303/596] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 23 15:38:07 2022] PUT /identity/v3/projects/ff90b874f5b84d28a2752bc95419ad95/users/79239c95306c43f0a1a0b51715440009/roles/e004305755a2468aa60ab6632d39207a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:38:07.933821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8aa12-8d5f-4fa0-ab99-e9a57cf2aefe None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:07.969486 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:07.992350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c61da4-acf3-4300-9ccd-edb91bf27595 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:08.063696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb60c7c-7c45-47d0-a1e1-553d7321047e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:08.064428 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb60c7c-7c45-47d0-a1e1-553d7321047e None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:08.064713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb60c7c-7c45-47d0-a1e1-553d7321047e None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:08.064991 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb60c7c-7c45-47d0-a1e1-553d7321047e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:08.083771 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb60c7c-7c45-47d0-a1e1-553d7321047e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:08.085263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb60c7c-7c45-47d0-a1e1-553d7321047e None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:08.106115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-ddb60c7c-7c45-47d0-a1e1-553d7321047e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 15:38:08.106115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:08.106115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:08.106115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:08.106115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:08.106115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:08.106115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:08.106115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:08.106115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:08.106115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:08.106115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:08.106115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:08.106115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:38:08.106115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:38:08.106115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:38:08.106115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:38:08.107124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:08.107124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:08.107124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:08.107124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:08.107124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:08.107124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:08.107124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:08.107124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:08.107124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:08.107124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:08.107124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:08.107124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:08.107124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:08.107124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:08.107124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:08.107124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:08.107124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:08.107124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:08.108041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:08.108041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:08.108041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:38:08.108041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:38:08.108041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:38:08.108041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:38:08.108041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:38:08.108041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:38:08.108041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 15:38:08.108041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:08.108041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 294/597] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 23 15:38:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:08.125383 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb60c7c-7c45-47d0-a1e1-553d7321047e None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:08.131358 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8aa12-8d5f-4fa0-ab99-e9a57cf2aefe None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:08.197164 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6eb7bb-560b-4a62-81ea-bbb01100b743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:08.199260 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6eb7bb-560b-4a62-81ea-bbb01100b743 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:08.200636 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6eb7bb-560b-4a62-81ea-bbb01100b743 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:08.201642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6eb7bb-560b-4a62-81ea-bbb01100b743 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:08.204188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6eb7bb-560b-4a62-81ea-bbb01100b743 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:08.205387 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6eb7bb-560b-4a62-81ea-bbb01100b743 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:08.208896 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6eb7bb-560b-4a62-81ea-bbb01100b743 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:08.232950 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 304/598] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:08.239959 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6eb7bb-560b-4a62-81ea-bbb01100b743 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:08.241549 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:08.285845 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb60c7c-7c45-47d0-a1e1-553d7321047e None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:08.359929 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f562948-3e2b-4a56-8d39-5121bb32a2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:08.360623 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f562948-3e2b-4a56-8d39-5121bb32a2ac None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:08.360973 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f562948-3e2b-4a56-8d39-5121bb32a2ac None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:08.361318 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f562948-3e2b-4a56-8d39-5121bb32a2ac None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:08.362416 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f562948-3e2b-4a56-8d39-5121bb32a2ac None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:08.362791 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f562948-3e2b-4a56-8d39-5121bb32a2ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:08.364342 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f562948-3e2b-4a56-8d39-5121bb32a2ac None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:08.378128 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:08.398807 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6eb7bb-560b-4a62-81ea-bbb01100b743 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:08.408675 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 295/599] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Jun 23 15:38:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:08.414370 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f562948-3e2b-4a56-8d39-5121bb32a2ac None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:08.456870 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087b9bf-2fef-4ec5-89e3-24a87565ef53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:08.459189 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087b9bf-2fef-4ec5-89e3-24a87565ef53 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:08.459887 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087b9bf-2fef-4ec5-89e3-24a87565ef53 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:08.460530 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087b9bf-2fef-4ec5-89e3-24a87565ef53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:08.471559 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087b9bf-2fef-4ec5-89e3-24a87565ef53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:08.473625 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087b9bf-2fef-4ec5-89e3-24a87565ef53 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:08.492235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-a087b9bf-2fef-4ec5-89e3-24a87565ef53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:08.492235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:08.492235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:08.492235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:08.492235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:08.492235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:08.492235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:08.492235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:08.492235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:08.492235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:08.492235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:08.492235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:08.492235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:08.492235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:08.492235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:08.493161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:08.493161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:08.493161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:08.493161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:08.493161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:08.493161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:08.493161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:08.493161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:08.493161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:08.493161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:08.493161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:08.493161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:08.493161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:08.493161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:08.493161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:08.493161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:08.493161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:08.494102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:08.494102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:08.494102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:08.494102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:08.494102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:08.494102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:08.494102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:08.494102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:08.497603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 305/600] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:08.503843 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087b9bf-2fef-4ec5-89e3-24a87565ef53 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:08.635124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f562948-3e2b-4a56-8d39-5121bb32a2ac None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:08.657668 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087b9bf-2fef-4ec5-89e3-24a87565ef53 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:08.689244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:08.697979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab299161-85f2-427b-b36f-41e4eee2726b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:08.698552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac71e6-4bb1-44a6-937d-189e41f8521b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:08.699478 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab299161-85f2-427b-b36f-41e4eee2726b None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:08.699587 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac71e6-4bb1-44a6-937d-189e41f8521b None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:08.700491 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac71e6-4bb1-44a6-937d-189e41f8521b None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:08.700890 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac71e6-4bb1-44a6-937d-189e41f8521b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:08.701357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab299161-85f2-427b-b36f-41e4eee2726b None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:08.702233 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab299161-85f2-427b-b36f-41e4eee2726b None admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:08.704096 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab299161-85f2-427b-b36f-41e4eee2726b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:08.704788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab299161-85f2-427b-b36f-41e4eee2726b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:08.707564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab299161-85f2-427b-b36f-41e4eee2726b None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:08.718085 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac71e6-4bb1-44a6-937d-189e41f8521b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:08.719860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac71e6-4bb1-44a6-937d-189e41f8521b None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:08.720980 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:08.727481 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 306/601] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:08.729502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a10e4-8fdd-49b0-a6c4-58e031a38a42 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:08.729935 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a10e4-8fdd-49b0-a6c4-58e031a38a42 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:08.730329 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a10e4-8fdd-49b0-a6c4-58e031a38a42 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:08.733760 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 307/602] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:08.733760 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a10e4-8fdd-49b0-a6c4-58e031a38a42 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:08.745604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-37ac71e6-4bb1-44a6-937d-189e41f8521b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:08.745604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:08.745604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:08.745604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:08.745604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:08.745604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:08.745604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:08.745604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:08.745604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:08.745604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:08.745604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:08.745604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:08.745604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:08.745604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:08.745604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:08.747110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:08.747110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:08.747110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:08.747110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:08.747110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:08.747110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:08.747110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:08.747110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:08.747110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:08.747110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:08.747110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:08.747110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:08.747110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:08.747110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:08.747110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:08.747110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:08.747110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:08.748046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:08.748046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:08.748046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:08.748046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:08.750403 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 296/603] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:38:08.752029 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e9f70-e84b-424f-b5df-b3ba3be6ecfc None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:08.752545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e9f70-e84b-424f-b5df-b3ba3be6ecfc None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:08.752992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e9f70-e84b-424f-b5df-b3ba3be6ecfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:08.771894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-dd1e9f70-e84b-424f-b5df-b3ba3be6ecfc None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:08.773329 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-dd1e9f70-e84b-424f-b5df-b3ba3be6ecfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:08.858009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 297/604] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:38:08.859246 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e9f70-e84b-424f-b5df-b3ba3be6ecfc None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:08.896867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a10e4-8fdd-49b0-a6c4-58e031a38a42 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:08.943048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa90a55-cc6b-4273-9164-cb9f99972806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:08.944256 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa90a55-cc6b-4273-9164-cb9f99972806 None admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:08.944694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa90a55-cc6b-4273-9164-cb9f99972806 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:08.945182 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa90a55-cc6b-4273-9164-cb9f99972806 None admin] PATH_INFO: `/v3/projects/ff90b874f5b84d28a2752bc95419ad95/users/b524afb3b4b24025ad8bef85aa64bd91/roles/e004305755a2468aa60ab6632d39207a` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:08.966797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa90a55-cc6b-4273-9164-cb9f99972806 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff90b874f5b84d28a2752bc95419ad95, user_id=b524afb3b4b24025ad8bef85aa64bd91, role_id=e004305755a2468aa60ab6632d39207a)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:08.968414 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa90a55-cc6b-4273-9164-cb9f99972806 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:08.988156 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 308/605] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 23 15:38:08 2022] PUT /identity/v3/projects/ff90b874f5b84d28a2752bc95419ad95/users/b524afb3b4b24025ad8bef85aa64bd91/roles/e004305755a2468aa60ab6632d39207a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:38:08.989449 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa90a55-cc6b-4273-9164-cb9f99972806 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:09.006786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e9f70-e84b-424f-b5df-b3ba3be6ecfc None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:09.029148 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:09.061686 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe8d2d-5cab-45fb-95f7-6ad49893f9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:09.062685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe8d2d-5cab-45fb-95f7-6ad49893f9a6 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:09.063138 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe8d2d-5cab-45fb-95f7-6ad49893f9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:09.063568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe8d2d-5cab-45fb-95f7-6ad49893f9a6 None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:09.064440 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe8d2d-5cab-45fb-95f7-6ad49893f9a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:09.064983 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe8d2d-5cab-45fb-95f7-6ad49893f9a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:09.066605 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe8d2d-5cab-45fb-95f7-6ad49893f9a6 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:09.076438 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:09.087923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 298/606] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:09.095417 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe8d2d-5cab-45fb-95f7-6ad49893f9a6 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:09.191573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa90a55-cc6b-4273-9164-cb9f99972806 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:09.248765 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6d344-e173-4ec1-aead-81d1bcc07027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:09.250353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6d344-e173-4ec1-aead-81d1bcc07027 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:09.250958 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6d344-e173-4ec1-aead-81d1bcc07027 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:09.251583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6d344-e173-4ec1-aead-81d1bcc07027 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:09.265739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea6d344-e173-4ec1-aead-81d1bcc07027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:38:09.274127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-0ea6d344-e173-4ec1-aead-81d1bcc07027 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:09.274127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:09.274127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:09.274127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:09.274127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:09.274127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:09.274127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:09.274127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:09.274127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:09.274127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:09.274127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:09.274127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:09.274127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:38:09.274127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:38:09.274127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:38:09.274127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:38:09.275328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:38:09.275328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:38:09.275328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:38:09.275328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:38:09.275328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:09.275328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:09.275328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:09.275328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:09.275328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:09.275328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:09.275328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:09.275328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:09.275328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:09.275328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:09.275328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:09.275328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:09.276357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:09.276357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:09.276357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:09.276357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:09.276357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:38:09.276357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:38:09.276357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:38:09.276357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:38:09.276357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:38:09.276357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:38:09.276357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:09.276357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:09.281948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 309/607] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 23 15:38:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:09.284303 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6d344-e173-4ec1-aead-81d1bcc07027 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:09.306845 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe8d2d-5cab-45fb-95f7-6ad49893f9a6 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:09.348149 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f23e3-a072-4e87-a1af-2ad8852ce458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:09.348961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f23e3-a072-4e87-a1af-2ad8852ce458 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:09.349270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f23e3-a072-4e87-a1af-2ad8852ce458 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:09.349546 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f23e3-a072-4e87-a1af-2ad8852ce458 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:09.357500 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f23e3-a072-4e87-a1af-2ad8852ce458 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:09.359238 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f23e3-a072-4e87-a1af-2ad8852ce458 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:09.375325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-e74f23e3-a072-4e87-a1af-2ad8852ce458 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:09.375325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:09.375325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:09.375325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:09.375325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:09.375325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:09.375325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:09.375325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:09.375325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:09.375325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:09.375325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:09.375325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:09.375325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:09.375325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:09.375325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:09.376446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:09.376446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:09.376446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:09.376446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:09.376446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:09.376446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:09.376446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:09.376446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:09.376446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:09.376446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:09.376446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:09.376446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:09.376446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:09.376446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:09.376446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:09.376446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:09.376446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:09.377674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:09.377674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:09.377674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:09.377674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:09.377674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:09.377674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:09.377674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:09.377674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:09.377674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 299/608] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:09.388416 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f23e3-a072-4e87-a1af-2ad8852ce458 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:09.408843 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6d344-e173-4ec1-aead-81d1bcc07027 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:09.422476 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:09.459196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5e577-21da-4f93-ae7c-39c5262fa1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:09.460052 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5e577-21da-4f93-ae7c-39c5262fa1e3 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:09.460442 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5e577-21da-4f93-ae7c-39c5262fa1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:09.460980 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5e577-21da-4f93-ae7c-39c5262fa1e3 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:09.461872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5e577-21da-4f93-ae7c-39c5262fa1e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:09.461991 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:09.462615 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5e577-21da-4f93-ae7c-39c5262fa1e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:09.464977 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5e577-21da-4f93-ae7c-39c5262fa1e3 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:09.476307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 310/609] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 23 15:38:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:09.478300 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44adfa-9001-443c-b143-ab8470dad23c None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:09.478702 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44adfa-9001-443c-b143-ab8470dad23c None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:09.479086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44adfa-9001-443c-b143-ab8470dad23c None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:09.485595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 311/610] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:09.486940 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44adfa-9001-443c-b143-ab8470dad23c None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:09.567754 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f23e3-a072-4e87-a1af-2ad8852ce458 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:09.624747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff393fc-9997-4ea5-ab38-2f95568d2eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:09.625989 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff393fc-9997-4ea5-ab38-2f95568d2eff None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:09.626455 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff393fc-9997-4ea5-ab38-2f95568d2eff None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:09.626909 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff393fc-9997-4ea5-ab38-2f95568d2eff None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:09.629112 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff393fc-9997-4ea5-ab38-2f95568d2eff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:09.629443 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff393fc-9997-4ea5-ab38-2f95568d2eff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:09.631579 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff393fc-9997-4ea5-ab38-2f95568d2eff None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:09.634048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44adfa-9001-443c-b143-ab8470dad23c None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:09.647002 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 300/611] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:09.648850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0661089-f585-4366-91bd-f3fe825fe78a None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:09.649149 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0661089-f585-4366-91bd-f3fe825fe78a None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:09.649532 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0661089-f585-4366-91bd-f3fe825fe78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:09.673024 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-e0661089-f585-4366-91bd-f3fe825fe78a None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:09.674707 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-e0661089-f585-4366-91bd-f3fe825fe78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:09.687492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985b73f-ccaa-4698-8298-fc9cba8a3d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:09.688301 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985b73f-ccaa-4698-8298-fc9cba8a3d36 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:09.688588 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985b73f-ccaa-4698-8298-fc9cba8a3d36 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:09.688869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985b73f-ccaa-4698-8298-fc9cba8a3d36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:09.704680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985b73f-ccaa-4698-8298-fc9cba8a3d36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:09.706723 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985b73f-ccaa-4698-8298-fc9cba8a3d36 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:09.735981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-d985b73f-ccaa-4698-8298-fc9cba8a3d36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:09.735981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:09.735981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:09.735981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:09.735981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:09.735981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:09.735981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:09.735981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:09.735981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:09.735981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:09.735981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:09.735981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:09.735981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:09.735981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:09.735981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:09.739249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:09.739249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:09.739249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:09.739249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:09.739249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:09.739249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:09.739249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:09.739249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:09.739249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:09.739249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:09.739249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:09.739249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:09.739249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:09.739249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:09.739249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:09.739249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:09.739249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:09.741393 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:09.741393 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:09.741393 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:09.741393 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:09.741393 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 312/612] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:09.741393 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985b73f-ccaa-4698-8298-fc9cba8a3d36 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:09.775948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:09.798036 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 301/613] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:38:09.799523 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0661089-f585-4366-91bd-f3fe825fe78a None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:09.868053 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985b73f-ccaa-4698-8298-fc9cba8a3d36 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:09.882223 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:09.912341 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c33a1-080a-4431-9f88-3160770ea94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:09.913513 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c33a1-080a-4431-9f88-3160770ea94d None admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:09.913805 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c33a1-080a-4431-9f88-3160770ea94d None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:09.914113 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c33a1-080a-4431-9f88-3160770ea94d None admin] PATH_INFO: `/v3/projects/ff90b874f5b84d28a2752bc95419ad95/users/44e9fc6def5341a589221350067bb0fa/roles/e004305755a2468aa60ab6632d39207a` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:09.938232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c33a1-080a-4431-9f88-3160770ea94d None admin] RBAC: Authorizing `identity:create_grant(project_id=ff90b874f5b84d28a2752bc95419ad95, user_id=44e9fc6def5341a589221350067bb0fa, role_id=e004305755a2468aa60ab6632d39207a)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:09.939829 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c33a1-080a-4431-9f88-3160770ea94d None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:09.958215 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 313/614] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 23 15:38:09 2022] PUT /identity/v3/projects/ff90b874f5b84d28a2752bc95419ad95/users/44e9fc6def5341a589221350067bb0fa/roles/e004305755a2468aa60ab6632d39207a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:38:09.959599 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c33a1-080a-4431-9f88-3160770ea94d None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:09.976610 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0661089-f585-4366-91bd-f3fe825fe78a None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:10.037417 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58c2b2-abb1-4bad-b6dc-40ecd0f864b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:10.038369 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58c2b2-abb1-4bad-b6dc-40ecd0f864b4 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:10.038657 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58c2b2-abb1-4bad-b6dc-40ecd0f864b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:10.040122 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58c2b2-abb1-4bad-b6dc-40ecd0f864b4 None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:10.040122 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58c2b2-abb1-4bad-b6dc-40ecd0f864b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:10.040122 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58c2b2-abb1-4bad-b6dc-40ecd0f864b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:10.041384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58c2b2-abb1-4bad-b6dc-40ecd0f864b4 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:10.061264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 302/615] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:10.068156 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58c2b2-abb1-4bad-b6dc-40ecd0f864b4 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:10.110300 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:10.175708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c33a1-080a-4431-9f88-3160770ea94d None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:10.233287 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba19e9-55c0-478f-9f8e-2b42a8b966e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:10.234123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba19e9-55c0-478f-9f8e-2b42a8b966e8 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:10.234405 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba19e9-55c0-478f-9f8e-2b42a8b966e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:10.234680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba19e9-55c0-478f-9f8e-2b42a8b966e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:10.246342 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:10.252342 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba19e9-55c0-478f-9f8e-2b42a8b966e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:38:10.261375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-49ba19e9-55c0-478f-9f8e-2b42a8b966e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:10.261375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:10.261375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:10.261375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:10.261375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:10.261375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:10.261375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:10.261375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:10.261375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:10.261375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:10.261375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:10.261375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:10.261375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:38:10.261375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:38:10.261375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:38:10.261375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:38:10.263011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:38:10.263011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:38:10.263011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:38:10.263011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:38:10.263011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:10.263011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:10.263011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:10.263011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:10.263011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:10.263011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:10.263011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:10.263011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:10.263011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:10.263011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:10.263011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:10.263011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:10.263846 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:10.263846 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:10.263846 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:10.263846 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:10.263846 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:38:10.263846 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:38:10.263846 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:38:10.263846 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:38:10.263846 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:38:10.263846 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:38:10.263846 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:10.263846 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:10.269884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 314/616] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 23 15:38:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:10.274759 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba19e9-55c0-478f-9f8e-2b42a8b966e8 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:10.300815 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58c2b2-abb1-4bad-b6dc-40ecd0f864b4 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:10.382233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefb094-4e25-494a-b885-be37c0a378b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:10.383038 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefb094-4e25-494a-b885-be37c0a378b2 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:10.383320 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefb094-4e25-494a-b885-be37c0a378b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:10.383593 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefb094-4e25-494a-b885-be37c0a378b2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:10.398410 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefb094-4e25-494a-b885-be37c0a378b2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:10.400267 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefb094-4e25-494a-b885-be37c0a378b2 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:10.441437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-4aefb094-4e25-494a-b885-be37c0a378b2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 15:38:10.441437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:10.441437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:10.441437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:10.441437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:10.441437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:10.441437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:10.441437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:10.441437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:10.441437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:10.441437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:10.441437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:10.441437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:38:10.441437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:38:10.441437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:38:10.441437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:38:10.443857 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:10.443857 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:10.443857 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:10.443857 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:10.443857 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:10.443857 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:10.443857 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:10.443857 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:10.443857 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:10.443857 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:10.443857 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:10.443857 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:10.443857 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:10.443857 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:10.443857 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:10.443857 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:10.443857 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:10.443857 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:10.446297 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:10.446297 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:10.446297 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:38:10.446297 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:38:10.446297 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:38:10.446297 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:38:10.446297 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:38:10.446297 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:38:10.446297 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 15:38:10.446297 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:10.446297 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 303/617] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:38:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:10.452628 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefb094-4e25-494a-b885-be37c0a378b2 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:10.494038 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba19e9-55c0-478f-9f8e-2b42a8b966e8 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:10.562631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8181c40-30ef-43d9-ae7d-e641152ab9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:10.563411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8181c40-30ef-43d9-ae7d-e641152ab9b6 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:10.563813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8181c40-30ef-43d9-ae7d-e641152ab9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:10.564098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8181c40-30ef-43d9-ae7d-e641152ab9b6 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:10.564878 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8181c40-30ef-43d9-ae7d-e641152ab9b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:10.565189 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8181c40-30ef-43d9-ae7d-e641152ab9b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:10.566614 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8181c40-30ef-43d9-ae7d-e641152ab9b6 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:10.569017 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:10.579938 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 315/618] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 23 15:38:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:10.583453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dc81e-5f09-43b1-b746-4de9a6a911bd None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:10.584544 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dc81e-5f09-43b1-b746-4de9a6a911bd None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:10.585549 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dc81e-5f09-43b1-b746-4de9a6a911bd None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:10.588068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 316/619] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:10.589461 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25dc81e-5f09-43b1-b746-4de9a6a911bd None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:10.633971 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefb094-4e25-494a-b885-be37c0a378b2 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:10.681781 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24582eb3-9e89-4549-8b14-e6a4320ada3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:10.682628 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24582eb3-9e89-4549-8b14-e6a4320ada3f None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:10.682928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24582eb3-9e89-4549-8b14-e6a4320ada3f None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:10.683309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24582eb3-9e89-4549-8b14-e6a4320ada3f None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:10.684850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24582eb3-9e89-4549-8b14-e6a4320ada3f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:10.685086 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24582eb3-9e89-4549-8b14-e6a4320ada3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:10.687067 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24582eb3-9e89-4549-8b14-e6a4320ada3f None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:10.704164 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:10.716784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 304/620] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Jun 23 15:38:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:10.717921 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba50f4-4c17-490a-b3dc-4005dced87e0 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:10.718216 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba50f4-4c17-490a-b3dc-4005dced87e0 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:10.718499 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba50f4-4c17-490a-b3dc-4005dced87e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:10.743772 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-aeba50f4-4c17-490a-b3dc-4005dced87e0 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:10.747720 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-aeba50f4-4c17-490a-b3dc-4005dced87e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:10.751619 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25dc81e-5f09-43b1-b746-4de9a6a911bd None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:10.798289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce1988-c2f2-495e-81a6-eac214797449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:10.798669 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce1988-c2f2-495e-81a6-eac214797449 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:10.799069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce1988-c2f2-495e-81a6-eac214797449 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:10.799446 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce1988-c2f2-495e-81a6-eac214797449 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:10.817387 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce1988-c2f2-495e-81a6-eac214797449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:10.819369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce1988-c2f2-495e-81a6-eac214797449 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:10.836754 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 305/621] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:38:10.838000 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba50f4-4c17-490a-b3dc-4005dced87e0 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:10.843480 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-c4ce1988-c2f2-495e-81a6-eac214797449 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:10.843480 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:10.843480 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:10.843480 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:10.843480 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:10.843480 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:10.843480 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:10.843480 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:10.843480 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:10.843480 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:10.843480 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:10.843480 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:10.843480 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:10.843480 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:10.843480 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:10.844390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:10.844390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:10.844390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:10.844390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:10.844390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:10.844390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:10.844390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:10.844390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:10.844390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:10.844390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:10.844390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:10.844390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:10.844390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:10.844390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:10.844390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:10.844390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:10.844390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:10.845255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:10.845255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:10.845255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:10.845255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:10.845255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 317/622] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:10.852156 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce1988-c2f2-495e-81a6-eac214797449 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:10.955583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:10.971603 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba50f4-4c17-490a-b3dc-4005dced87e0 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:11.017087 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:11.018254 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce1988-c2f2-495e-81a6-eac214797449 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:11.026674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645c1aa-7561-43f9-a0cd-25090fb04916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:11.028345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645c1aa-7561-43f9-a0cd-25090fb04916 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:11.029480 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645c1aa-7561-43f9-a0cd-25090fb04916 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:11.029994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645c1aa-7561-43f9-a0cd-25090fb04916 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:11.045441 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645c1aa-7561-43f9-a0cd-25090fb04916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:11.047264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645c1aa-7561-43f9-a0cd-25090fb04916 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:11.062895 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ddad93-eed0-40d3-bde9-e2d6799e04aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:11.063616 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddad93-eed0-40d3-bde9-e2d6799e04aa None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:11.063898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddad93-eed0-40d3-bde9-e2d6799e04aa None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:11.064170 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddad93-eed0-40d3-bde9-e2d6799e04aa None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:11.065156 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ddad93-eed0-40d3-bde9-e2d6799e04aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:11.065513 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ddad93-eed0-40d3-bde9-e2d6799e04aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:11.066936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ddad93-eed0-40d3-bde9-e2d6799e04aa None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:11.078888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-b645c1aa-7561-43f9-a0cd-25090fb04916 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:11.078888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:11.078888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:11.078888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:11.078888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:11.078888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:11.078888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:11.078888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:11.078888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:11.078888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:11.078888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:11.078888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:11.078888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:11.078888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:11.078888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:11.079823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:11.079823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:11.079823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:11.079823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:11.079823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:11.079823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:11.079823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:11.079823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:11.079823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:11.079823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:11.079823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:11.079823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:11.079823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:11.079823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:11.079823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:11.079823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:11.079823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:11.080705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:11.080705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:11.080705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:11.080705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:11.082923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 306/623] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:11.083972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645c1aa-7561-43f9-a0cd-25090fb04916 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:11.089603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 318/624] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:11.091205 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ddad93-eed0-40d3-bde9-e2d6799e04aa None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:11.198798 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ddad93-eed0-40d3-bde9-e2d6799e04aa None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:11.209041 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:11.238118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880ab72-f5cd-4b04-b6ec-4f61a52b148b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:11.238853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880ab72-f5cd-4b04-b6ec-4f61a52b148b None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:11.239177 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880ab72-f5cd-4b04-b6ec-4f61a52b148b None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:11.239411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880ab72-f5cd-4b04-b6ec-4f61a52b148b None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:11.240192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880ab72-f5cd-4b04-b6ec-4f61a52b148b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:11.240504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880ab72-f5cd-4b04-b6ec-4f61a52b148b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:11.242145 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880ab72-f5cd-4b04-b6ec-4f61a52b148b None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:11.245154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645c1aa-7561-43f9-a0cd-25090fb04916 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:11.255763 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 319/625] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:11.256703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880ab72-f5cd-4b04-b6ec-4f61a52b148b None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:11.283407 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c18a2-7472-476d-a686-764cd7f82df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:11.284460 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c18a2-7472-476d-a686-764cd7f82df6 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:11.284915 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c18a2-7472-476d-a686-764cd7f82df6 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:11.285343 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c18a2-7472-476d-a686-764cd7f82df6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:11.296603 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c18a2-7472-476d-a686-764cd7f82df6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:38:11.304843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-de2c18a2-7472-476d-a686-764cd7f82df6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:11.304843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:11.304843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:11.304843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:11.304843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:11.304843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:11.304843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:11.304843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:11.304843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:11.304843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:11.304843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:11.304843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:11.304843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:38:11.304843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:38:11.304843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:38:11.304843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:38:11.306045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:38:11.306045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:38:11.306045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:38:11.306045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:38:11.306045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:11.306045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:11.306045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:11.306045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:11.306045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:11.306045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:11.306045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:11.306045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:11.306045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:11.306045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:11.306045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:11.306045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:11.306962 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:11.306962 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:11.306962 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:11.306962 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:11.306962 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:38:11.306962 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:38:11.306962 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:38:11.306962 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:38:11.306962 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:38:11.306962 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:38:11.306962 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:11.306962 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:11.309335 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 307/626] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 23 15:38:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:11.310590 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c18a2-7472-476d-a686-764cd7f82df6 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:11.357880 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:11.375207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880ab72-f5cd-4b04-b6ec-4f61a52b148b None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:11.414425 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cfc7c-300f-4dd3-870a-c4c19cca96c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:11.415619 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cfc7c-300f-4dd3-870a-c4c19cca96c2 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:11.416063 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cfc7c-300f-4dd3-870a-c4c19cca96c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:11.416499 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cfc7c-300f-4dd3-870a-c4c19cca96c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:11.422739 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c18a2-7472-476d-a686-764cd7f82df6 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:11.427181 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cfc7c-300f-4dd3-870a-c4c19cca96c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:11.428935 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cfc7c-300f-4dd3-870a-c4c19cca96c2 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:11.445813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-5f1cfc7c-300f-4dd3-870a-c4c19cca96c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 15:38:11.445813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:11.445813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:11.445813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:11.445813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:11.445813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:11.445813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:11.445813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:11.445813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:11.445813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:11.445813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:11.445813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:11.445813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:38:11.445813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:38:11.445813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:38:11.445813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:38:11.447030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:11.447030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:11.447030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:11.447030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:11.447030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:11.447030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:11.447030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:11.447030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:11.447030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:11.447030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:11.447030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:11.447030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:11.447030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:11.447030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:11.447030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:11.447030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:11.447030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:11.447030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:11.448028 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:11.448028 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:11.448028 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:38:11.448028 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:38:11.448028 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:38:11.448028 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:38:11.448028 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:38:11.448028 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:38:11.448028 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 15:38:11.448028 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:11.454769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 320/627] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jun 23 15:38:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:11.456054 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cfc7c-300f-4dd3-870a-c4c19cca96c2 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:11.461095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7291011-7e30-420c-a420-3980c87b9a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:11.461969 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7291011-7e30-420c-a420-3980c87b9a43 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:11.462261 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7291011-7e30-420c-a420-3980c87b9a43 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:11.462539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7291011-7e30-420c-a420-3980c87b9a43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:11.470975 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7291011-7e30-420c-a420-3980c87b9a43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:11.472277 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7291011-7e30-420c-a420-3980c87b9a43 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:11.488602 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:11.488799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-a7291011-7e30-420c-a420-3980c87b9a43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:11.488799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:11.488799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:11.488799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:11.488799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:11.488799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:11.488799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:11.488799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:11.488799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:11.488799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:11.488799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:11.488799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:11.488799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:11.488799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:11.488799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:11.489683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:11.489683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:11.489683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:11.489683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:11.489683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:11.489683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:11.489683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:11.489683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:11.489683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:11.489683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:11.489683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:11.489683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:11.489683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:11.489683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:11.489683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:11.489683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:11.489683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:11.490562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:11.490562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:11.490562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:11.490562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:11.490562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:11.490562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:11.490562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:11.490562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:11.490562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 308/628] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:11.491050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7291011-7e30-420c-a420-3980c87b9a43 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:11.580887 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cfc7c-300f-4dd3-870a-c4c19cca96c2 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:11.606435 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7291011-7e30-420c-a420-3980c87b9a43 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:11.608190 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:11.619838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938a8b8-b301-4ada-b75b-9c9253dc8ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:11.620513 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938a8b8-b301-4ada-b75b-9c9253dc8ef0 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:11.620801 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938a8b8-b301-4ada-b75b-9c9253dc8ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:11.621324 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938a8b8-b301-4ada-b75b-9c9253dc8ef0 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:11.622403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938a8b8-b301-4ada-b75b-9c9253dc8ef0 None admin] RBAC: Adding query filter params (name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:11.622715 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938a8b8-b301-4ada-b75b-9c9253dc8ef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:11.624093 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938a8b8-b301-4ada-b75b-9c9253dc8ef0 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:11.633052 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 321/629] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 23 15:38:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:11.634318 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13eb88-2931-46ac-914e-4dde855065e9 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:11.634612 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13eb88-2931-46ac-914e-4dde855065e9 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:11.634895 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13eb88-2931-46ac-914e-4dde855065e9 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:11.636248 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 322/630] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:11.641518 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13eb88-2931-46ac-914e-4dde855065e9 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:11.647515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09699be-56fe-47aa-8151-2cce7bd840b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:11.648259 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09699be-56fe-47aa-8151-2cce7bd840b9 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:11.648545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09699be-56fe-47aa-8151-2cce7bd840b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:11.648841 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09699be-56fe-47aa-8151-2cce7bd840b9 None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:11.649681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09699be-56fe-47aa-8151-2cce7bd840b9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:11.650018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09699be-56fe-47aa-8151-2cce7bd840b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:11.651443 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09699be-56fe-47aa-8151-2cce7bd840b9 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:11.669514 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 309/631] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jun 23 15:38:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:11.670700 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09699be-56fe-47aa-8151-2cce7bd840b9 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:11.745403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:11.758559 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13eb88-2931-46ac-914e-4dde855065e9 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:11.777311 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09699be-56fe-47aa-8151-2cce7bd840b9 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:11.796264 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a2a33-58c9-4e4e-a9a8-671c61ded042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:11.796927 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a2a33-58c9-4e4e-a9a8-671c61ded042 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:11.797209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a2a33-58c9-4e4e-a9a8-671c61ded042 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:11.797487 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a2a33-58c9-4e4e-a9a8-671c61ded042 None admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:11.798296 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a2a33-58c9-4e4e-a9a8-671c61ded042 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:11.798612 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a2a33-58c9-4e4e-a9a8-671c61ded042 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:11.800038 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a2a33-58c9-4e4e-a9a8-671c61ded042 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:11.813248 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 323/632] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:11.814362 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356951c-029a-4087-8fb9-74146ee22aae None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:11.814654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356951c-029a-4087-8fb9-74146ee22aae None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:11.814939 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356951c-029a-4087-8fb9-74146ee22aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:11.815365 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e54045-eed7-4826-bc86-950d6a7653a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:11.816653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e54045-eed7-4826-bc86-950d6a7653a4 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:11.817301 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e54045-eed7-4826-bc86-950d6a7653a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:11.817904 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e54045-eed7-4826-bc86-950d6a7653a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:11.830701 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e54045-eed7-4826-bc86-950d6a7653a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:11.832155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e54045-eed7-4826-bc86-950d6a7653a4 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:11.834127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-1356951c-029a-4087-8fb9-74146ee22aae None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:11.835686 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-1356951c-029a-4087-8fb9-74146ee22aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:11.852680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-e8e54045-eed7-4826-bc86-950d6a7653a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:11.852680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:11.852680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:11.852680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:11.852680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:11.852680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:11.852680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:11.852680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:11.852680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:11.852680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:11.852680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:11.852680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:11.852680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:11.852680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:11.852680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:11.853611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:11.853611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:11.853611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:11.853611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:11.853611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:11.853611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:11.853611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:11.853611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:11.853611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:11.853611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:11.853611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:11.853611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:11.853611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:11.853611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:11.853611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:11.853611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:11.853611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:11.854510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:11.854510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:11.854510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:11.854510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:11.854510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 310/633] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:11.854796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e54045-eed7-4826-bc86-950d6a7653a4 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:11.874364 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:11.912796 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 324/634] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:38:11.913696 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356951c-029a-4087-8fb9-74146ee22aae None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:11.983878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e54045-eed7-4826-bc86-950d6a7653a4 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:11.998759 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:12.022754 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c845af3-d550-4c04-9d1e-0f3d8bfe54ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:12.023416 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c845af3-d550-4c04-9d1e-0f3d8bfe54ea None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:12.023702 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c845af3-d550-4c04-9d1e-0f3d8bfe54ea None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:12.023983 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c845af3-d550-4c04-9d1e-0f3d8bfe54ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:12.025056 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356951c-029a-4087-8fb9-74146ee22aae None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:12.068650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcf55a-a383-4e3f-92c5-26a383483af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:12.069675 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcf55a-a383-4e3f-92c5-26a383483af8 None admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:12.070314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcf55a-a383-4e3f-92c5-26a383483af8 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:12.070314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcf55a-a383-4e3f-92c5-26a383483af8 None admin] PATH_INFO: `/v3/projects/ff90b874f5b84d28a2752bc95419ad95/users/5824ee17e276483faf20db88a93545f3/roles/e004305755a2468aa60ab6632d39207a` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:12.087399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcf55a-a383-4e3f-92c5-26a383483af8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff90b874f5b84d28a2752bc95419ad95, user_id=5824ee17e276483faf20db88a93545f3, role_id=e004305755a2468aa60ab6632d39207a)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:12.088850 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcf55a-a383-4e3f-92c5-26a383483af8 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:12.102639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c845af3-d550-4c04-9d1e-0f3d8bfe54ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:12.114235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 325/635] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 23 15:38:11 2022] PUT /identity/v3/projects/ff90b874f5b84d28a2752bc95419ad95/users/5824ee17e276483faf20db88a93545f3/roles/e004305755a2468aa60ab6632d39207a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:38:12.114450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c845af3-d550-4c04-9d1e-0f3d8bfe54ea None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:12.114583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcf55a-a383-4e3f-92c5-26a383483af8 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:12.130743 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:12.244510 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcf55a-a383-4e3f-92c5-26a383483af8 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:12.279460 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 311/636] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:38:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:38:12.280498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c845af3-d550-4c04-9d1e-0f3d8bfe54ea None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:12.293641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:12.304677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be81cf-a2b9-43e7-bd10-03e645492143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:12.304677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be81cf-a2b9-43e7-bd10-03e645492143 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:12.304677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be81cf-a2b9-43e7-bd10-03e645492143 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:12.304677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be81cf-a2b9-43e7-bd10-03e645492143 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:12.305752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be81cf-a2b9-43e7-bd10-03e645492143 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:12.306902 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be81cf-a2b9-43e7-bd10-03e645492143 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:12.309600 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be81cf-a2b9-43e7-bd10-03e645492143 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:12.327057 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 326/637] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:12.327952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be81cf-a2b9-43e7-bd10-03e645492143 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:12.414586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c845af3-d550-4c04-9d1e-0f3d8bfe54ea None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:12.429426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:12.453741 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc5df7-433a-4718-8fee-288d5cf26c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:12.455076 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc5df7-433a-4718-8fee-288d5cf26c71 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:12.455606 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc5df7-433a-4718-8fee-288d5cf26c71 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:12.456096 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc5df7-433a-4718-8fee-288d5cf26c71 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:12.468776 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc5df7-433a-4718-8fee-288d5cf26c71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:38:12.477619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-bfbc5df7-433a-4718-8fee-288d5cf26c71 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:12.477619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:12.477619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:12.477619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:12.477619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:12.477619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:12.477619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:12.477619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:12.477619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:12.477619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:12.477619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:12.477619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:12.477619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:38:12.477619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:38:12.477619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:38:12.477619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:38:12.478647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:38:12.478647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:38:12.478647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:38:12.478647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:38:12.478647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:12.478647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:12.478647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:12.478647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:12.478647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:12.478647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:12.478647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:12.478647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:12.478647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:12.478647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:12.478647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:12.478647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:12.479481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:12.479481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:12.479481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:12.479481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:12.479481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:38:12.479481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:38:12.479481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:38:12.479481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:38:12.479481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:38:12.479481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:38:12.479481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:12.479481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:12.480104 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be81cf-a2b9-43e7-bd10-03e645492143 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:12.482483 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 312/638] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 23 15:38:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:12.488454 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc5df7-433a-4718-8fee-288d5cf26c71 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:12.522161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247ef71-caf6-46a8-88f9-aa4315f184a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:12.522977 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247ef71-caf6-46a8-88f9-aa4315f184a6 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:12.523266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247ef71-caf6-46a8-88f9-aa4315f184a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:12.523679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247ef71-caf6-46a8-88f9-aa4315f184a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:12.539330 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247ef71-caf6-46a8-88f9-aa4315f184a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:12.541265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247ef71-caf6-46a8-88f9-aa4315f184a6 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:12.564231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-2247ef71-caf6-46a8-88f9-aa4315f184a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:12.564231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:12.564231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:12.564231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:12.564231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:12.564231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:12.564231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:12.564231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:12.564231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:12.564231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:12.564231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:12.564231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:12.564231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:12.564231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:12.564231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:12.565217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:12.565217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:12.565217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:12.565217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:12.565217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:12.565217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:12.565217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:12.565217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:12.565217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:12.565217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:12.565217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:12.565217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:12.565217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:12.565217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:12.565217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:12.565217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:12.565217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:12.566356 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:12.566356 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:12.566356 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:12.566356 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:12.569886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 327/639] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:12.571074 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247ef71-caf6-46a8-88f9-aa4315f184a6 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:12.619484 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:12.624521 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc5df7-433a-4718-8fee-288d5cf26c71 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:12.672020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04012e1-78b2-41ec-8587-c9ac802bf290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:12.673276 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04012e1-78b2-41ec-8587-c9ac802bf290 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:12.673871 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04012e1-78b2-41ec-8587-c9ac802bf290 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:12.674360 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04012e1-78b2-41ec-8587-c9ac802bf290 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:12.683308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04012e1-78b2-41ec-8587-c9ac802bf290 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:12.684841 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04012e1-78b2-41ec-8587-c9ac802bf290 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:12.698016 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247ef71-caf6-46a8-88f9-aa4315f184a6 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:12.700481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-d04012e1-78b2-41ec-8587-c9ac802bf290 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 15:38:12.700481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:12.700481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:12.700481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:12.700481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:12.700481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:12.700481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:12.700481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:12.700481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:12.700481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:12.700481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:12.700481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:12.700481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:38:12.700481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:38:12.700481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:38:12.700481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:38:12.701450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:12.701450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:12.701450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:12.701450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:12.701450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:12.701450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:12.701450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:12.701450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:12.701450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:12.701450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:12.701450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:12.701450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:12.701450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:12.701450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:12.701450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:12.701450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:12.701450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:12.701450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:12.702595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:12.702595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:12.702595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:38:12.702595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:38:12.702595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:38:12.702595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:38:12.702595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:38:12.702595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:38:12.702595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 15:38:12.702595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:12.702595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 313/640] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:38:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:12.702595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04012e1-78b2-41ec-8587-c9ac802bf290 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:12.735579 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:12.748739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5d722-c495-43bd-8035-69eaed18a499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:12.749410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5d722-c495-43bd-8035-69eaed18a499 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:12.749691 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5d722-c495-43bd-8035-69eaed18a499 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:12.749996 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5d722-c495-43bd-8035-69eaed18a499 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:12.750748 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5d722-c495-43bd-8035-69eaed18a499 None admin] RBAC: Adding query filter params (name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:12.751062 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5d722-c495-43bd-8035-69eaed18a499 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:12.752418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5d722-c495-43bd-8035-69eaed18a499 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:12.761233 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 328/641] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 23 15:38:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:12.767905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24975b-8e5f-47a5-9f0e-97fc96399b4a None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:12.768234 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24975b-8e5f-47a5-9f0e-97fc96399b4a None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:12.768484 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24975b-8e5f-47a5-9f0e-97fc96399b4a None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:12.775698 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 329/642] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:12 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:12.776606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24975b-8e5f-47a5-9f0e-97fc96399b4a None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:12.828635 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04012e1-78b2-41ec-8587-c9ac802bf290 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:12.878526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a4323-b6fc-4636-b2b8-6046556045ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:12.879212 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a4323-b6fc-4636-b2b8-6046556045ee None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:12.879486 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a4323-b6fc-4636-b2b8-6046556045ee None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:12.879775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a4323-b6fc-4636-b2b8-6046556045ee None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:12.880523 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a4323-b6fc-4636-b2b8-6046556045ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:12.880923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a4323-b6fc-4636-b2b8-6046556045ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:12.882279 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a4323-b6fc-4636-b2b8-6046556045ee None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:12.905876 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 314/643] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:12.905876 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a4323-b6fc-4636-b2b8-6046556045ee None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:12.924369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24975b-8e5f-47a5-9f0e-97fc96399b4a None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:12.927655 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:12.969275 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9d122-13a6-4ac3-8c6e-cbb1ee52a8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:12.969983 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9d122-13a6-4ac3-8c6e-cbb1ee52a8d6 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:12.970267 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9d122-13a6-4ac3-8c6e-cbb1ee52a8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:12.970545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9d122-13a6-4ac3-8c6e-cbb1ee52a8d6 None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:12.971529 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9d122-13a6-4ac3-8c6e-cbb1ee52a8d6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:12.971840 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9d122-13a6-4ac3-8c6e-cbb1ee52a8d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:12.973271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9d122-13a6-4ac3-8c6e-cbb1ee52a8d6 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:12.990406 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 330/644] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Jun 23 15:38:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:12.991719 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67a68b-08d7-4a2e-9d8d-d3c5137ebe66 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:12.992008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67a68b-08d7-4a2e-9d8d-d3c5137ebe66 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:12.992286 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67a68b-08d7-4a2e-9d8d-d3c5137ebe66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:13.011209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-8b67a68b-08d7-4a2e-9d8d-d3c5137ebe66 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:13.013145 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-8b67a68b-08d7-4a2e-9d8d-d3c5137ebe66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:13.014040 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:13.023781 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a4323-b6fc-4636-b2b8-6046556045ee None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:13.061282 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690976f-9915-4935-9c31-e46d66d24eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:13.062103 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690976f-9915-4935-9c31-e46d66d24eee None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:13.062392 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690976f-9915-4935-9c31-e46d66d24eee None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:13.062666 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690976f-9915-4935-9c31-e46d66d24eee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:13.072736 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690976f-9915-4935-9c31-e46d66d24eee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:13.074223 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690976f-9915-4935-9c31-e46d66d24eee None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:13.091036 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 331/645] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:38:13.092340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-7690976f-9915-4935-9c31-e46d66d24eee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:13.092340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:13.092340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:13.092340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:13.092340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:13.092340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:13.092340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:13.092340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:13.092340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:13.092340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:13.092340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:13.092340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:13.092340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:13.092340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:13.092340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:13.093581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:13.093581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:13.093581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:13.093581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:13.093581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:13.093581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:13.093581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:13.093581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:13.093581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:13.093581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:13.093581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:13.093581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:13.093581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:13.093581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:13.093581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:13.093581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:13.093581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:13.094671 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:13.094671 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:13.094671 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:13.094671 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:13.095516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67a68b-08d7-4a2e-9d8d-d3c5137ebe66 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:13.097983 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 315/646] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:13.098807 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690976f-9915-4935-9c31-e46d66d24eee None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:13.203873 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690976f-9915-4935-9c31-e46d66d24eee None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:13.214079 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:13.223658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67a68b-08d7-4a2e-9d8d-d3c5137ebe66 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:13.240628 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40241285-239c-4d12-a828-ee8afe522ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:13.241279 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40241285-239c-4d12-a828-ee8afe522ff7 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:13.241567 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40241285-239c-4d12-a828-ee8afe522ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:13.241846 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40241285-239c-4d12-a828-ee8afe522ff7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:13.257388 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:13.266684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91682928-02f4-492c-9546-e94b10ce26e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:13.267516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91682928-02f4-492c-9546-e94b10ce26e3 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:13.267799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91682928-02f4-492c-9546-e94b10ce26e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:13.268096 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91682928-02f4-492c-9546-e94b10ce26e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:13.275378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91682928-02f4-492c-9546-e94b10ce26e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:13.276832 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91682928-02f4-492c-9546-e94b10ce26e3 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:13.294138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-91682928-02f4-492c-9546-e94b10ce26e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:13.294138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:13.294138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:13.294138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:13.294138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:13.294138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:13.294138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:13.294138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:13.294138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:13.294138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:13.294138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:13.294138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:13.294138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:13.294138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:13.294138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:13.295152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:13.295152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:13.295152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:13.295152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:13.295152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:13.295152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:13.295152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:13.295152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:13.295152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:13.295152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:13.295152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:13.295152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:13.295152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:13.295152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:13.295152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:13.295152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:13.295152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:13.296081 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:13.296081 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:13.296081 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:13.296081 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:13.296081 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:13.296081 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:13.296081 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:13.296081 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:13.296081 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 332/647] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:13.296577 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91682928-02f4-492c-9546-e94b10ce26e3 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:13.323944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40241285-239c-4d12-a828-ee8afe522ff7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:13.325972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40241285-239c-4d12-a828-ee8afe522ff7 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:13.408314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91682928-02f4-492c-9546-e94b10ce26e3 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:13.432156 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 316/648] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:38:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:38:13.433335 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40241285-239c-4d12-a828-ee8afe522ff7 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:13.449513 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728080f-d82b-47fa-b062-5fd7f8b920a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:13.451025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728080f-d82b-47fa-b062-5fd7f8b920a7 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:13.451528 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728080f-d82b-47fa-b062-5fd7f8b920a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:13.451956 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728080f-d82b-47fa-b062-5fd7f8b920a7 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:13.452843 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728080f-d82b-47fa-b062-5fd7f8b920a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:13.453160 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728080f-d82b-47fa-b062-5fd7f8b920a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:13.454623 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728080f-d82b-47fa-b062-5fd7f8b920a7 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:13.472443 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 333/649] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:13.473394 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728080f-d82b-47fa-b062-5fd7f8b920a7 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:13.482657 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:13.491665 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:13.538693 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40241285-239c-4d12-a828-ee8afe522ff7 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:13.579622 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7bd1d-40ac-4271-8d0c-f20e9aab103d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:13.580834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7bd1d-40ac-4271-8d0c-f20e9aab103d None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:13.581248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7bd1d-40ac-4271-8d0c-f20e9aab103d None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:13.581671 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7bd1d-40ac-4271-8d0c-f20e9aab103d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:13.595870 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728080f-d82b-47fa-b062-5fd7f8b920a7 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:13.598735 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7bd1d-40ac-4271-8d0c-f20e9aab103d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:38:13.611831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-e6c7bd1d-40ac-4271-8d0c-f20e9aab103d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:13.611831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:13.611831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:13.611831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:13.611831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:13.611831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:13.611831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:13.611831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:13.611831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:13.611831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:13.611831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:13.611831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:13.611831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:38:13.611831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:38:13.611831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:38:13.611831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:38:13.612801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:38:13.612801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:38:13.612801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:38:13.612801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:38:13.612801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:13.612801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:13.612801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:13.612801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:13.612801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:13.612801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:13.612801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:13.612801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:13.612801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:13.612801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:13.612801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:13.612801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:13.613651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:13.613651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:13.613651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:13.613651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:13.613651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:38:13.613651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:38:13.613651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:38:13.613651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:38:13.613651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:38:13.613651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:38:13.613651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:13.613651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:13.614943 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 317/650] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 23 15:38:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:13.614943 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7bd1d-40ac-4271-8d0c-f20e9aab103d None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:13.640498 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117d444-2dfa-409a-b759-12300d762d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:13.642152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117d444-2dfa-409a-b759-12300d762d64 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:13.642649 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117d444-2dfa-409a-b759-12300d762d64 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:13.643382 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117d444-2dfa-409a-b759-12300d762d64 None admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:13.644419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117d444-2dfa-409a-b759-12300d762d64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:13.645216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117d444-2dfa-409a-b759-12300d762d64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:13.647359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117d444-2dfa-409a-b759-12300d762d64 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:13.671774 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 334/651] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:13.671774 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117d444-2dfa-409a-b759-12300d762d64 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:13.738280 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7bd1d-40ac-4271-8d0c-f20e9aab103d None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:13.741492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:13.769336 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:13.778538 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d6ba4-6e1c-4731-a30f-a3fabdefe4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:13.779579 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d6ba4-6e1c-4731-a30f-a3fabdefe4f2 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:13.780011 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d6ba4-6e1c-4731-a30f-a3fabdefe4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:13.780432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d6ba4-6e1c-4731-a30f-a3fabdefe4f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:13.793672 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d6ba4-6e1c-4731-a30f-a3fabdefe4f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:13.795475 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d6ba4-6e1c-4731-a30f-a3fabdefe4f2 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:13.811134 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117d444-2dfa-409a-b759-12300d762d64 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:13.818526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-1a7d6ba4-6e1c-4731-a30f-a3fabdefe4f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:13.818526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:13.818526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:13.818526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:13.818526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:13.818526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:13.818526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:13.818526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:13.818526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:13.818526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:13.818526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:13.818526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:13.818526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:13.818526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:13.818526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:13.819621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:13.819621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:13.819621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:13.819621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:13.819621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:13.819621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:13.819621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:13.819621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:13.819621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:13.819621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:13.819621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:13.819621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:13.819621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:13.819621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:13.819621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:13.819621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:13.819621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:13.820520 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:13.820520 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:13.820520 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:13.820520 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:13.820520 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 318/652] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:13.820797 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d6ba4-6e1c-4731-a30f-a3fabdefe4f2 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:13.853649 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f9ea2-72e4-4c8b-b06a-c5d1a2e28f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:13.854795 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f9ea2-72e4-4c8b-b06a-c5d1a2e28f8e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:13.855260 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f9ea2-72e4-4c8b-b06a-c5d1a2e28f8e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:13.855684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f9ea2-72e4-4c8b-b06a-c5d1a2e28f8e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:13.865227 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f9ea2-72e4-4c8b-b06a-c5d1a2e28f8e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:13.866945 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f9ea2-72e4-4c8b-b06a-c5d1a2e28f8e None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:13.883886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-930f9ea2-72e4-4c8b-b06a-c5d1a2e28f8e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 15:38:13.883886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:13.883886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:13.883886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:13.883886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:13.883886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:13.883886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:13.883886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:13.883886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:13.883886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:13.883886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:13.883886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:13.883886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:38:13.883886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:38:13.883886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:38:13.883886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:38:13.885249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:13.885249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:13.885249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:13.885249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:13.885249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:13.885249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:13.885249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:13.885249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:13.885249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:13.885249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:13.885249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:13.885249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:13.885249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:13.885249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:13.885249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:13.885249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:13.885249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:13.885249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:13.886502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:13.886502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:13.886502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:38:13.886502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:38:13.886502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:38:13.886502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:38:13.886502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:38:13.886502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:38:13.886502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 15:38:13.886502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:13.890263 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 335/653] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:38:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:13.891302 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f9ea2-72e4-4c8b-b06a-c5d1a2e28f8e None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:13.937397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d6ba4-6e1c-4731-a30f-a3fabdefe4f2 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:13.981897 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cea12a-a172-426d-9695-85291289273c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:13.983024 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cea12a-a172-426d-9695-85291289273c None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:13.983492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cea12a-a172-426d-9695-85291289273c None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:13.983957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cea12a-a172-426d-9695-85291289273c None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:13.984942 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cea12a-a172-426d-9695-85291289273c None admin] RBAC: Adding query filter params (name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:13.985437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cea12a-a172-426d-9695-85291289273c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:13.987051 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cea12a-a172-426d-9695-85291289273c None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:13.996005 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 319/654] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 23 15:38:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:13.997226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cea12a-a172-426d-9695-85291289273c None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:14.019919 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f9ea2-72e4-4c8b-b06a-c5d1a2e28f8e None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:14.024382 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:14.058677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:14.069553 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f5599-b7a8-4b0c-a0fd-f80bece4eaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:14.070835 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f5599-b7a8-4b0c-a0fd-f80bece4eaf1 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:14.071427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f5599-b7a8-4b0c-a0fd-f80bece4eaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:14.072021 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f5599-b7a8-4b0c-a0fd-f80bece4eaf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:14.073683 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f5599-b7a8-4b0c-a0fd-f80bece4eaf1 None admin] RBAC: Adding query filter params (role.id=e004305755a2468aa60ab6632d39207a, scope.project.id=ff90b874f5b84d28a2752bc95419ad95, user.id=d54521ea1dca44c98d6723d0b9fd6468) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:14.074377 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f5599-b7a8-4b0c-a0fd-f80bece4eaf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:14.077293 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f5599-b7a8-4b0c-a0fd-f80bece4eaf1 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:14.097892 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 336/655] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:38:13 2022] GET /identity/v3/role_assignments?user.id=d54521ea1dca44c98d6723d0b9fd6468&scope.project.id=ff90b874f5b84d28a2752bc95419ad95&role.id=e004305755a2468aa60ab6632d39207a => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:14.097892 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f5599-b7a8-4b0c-a0fd-f80bece4eaf1 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:14.147554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cea12a-a172-426d-9695-85291289273c None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:14.206375 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7bbce-d014-48d2-a046-60ac251e122b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:14.207239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7bbce-d014-48d2-a046-60ac251e122b None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:14.207627 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7bbce-d014-48d2-a046-60ac251e122b None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:14.208001 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7bbce-d014-48d2-a046-60ac251e122b None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:14.208858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7bbce-d014-48d2-a046-60ac251e122b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:14.209293 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7bbce-d014-48d2-a046-60ac251e122b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:14.211292 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7bbce-d014-48d2-a046-60ac251e122b None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:14.230312 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 320/656] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:14.231474 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7bbce-d014-48d2-a046-60ac251e122b None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:14.270660 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f5599-b7a8-4b0c-a0fd-f80bece4eaf1 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:14.320213 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34db2f-1de3-4a32-ad28-0c8e7ffd9ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:14.320900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34db2f-1de3-4a32-ad28-0c8e7ffd9ed1 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:14.321771 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34db2f-1de3-4a32-ad28-0c8e7ffd9ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:14.321771 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34db2f-1de3-4a32-ad28-0c8e7ffd9ed1 None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:14.323161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34db2f-1de3-4a32-ad28-0c8e7ffd9ed1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:14.323161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34db2f-1de3-4a32-ad28-0c8e7ffd9ed1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:14.324165 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34db2f-1de3-4a32-ad28-0c8e7ffd9ed1 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:14.338738 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:14.348476 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 337/657] 10.222.0.15 () {56 vars in 1137 bytes} [Thu Jun 23 15:38:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:14.348476 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34db2f-1de3-4a32-ad28-0c8e7ffd9ed1 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:14.372795 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7bbce-d014-48d2-a046-60ac251e122b None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:14.414193 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc458993-da93-4e50-876c-0d7e9c4d430f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:14.414997 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc458993-da93-4e50-876c-0d7e9c4d430f None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:14.415287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc458993-da93-4e50-876c-0d7e9c4d430f None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:14.415566 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc458993-da93-4e50-876c-0d7e9c4d430f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:14.421442 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:14.429125 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc458993-da93-4e50-876c-0d7e9c4d430f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:14.430740 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc458993-da93-4e50-876c-0d7e9c4d430f None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:14.451998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-bc458993-da93-4e50-876c-0d7e9c4d430f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:14.451998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:14.451998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:14.451998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:14.451998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:14.451998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:14.451998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:14.451998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:14.451998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:14.451998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:14.451998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:14.451998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:14.451998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:14.451998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:14.451998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:14.453064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:14.453064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:14.453064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:14.453064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:14.453064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:14.453064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:14.453064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:14.453064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:14.453064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:14.453064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:14.453064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:14.453064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:14.453064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:14.453064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:14.453064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:14.453064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:14.453064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:14.454193 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:14.454193 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:14.454193 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:14.454193 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:14.454672 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 321/658] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:14.456169 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8a941-0c10-4b89-a8e4-73ad8e093340 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:14.456619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8a941-0c10-4b89-a8e4-73ad8e093340 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:14.457132 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8a941-0c10-4b89-a8e4-73ad8e093340 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:14.459136 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 322/659] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:14.460027 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8a941-0c10-4b89-a8e4-73ad8e093340 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:14.488010 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34db2f-1de3-4a32-ad28-0c8e7ffd9ed1 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:14.532738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1d9a0-a8f3-4bd4-8245-7d2259dbfebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:14.533565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1d9a0-a8f3-4bd4-8245-7d2259dbfebd None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:14.533877 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1d9a0-a8f3-4bd4-8245-7d2259dbfebd None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:14.534276 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1d9a0-a8f3-4bd4-8245-7d2259dbfebd None admin] PATH_INFO: `/v3/projects/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:14.543010 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1d9a0-a8f3-4bd4-8245-7d2259dbfebd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:14.545325 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1d9a0-a8f3-4bd4-8245-7d2259dbfebd None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:14.561534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-4be1d9a0-a8f3-4bd4-8245-7d2259dbfebd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:14.561534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:14.561534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:14.561534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:14.561534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:14.561534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:14.561534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:14.561534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:14.561534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:14.561534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:14.561534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:14.561534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:14.561534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:14.561534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:14.561534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:14.562541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:14.562541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:14.562541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:14.562541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:14.562541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:14.562541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:14.562541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:14.562541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:14.562541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:14.562541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:14.562541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:14.562541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:14.562541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:14.562541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:14.562541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:14.562541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:14.562541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:14.563419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:14.563419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:14.563419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:14.563419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:14.563419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:14.563419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:14.563419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:14.563419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:14.567649 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 338/660] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:14.568562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1d9a0-a8f3-4bd4-8245-7d2259dbfebd None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:14.586574 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8a941-0c10-4b89-a8e4-73ad8e093340 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:14.617014 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:14.624858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee6caa-e733-4a57-9ce7-cdf28b457334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:14.625340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee6caa-e733-4a57-9ce7-cdf28b457334 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:14.625693 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee6caa-e733-4a57-9ce7-cdf28b457334 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:14.626074 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee6caa-e733-4a57-9ce7-cdf28b457334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:14.692167 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1d9a0-a8f3-4bd4-8245-7d2259dbfebd None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:14.701930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee6caa-e733-4a57-9ce7-cdf28b457334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:14.703784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee6caa-e733-4a57-9ce7-cdf28b457334 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:14.708811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:14.732591 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4cb37-ccb6-4884-b243-dbec90220974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:14.733272 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4cb37-ccb6-4884-b243-dbec90220974 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:14.733561 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4cb37-ccb6-4884-b243-dbec90220974 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:14.733868 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4cb37-ccb6-4884-b243-dbec90220974 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:14.734614 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4cb37-ccb6-4884-b243-dbec90220974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:14.734981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4cb37-ccb6-4884-b243-dbec90220974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:14.736362 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4cb37-ccb6-4884-b243-dbec90220974 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:14.749947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 339/661] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:14.751237 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cd8ce-9986-458c-9dc4-a8f5a2dfd269 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:14.751526 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cd8ce-9986-458c-9dc4-a8f5a2dfd269 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:14.751809 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9cd8ce-9986-458c-9dc4-a8f5a2dfd269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:14.768793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-3b9cd8ce-9986-458c-9dc4-a8f5a2dfd269 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:14.770008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-3b9cd8ce-9986-458c-9dc4-a8f5a2dfd269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:14.824308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 323/662] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:38:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:38:14.825725 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee6caa-e733-4a57-9ce7-cdf28b457334 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:14.849414 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 340/663] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:38:14.850593 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cd8ce-9986-458c-9dc4-a8f5a2dfd269 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:14.863446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:14.945682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee6caa-e733-4a57-9ce7-cdf28b457334 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:14.982640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9cd8ce-9986-458c-9dc4-a8f5a2dfd269 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:14.984980 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1ad2d-f5ed-4297-9f17-097616e6034e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:14.985194 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:14.985652 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1ad2d-f5ed-4297-9f17-097616e6034e None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:14.985968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1ad2d-f5ed-4297-9f17-097616e6034e None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:14.986253 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1ad2d-f5ed-4297-9f17-097616e6034e None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:14.987091 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1ad2d-f5ed-4297-9f17-097616e6034e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:14.987620 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1ad2d-f5ed-4297-9f17-097616e6034e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:14.989130 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1ad2d-f5ed-4297-9f17-097616e6034e None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:15.001869 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 324/664] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:15.002726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1ad2d-f5ed-4297-9f17-097616e6034e None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:15.028804 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd260b-dd1b-4f30-bf79-7f9cb2b6d6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:15.030179 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd260b-dd1b-4f30-bf79-7f9cb2b6d6c2 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:15.030913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd260b-dd1b-4f30-bf79-7f9cb2b6d6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:15.031368 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd260b-dd1b-4f30-bf79-7f9cb2b6d6c2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:15.039857 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd260b-dd1b-4f30-bf79-7f9cb2b6d6c2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:15.041640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd260b-dd1b-4f30-bf79-7f9cb2b6d6c2 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:15.057384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-68fd260b-dd1b-4f30-bf79-7f9cb2b6d6c2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 15:38:15.057384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:15.057384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:15.057384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:15.057384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:15.057384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:15.057384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:15.057384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:15.057384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:15.057384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:15.057384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:15.057384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:15.057384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:38:15.057384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:38:15.057384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:38:15.057384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:38:15.058447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:15.058447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:15.058447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:15.058447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:15.058447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:15.058447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:15.058447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:15.058447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:15.058447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:15.058447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:15.058447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:15.058447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:15.058447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:15.058447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:15.058447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:15.058447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:15.058447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:15.058447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:15.059434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:15.059434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:15.059434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:38:15.059434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:38:15.059434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:38:15.059434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:38:15.059434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:38:15.059434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:38:15.059434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 15:38:15.059434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:15.062035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 341/665] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 23 15:38:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:15.062937 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd260b-dd1b-4f30-bf79-7f9cb2b6d6c2 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:15.104346 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:15.115848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1ad2d-f5ed-4297-9f17-097616e6034e None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:15.159651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb255e9-3f64-459a-8e4b-1dc4dded5952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:15.161201 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb255e9-3f64-459a-8e4b-1dc4dded5952 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:15.161707 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb255e9-3f64-459a-8e4b-1dc4dded5952 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:15.162222 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb255e9-3f64-459a-8e4b-1dc4dded5952 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:15.173630 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd260b-dd1b-4f30-bf79-7f9cb2b6d6c2 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:15.173961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb255e9-3f64-459a-8e4b-1dc4dded5952 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:15.175354 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb255e9-3f64-459a-8e4b-1dc4dded5952 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:15.193703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-deb255e9-3f64-459a-8e4b-1dc4dded5952 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:15.193703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:15.193703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:15.193703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:15.193703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:15.193703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:15.193703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:15.193703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:15.193703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:15.193703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:15.193703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:15.193703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:15.193703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:15.193703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:15.193703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:15.194706 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:15.194706 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:15.194706 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:15.194706 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:15.194706 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:15.194706 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:15.194706 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:15.194706 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:15.194706 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:15.194706 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:15.194706 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:15.194706 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:15.194706 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:15.194706 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:15.194706 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:15.194706 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:15.194706 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:15.195604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:15.195604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:15.195604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:15.195604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:15.195604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 325/666] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:15.195891 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb255e9-3f64-459a-8e4b-1dc4dded5952 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:15.212344 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce338dcd-a729-4a3d-a6c5-2e1c85d2a38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:15.213149 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce338dcd-a729-4a3d-a6c5-2e1c85d2a38d None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:15.213436 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce338dcd-a729-4a3d-a6c5-2e1c85d2a38d None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:15.213714 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce338dcd-a729-4a3d-a6c5-2e1c85d2a38d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:15.225573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce338dcd-a729-4a3d-a6c5-2e1c85d2a38d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:38:15.236196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-ce338dcd-a729-4a3d-a6c5-2e1c85d2a38d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:15.236196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:15.236196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:15.236196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:15.236196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:15.236196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:15.236196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:15.236196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:15.236196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:15.236196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:15.236196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:15.236196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:15.236196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:38:15.236196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:38:15.236196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:38:15.236196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:38:15.237360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:38:15.237360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:38:15.237360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:38:15.237360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:38:15.237360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:15.237360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:15.237360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:15.237360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:15.237360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:15.237360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:15.237360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:15.237360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:15.237360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:15.237360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:15.237360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:15.237360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:15.243541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:15.243541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:15.243541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:15.243541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:15.243541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:38:15.243541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:38:15.243541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:38:15.243541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:38:15.243541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:38:15.243541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:38:15.243541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:15.243541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:15.243541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 342/667] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 23 15:38:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:15.243541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce338dcd-a729-4a3d-a6c5-2e1c85d2a38d None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:15.270740 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:15.330049 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb255e9-3f64-459a-8e4b-1dc4dded5952 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:15.359252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce338dcd-a729-4a3d-a6c5-2e1c85d2a38d None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:15.372994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9fdfe-07b8-49b9-893c-24c30b3ee256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:15.373818 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9fdfe-07b8-49b9-893c-24c30b3ee256 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:15.374511 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9fdfe-07b8-49b9-893c-24c30b3ee256 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:15.374798 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9fdfe-07b8-49b9-893c-24c30b3ee256 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:15.375800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9fdfe-07b8-49b9-893c-24c30b3ee256 None admin] RBAC: Adding query filter params (role.id=e004305755a2468aa60ab6632d39207a, scope.project.id=ff90b874f5b84d28a2752bc95419ad95, user.id=79239c95306c43f0a1a0b51715440009) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:15.376122 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9fdfe-07b8-49b9-893c-24c30b3ee256 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:15.377611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9fdfe-07b8-49b9-893c-24c30b3ee256 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:15.393894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 326/668] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:38:15 2022] GET /identity/v3/role_assignments?user.id=79239c95306c43f0a1a0b51715440009&scope.project.id=ff90b874f5b84d28a2752bc95419ad95&role.id=e004305755a2468aa60ab6632d39207a => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:15.393894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9fdfe-07b8-49b9-893c-24c30b3ee256 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:15.406340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:15.416723 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52a61e-cbc5-4cd4-b1f5-0eb24f28eb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:15.419210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52a61e-cbc5-4cd4-b1f5-0eb24f28eb6b None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:15.420131 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52a61e-cbc5-4cd4-b1f5-0eb24f28eb6b None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:15.420456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52a61e-cbc5-4cd4-b1f5-0eb24f28eb6b None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:15.422100 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52a61e-cbc5-4cd4-b1f5-0eb24f28eb6b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:15.422446 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52a61e-cbc5-4cd4-b1f5-0eb24f28eb6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:15.425001 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52a61e-cbc5-4cd4-b1f5-0eb24f28eb6b None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:15.454067 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 343/669] 10.222.0.15 () {56 vars in 1139 bytes} [Thu Jun 23 15:38:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:15.454984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52a61e-cbc5-4cd4-b1f5-0eb24f28eb6b None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:15.524455 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9fdfe-07b8-49b9-893c-24c30b3ee256 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:15.573223 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f378d7-1211-4d4b-a9ea-2bc6684499ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:15.574389 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f378d7-1211-4d4b-a9ea-2bc6684499ee None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:15.574726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f378d7-1211-4d4b-a9ea-2bc6684499ee None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:15.575004 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f378d7-1211-4d4b-a9ea-2bc6684499ee None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:15.575757 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f378d7-1211-4d4b-a9ea-2bc6684499ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:15.576069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f378d7-1211-4d4b-a9ea-2bc6684499ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:15.577459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f378d7-1211-4d4b-a9ea-2bc6684499ee None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:15.583335 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:15.593378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 327/670] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:15.595310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f378d7-1211-4d4b-a9ea-2bc6684499ee None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:15.608834 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52a61e-cbc5-4cd4-b1f5-0eb24f28eb6b None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:15.647546 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b314f93-b8fe-4561-95a8-e69b81eba1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:15.648299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b314f93-b8fe-4561-95a8-e69b81eba1ca None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:15.648689 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b314f93-b8fe-4561-95a8-e69b81eba1ca None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:15.649130 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b314f93-b8fe-4561-95a8-e69b81eba1ca None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:15.650111 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b314f93-b8fe-4561-95a8-e69b81eba1ca None admin] RBAC: Adding query filter params (name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:15.650603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b314f93-b8fe-4561-95a8-e69b81eba1ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:15.652083 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b314f93-b8fe-4561-95a8-e69b81eba1ca None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:15.662508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 344/671] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 23 15:38:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:15.663501 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b314f93-b8fe-4561-95a8-e69b81eba1ca None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:15.674096 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:15.715972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f378d7-1211-4d4b-a9ea-2bc6684499ee None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:15.768144 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f4872-6fc8-4056-b1a6-00b250c82035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:15.768846 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f4872-6fc8-4056-b1a6-00b250c82035 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:15.769136 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f4872-6fc8-4056-b1a6-00b250c82035 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:15.769422 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f4872-6fc8-4056-b1a6-00b250c82035 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:15.789003 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b314f93-b8fe-4561-95a8-e69b81eba1ca None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:15.833364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607c06d-82f9-476a-bf33-1d06b916a9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:15.834569 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607c06d-82f9-476a-bf33-1d06b916a9aa None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:15.835051 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607c06d-82f9-476a-bf33-1d06b916a9aa None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:15.835568 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9607c06d-82f9-476a-bf33-1d06b916a9aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:15.843661 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607c06d-82f9-476a-bf33-1d06b916a9aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:15.845459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9607c06d-82f9-476a-bf33-1d06b916a9aa None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:15.860888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-9607c06d-82f9-476a-bf33-1d06b916a9aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:15.860888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:15.860888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:15.860888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:15.860888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:15.860888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:15.860888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:15.860888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:15.860888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:15.860888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:15.860888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:15.860888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:15.860888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:15.860888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:15.860888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:15.861872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:15.861872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:15.861872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:15.861872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:15.861872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:15.861872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:15.861872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:15.861872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:15.861872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:15.861872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:15.861872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:15.861872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:15.861872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:15.861872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:15.861872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:15.861872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:15.861872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:15.862838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:15.862838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:15.862838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:15.862838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:15.862838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:15.862838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:15.862838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:15.862838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:15.865359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 345/672] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:15.866483 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607c06d-82f9-476a-bf33-1d06b916a9aa None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:15.870855 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:15.880472 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f4872-6fc8-4056-b1a6-00b250c82035 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:15.884029 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f4872-6fc8-4056-b1a6-00b250c82035 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:15.986591 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:16.027352 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 328/673] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:38:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:38:16.029278 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f4872-6fc8-4056-b1a6-00b250c82035 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:16.036739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9607c06d-82f9-476a-bf33-1d06b916a9aa None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:16.078678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85732d11-eed5-421a-bca0-945536fe48af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:16.079882 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85732d11-eed5-421a-bca0-945536fe48af None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:16.080495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85732d11-eed5-421a-bca0-945536fe48af None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:16.080967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85732d11-eed5-421a-bca0-945536fe48af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:16.093511 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85732d11-eed5-421a-bca0-945536fe48af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:16.095294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85732d11-eed5-421a-bca0-945536fe48af None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:16.115994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-85732d11-eed5-421a-bca0-945536fe48af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:16.115994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:16.115994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:16.115994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:16.115994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:16.115994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:16.115994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:16.115994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:16.115994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:16.115994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:16.115994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:16.115994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:16.115994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:16.115994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:16.115994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:16.116936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:16.116936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:16.116936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:16.116936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:16.116936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:16.116936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:16.116936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:16.116936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:16.116936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:16.116936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:16.116936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:16.116936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:16.116936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:16.116936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:16.116936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:16.116936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:16.116936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:16.117849 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:16.117849 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:16.117849 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:16.117849 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:16.120228 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 346/674] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:16.121377 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85732d11-eed5-421a-bca0-945536fe48af None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:16.187556 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:16.232377 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f4872-6fc8-4056-b1a6-00b250c82035 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:16.238468 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85732d11-eed5-421a-bca0-945536fe48af None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:16.275274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4c6ee-0c6d-4e81-9302-18e9609b6281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:16.276427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4c6ee-0c6d-4e81-9302-18e9609b6281 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:16.276933 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4c6ee-0c6d-4e81-9302-18e9609b6281 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:16.277430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4c6ee-0c6d-4e81-9302-18e9609b6281 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:16.289147 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4c6ee-0c6d-4e81-9302-18e9609b6281 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:16.291089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4c6ee-0c6d-4e81-9302-18e9609b6281 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:16.301351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca61a61-ea20-4c64-868c-a0e9b9edb6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:16.301634 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca61a61-ea20-4c64-868c-a0e9b9edb6e3 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:16.301975 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca61a61-ea20-4c64-868c-a0e9b9edb6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:16.302460 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca61a61-ea20-4c64-868c-a0e9b9edb6e3 None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:16.309777 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca61a61-ea20-4c64-868c-a0e9b9edb6e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:16.309777 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca61a61-ea20-4c64-868c-a0e9b9edb6e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:16.311474 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca61a61-ea20-4c64-868c-a0e9b9edb6e3 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:16.320299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-ddd4c6ee-0c6d-4e81-9302-18e9609b6281 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:16.320299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:16.320299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:16.320299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:16.320299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:16.320299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:16.320299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:16.320299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:16.320299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:16.320299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:16.320299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:16.320299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:16.320299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:16.320299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:16.320299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:16.321197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:16.321197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:16.321197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:16.321197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:16.321197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:16.321197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:16.321197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:16.321197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:16.321197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:16.321197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:16.321197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:16.321197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:16.321197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:16.321197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:16.321197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:16.321197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:16.321197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:16.322097 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:16.322097 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:16.322097 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:16.322097 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:16.324363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 347/675] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:16.325468 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4c6ee-0c6d-4e81-9302-18e9609b6281 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:16.341625 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 329/676] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:16.343216 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca61a61-ea20-4c64-868c-a0e9b9edb6e3 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:16.390221 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:16.435979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4c6ee-0c6d-4e81-9302-18e9609b6281 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:16.446809 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:16.476898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b591525-b82c-4b0d-9f1f-ba9cb5574d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:16.477456 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca61a61-ea20-4c64-868c-a0e9b9edb6e3 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:16.477567 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b591525-b82c-4b0d-9f1f-ba9cb5574d3d None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:16.477920 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b591525-b82c-4b0d-9f1f-ba9cb5574d3d None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:16.478233 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b591525-b82c-4b0d-9f1f-ba9cb5574d3d None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:16.479033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b591525-b82c-4b0d-9f1f-ba9cb5574d3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:16.479467 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b591525-b82c-4b0d-9f1f-ba9cb5574d3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:16.480764 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b591525-b82c-4b0d-9f1f-ba9cb5574d3d None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:16.494010 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 348/677] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:16.494802 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b591525-b82c-4b0d-9f1f-ba9cb5574d3d None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:16.520257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360023d1-ed11-4d34-8f4d-df1385801306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:16.521084 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360023d1-ed11-4d34-8f4d-df1385801306 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:16.521483 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360023d1-ed11-4d34-8f4d-df1385801306 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:16.521911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360023d1-ed11-4d34-8f4d-df1385801306 None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:16.522723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360023d1-ed11-4d34-8f4d-df1385801306 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:16.523111 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360023d1-ed11-4d34-8f4d-df1385801306 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:16.524557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360023d1-ed11-4d34-8f4d-df1385801306 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:16.544305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 330/678] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:16.544305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27d3ca-2d9b-4c11-959d-d71239de7356 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:16.544305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27d3ca-2d9b-4c11-959d-d71239de7356 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:16.544305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce27d3ca-2d9b-4c11-959d-d71239de7356 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:16.544305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 331/679] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:16.545109 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27d3ca-2d9b-4c11-959d-d71239de7356 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:16.620221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b591525-b82c-4b0d-9f1f-ba9cb5574d3d None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:16.646781 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:16.662872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446a9e0-7123-493e-ad60-9df3f22fb7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:16.663643 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446a9e0-7123-493e-ad60-9df3f22fb7e9 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:16.663926 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446a9e0-7123-493e-ad60-9df3f22fb7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:16.664199 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446a9e0-7123-493e-ad60-9df3f22fb7e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:16.665027 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446a9e0-7123-493e-ad60-9df3f22fb7e9 None admin] RBAC: Adding query filter params (role.id=e004305755a2468aa60ab6632d39207a, scope.project.id=ff90b874f5b84d28a2752bc95419ad95, user.id=b524afb3b4b24025ad8bef85aa64bd91) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:16.665337 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446a9e0-7123-493e-ad60-9df3f22fb7e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:16.665659 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce27d3ca-2d9b-4c11-959d-d71239de7356 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:16.666785 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446a9e0-7123-493e-ad60-9df3f22fb7e9 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:16.681886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 349/680] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:38:16 2022] GET /identity/v3/role_assignments?user.id=b524afb3b4b24025ad8bef85aa64bd91&scope.project.id=ff90b874f5b84d28a2752bc95419ad95&role.id=e004305755a2468aa60ab6632d39207a => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:16.681886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446a9e0-7123-493e-ad60-9df3f22fb7e9 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:16.717929 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccd197-15a7-453a-8ad8-2b753f5b8911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:16.718845 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccd197-15a7-453a-8ad8-2b753f5b8911 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:16.719198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccd197-15a7-453a-8ad8-2b753f5b8911 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:16.719551 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccd197-15a7-453a-8ad8-2b753f5b8911 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:16.726169 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:16.728846 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccd197-15a7-453a-8ad8-2b753f5b8911 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:16.730493 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccd197-15a7-453a-8ad8-2b753f5b8911 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:16.748287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-27ccd197-15a7-453a-8ad8-2b753f5b8911 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 15:38:16.748287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:16.748287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:16.748287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:16.748287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:16.748287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:16.748287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:16.748287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:16.748287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:16.748287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:16.748287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:16.748287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:16.748287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:38:16.748287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:38:16.748287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:38:16.748287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:38:16.750163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:16.750163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:16.750163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:16.750163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:16.750163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:16.750163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:16.750163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:16.750163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:16.750163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:16.750163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:16.750163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:16.750163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:16.750163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:16.750163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:16.750163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:16.750163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:16.750163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:16.750163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:16.752049 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:16.752049 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:16.752049 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:38:16.752049 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:38:16.752049 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:38:16.752049 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:38:16.752049 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:38:16.752049 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:38:16.752049 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 15:38:16.752049 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:16.752049 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 332/681] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:38:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:16.752049 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495a9f4-83d1-4339-9846-6c2be5ffaf18 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:16.752049 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495a9f4-83d1-4339-9846-6c2be5ffaf18 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:16.753465 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495a9f4-83d1-4339-9846-6c2be5ffaf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:16.771377 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-b495a9f4-83d1-4339-9846-6c2be5ffaf18 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:16.772865 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-b495a9f4-83d1-4339-9846-6c2be5ffaf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:16.830992 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446a9e0-7123-493e-ad60-9df3f22fb7e9 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:16.851383 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 333/682] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:38:16.852446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495a9f4-83d1-4339-9846-6c2be5ffaf18 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:16.868486 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7863d8f-64d9-43ba-addf-3101684609cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:16.869286 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7863d8f-64d9-43ba-addf-3101684609cb None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:16.869564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7863d8f-64d9-43ba-addf-3101684609cb None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:16.869952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7863d8f-64d9-43ba-addf-3101684609cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:16.877803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7863d8f-64d9-43ba-addf-3101684609cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:16.879347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7863d8f-64d9-43ba-addf-3101684609cb None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:16.894412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-c7863d8f-64d9-43ba-addf-3101684609cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:16.894412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:16.894412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:16.894412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:16.894412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:16.894412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:16.894412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:16.894412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:16.894412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:16.894412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:16.894412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:16.894412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:16.894412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:16.894412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:16.894412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:16.897359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:16.897359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:16.897359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:16.897359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:16.897359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:16.897359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:16.897359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:16.897359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:16.897359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:16.897359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:16.897359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:16.897359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:16.897359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:16.897359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:16.897359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:16.897359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:16.897359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:16.901066 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:16.901066 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:16.901066 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:16.901066 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:16.901066 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:16.901066 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:16.901066 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:16.901066 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:16.901066 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 350/683] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:16.911038 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7863d8f-64d9-43ba-addf-3101684609cb None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:16.943085 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:16.969601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495a9f4-83d1-4339-9846-6c2be5ffaf18 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:17.010390 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c766f-1771-4ba4-a601-a4d463e8c6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:17.011351 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:17.012034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c766f-1771-4ba4-a601-a4d463e8c6ea None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:17.012927 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c766f-1771-4ba4-a601-a4d463e8c6ea None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:17.013372 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c766f-1771-4ba4-a601-a4d463e8c6ea None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:17.014618 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c766f-1771-4ba4-a601-a4d463e8c6ea None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:17.015073 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c766f-1771-4ba4-a601-a4d463e8c6ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:17.016760 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c766f-1771-4ba4-a601-a4d463e8c6ea None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:17.022185 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7863d8f-64d9-43ba-addf-3101684609cb None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:17.039415 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 334/684] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Jun 23 15:38:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:17.040495 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c766f-1771-4ba4-a601-a4d463e8c6ea None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:17.065115 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b8af7-d263-4442-89ad-f472ccb7a137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:17.065690 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b8af7-d263-4442-89ad-f472ccb7a137 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:17.066003 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b8af7-d263-4442-89ad-f472ccb7a137 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:17.066280 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b8af7-d263-4442-89ad-f472ccb7a137 None admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:17.067520 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b8af7-d263-4442-89ad-f472ccb7a137 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:17.067520 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b8af7-d263-4442-89ad-f472ccb7a137 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:17.069104 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b8af7-d263-4442-89ad-f472ccb7a137 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:17.081810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 351/685] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:17.086799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b8af7-d263-4442-89ad-f472ccb7a137 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:17.159864 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c766f-1771-4ba4-a601-a4d463e8c6ea None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:17.202328 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa23d0-768b-4cf3-8de7-97380e93b74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:17.203482 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa23d0-768b-4cf3-8de7-97380e93b74a None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:17.203960 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa23d0-768b-4cf3-8de7-97380e93b74a None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:17.204270 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b8af7-d263-4442-89ad-f472ccb7a137 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:17.204683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa23d0-768b-4cf3-8de7-97380e93b74a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:17.207730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:17.219057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa23d0-768b-4cf3-8de7-97380e93b74a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:38:17.226895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-ccaa23d0-768b-4cf3-8de7-97380e93b74a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:38:17.226895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:17.226895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:17.226895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:17.226895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:17.226895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:17.226895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:17.226895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:17.226895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:17.226895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:17.226895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:17.226895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:17.226895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:38:17.226895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:38:17.226895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:38:17.226895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:38:17.227831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:38:17.227831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:38:17.227831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:38:17.227831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:38:17.227831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:17.227831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:17.227831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:17.227831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:17.227831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:17.227831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:17.227831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:17.227831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:17.227831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:17.227831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:17.227831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:17.227831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:17.228663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:17.228663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:17.228663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:17.228663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:17.228663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:38:17.228663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:38:17.228663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:38:17.228663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:38:17.228663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:38:17.228663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:38:17.228663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:38:17.228663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:17.235871 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 335/686] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:38:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:17.236975 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa23d0-768b-4cf3-8de7-97380e93b74a None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:17.243972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27eedf0-d5e7-450e-b108-70791833f41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:17.244629 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27eedf0-d5e7-450e-b108-70791833f41b None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:17.244969 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27eedf0-d5e7-450e-b108-70791833f41b None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:17.245243 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27eedf0-d5e7-450e-b108-70791833f41b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:17.278481 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:17.348311 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27eedf0-d5e7-450e-b108-70791833f41b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:17.350068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27eedf0-d5e7-450e-b108-70791833f41b None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:17.353652 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa23d0-768b-4cf3-8de7-97380e93b74a None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:17.391840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd6c91-aae2-4e37-b38d-4e2e4ee2c84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:17.392876 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd6c91-aae2-4e37-b38d-4e2e4ee2c84d None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:17.393370 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd6c91-aae2-4e37-b38d-4e2e4ee2c84d None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:17.393839 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd6c91-aae2-4e37-b38d-4e2e4ee2c84d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:17.395277 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd6c91-aae2-4e37-b38d-4e2e4ee2c84d None admin] RBAC: Adding query filter params (role.id=e004305755a2468aa60ab6632d39207a, scope.project.id=ff90b874f5b84d28a2752bc95419ad95, user.id=44e9fc6def5341a589221350067bb0fa) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:17.395823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd6c91-aae2-4e37-b38d-4e2e4ee2c84d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:17.397439 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd6c91-aae2-4e37-b38d-4e2e4ee2c84d None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:17.404504 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 336/687] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:38:17 2022] GET /identity/v3/role_assignments?user.id=44e9fc6def5341a589221350067bb0fa&scope.project.id=ff90b874f5b84d28a2752bc95419ad95&role.id=e004305755a2468aa60ab6632d39207a => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:17.405921 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd6c91-aae2-4e37-b38d-4e2e4ee2c84d None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:17.500692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 352/688] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:38:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:38:17.510463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27eedf0-d5e7-450e-b108-70791833f41b None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:17.550751 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:17.609423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:17.613566 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd6c91-aae2-4e37-b38d-4e2e4ee2c84d None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:17.655021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6bf47-c5c8-41d1-bf0e-e9b8e9ec861e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:17.656265 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6bf47-c5c8-41d1-bf0e-e9b8e9ec861e None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:17.656700 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6bf47-c5c8-41d1-bf0e-e9b8e9ec861e None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:17.657228 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6bf47-c5c8-41d1-bf0e-e9b8e9ec861e None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:17.658157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6bf47-c5c8-41d1-bf0e-e9b8e9ec861e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:17.658606 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6bf47-c5c8-41d1-bf0e-e9b8e9ec861e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:17.660125 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6bf47-c5c8-41d1-bf0e-e9b8e9ec861e None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:17.670813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27eedf0-d5e7-450e-b108-70791833f41b None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:17.672230 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 337/689] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:38:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:17.678133 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6bf47-c5c8-41d1-bf0e-e9b8e9ec861e None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:17.710250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c9da6-82eb-4795-954e-667b3bcdb047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:17.711199 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c9da6-82eb-4795-954e-667b3bcdb047 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:17.711579 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c9da6-82eb-4795-954e-667b3bcdb047 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:17.711951 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c9da6-82eb-4795-954e-667b3bcdb047 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:17.723505 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c9da6-82eb-4795-954e-667b3bcdb047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:17.725131 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c9da6-82eb-4795-954e-667b3bcdb047 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:17.744913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-3e7c9da6-82eb-4795-954e-667b3bcdb047 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:17.744913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:17.744913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:17.744913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:17.744913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:17.744913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:17.744913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:17.744913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:17.744913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:17.744913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:17.744913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:17.744913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:17.744913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:17.744913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:17.744913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:17.745971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:17.745971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:17.745971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:17.745971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:17.745971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:17.745971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:17.745971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:17.745971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:17.745971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:17.745971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:17.745971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:17.745971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:17.745971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:17.745971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:17.745971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:17.745971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:17.745971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:17.746926 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:17.746926 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:17.746926 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:17.746926 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:17.746926 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 353/690] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:17.752582 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c9da6-82eb-4795-954e-667b3bcdb047 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:17.799085 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6bf47-c5c8-41d1-bf0e-e9b8e9ec861e None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:17.821308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:17.851882 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4d2e6-49b3-4242-ac37-26d2432c4086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:17.852687 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4d2e6-49b3-4242-ac37-26d2432c4086 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:17.853383 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4d2e6-49b3-4242-ac37-26d2432c4086 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:17.853670 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4d2e6-49b3-4242-ac37-26d2432c4086 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:17.868071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4d2e6-49b3-4242-ac37-26d2432c4086 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:17.869730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4d2e6-49b3-4242-ac37-26d2432c4086 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:17.880382 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c9da6-82eb-4795-954e-667b3bcdb047 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:17.892855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-eae4d2e6-49b3-4242-ac37-26d2432c4086 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:17.892855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:17.892855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:17.892855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:17.892855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:17.892855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:17.892855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:17.892855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:17.892855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:17.892855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:17.892855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:17.892855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:17.892855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:17.892855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:17.892855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:17.893790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:17.893790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:17.893790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:17.893790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:17.893790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:17.893790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:17.893790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:17.893790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:17.893790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:17.893790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:17.893790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:17.893790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:17.893790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:17.893790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:17.893790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:17.893790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:17.893790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:17.894699 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:17.894699 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:17.894699 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:17.894699 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:17.895010 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:17.895081 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 338/691] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:17.900773 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4d2e6-49b3-4242-ac37-26d2432c4086 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:17.921816 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3b720-a2a1-4c36-a5de-90e8e4443db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:17.922924 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3b720-a2a1-4c36-a5de-90e8e4443db7 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:17.923383 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3b720-a2a1-4c36-a5de-90e8e4443db7 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:17.923845 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3b720-a2a1-4c36-a5de-90e8e4443db7 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:17.924901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3b720-a2a1-4c36-a5de-90e8e4443db7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:17.925499 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3b720-a2a1-4c36-a5de-90e8e4443db7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:17.927114 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3b720-a2a1-4c36-a5de-90e8e4443db7 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:17.941008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 354/692] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:17.946130 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3b720-a2a1-4c36-a5de-90e8e4443db7 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:18.015894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4d2e6-49b3-4242-ac37-26d2432c4086 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:18.053806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a048c0-dbfd-4e00-8f08-2ac9c71192d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:18.054572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a048c0-dbfd-4e00-8f08-2ac9c71192d4 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:18.054945 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a048c0-dbfd-4e00-8f08-2ac9c71192d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:18.055314 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a048c0-dbfd-4e00-8f08-2ac9c71192d4 None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:18.056068 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a048c0-dbfd-4e00-8f08-2ac9c71192d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:18.056456 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a048c0-dbfd-4e00-8f08-2ac9c71192d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:18.057702 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3b720-a2a1-4c36-a5de-90e8e4443db7 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:18.057988 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a048c0-dbfd-4e00-8f08-2ac9c71192d4 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:18.071230 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 339/693] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:18.073001 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adc10f-b15b-4998-931f-208fb580e19c None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:18.073159 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adc10f-b15b-4998-931f-208fb580e19c None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:18.073563 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adc10f-b15b-4998-931f-208fb580e19c None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:18.075252 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 340/694] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:18.076186 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adc10f-b15b-4998-931f-208fb580e19c None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:18.095546 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa6c32-5bce-4e68-a6b3-813f6383ac37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:18.096731 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa6c32-5bce-4e68-a6b3-813f6383ac37 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:18.097216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa6c32-5bce-4e68-a6b3-813f6383ac37 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:18.097677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa6c32-5bce-4e68-a6b3-813f6383ac37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:18.105541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa6c32-5bce-4e68-a6b3-813f6383ac37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:18.107919 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa6c32-5bce-4e68-a6b3-813f6383ac37 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:18.110162 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:18.127583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-3faa6c32-5bce-4e68-a6b3-813f6383ac37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:18.127583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:18.127583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:18.127583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:18.127583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:18.127583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:18.127583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:18.127583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:18.127583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:18.127583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:18.127583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:18.127583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:18.127583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:18.127583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:18.127583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:18.128522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:18.128522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:18.128522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:18.128522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:18.128522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:18.128522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:18.128522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:18.128522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:18.128522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:18.128522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:18.128522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:18.128522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:18.128522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:18.128522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:18.128522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:18.128522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:18.128522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:18.129401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:18.129401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:18.129401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:18.129401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:18.129401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:18.129401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:18.129401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:18.129401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:18.129401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 355/695] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:38:18.129401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec506b64-ccaf-4b8d-91d2-e73783587385 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:18.129401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec506b64-ccaf-4b8d-91d2-e73783587385 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:18.130008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec506b64-ccaf-4b8d-91d2-e73783587385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:18.146559 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-ec506b64-ccaf-4b8d-91d2-e73783587385 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:18.147964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ec506b64-ccaf-4b8d-91d2-e73783587385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:18.169796 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:18.192074 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adc10f-b15b-4998-931f-208fb580e19c None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:18.229463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f647b0-05fb-4437-92b9-2655729dd423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:18.230106 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 356/696] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:38:18.230282 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f647b0-05fb-4437-92b9-2655729dd423 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:18.230564 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f647b0-05fb-4437-92b9-2655729dd423 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:18.231482 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f647b0-05fb-4437-92b9-2655729dd423 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:18.232360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec506b64-ccaf-4b8d-91d2-e73783587385 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:18.239560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f647b0-05fb-4437-92b9-2655729dd423 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:18.241010 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f647b0-05fb-4437-92b9-2655729dd423 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:18.256690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-f7f647b0-05fb-4437-92b9-2655729dd423 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 15:38:18.256690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:18.256690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:18.256690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:18.256690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:18.256690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:18.256690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:18.256690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:18.256690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:18.256690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:18.256690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:18.256690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:18.256690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:38:18.256690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:38:18.256690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:38:18.256690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:38:18.257806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:18.257806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:18.257806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:18.257806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:18.257806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:18.257806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:18.257806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:18.257806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:18.257806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:18.257806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:18.257806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:18.257806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:18.257806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:18.257806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:18.257806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:18.257806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:18.257806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:18.257806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:18.258785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:18.258785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:18.258785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:38:18.258785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:38:18.258785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:38:18.258785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:38:18.258785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:38:18.258785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:38:18.258785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 15:38:18.258785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:18.258785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 341/697] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jun 23 15:38:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:38:18.263766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f647b0-05fb-4437-92b9-2655729dd423 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:18.345953 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec506b64-ccaf-4b8d-91d2-e73783587385 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:18.366593 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:18.381365 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f647b0-05fb-4437-92b9-2655729dd423 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:18.391355 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bbf5a-6892-45a0-9fd8-37a0ebbb8741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:18.392391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bbf5a-6892-45a0-9fd8-37a0ebbb8741 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:18.392674 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bbf5a-6892-45a0-9fd8-37a0ebbb8741 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:18.392953 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bbf5a-6892-45a0-9fd8-37a0ebbb8741 None admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:18.394265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bbf5a-6892-45a0-9fd8-37a0ebbb8741 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:18.394709 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bbf5a-6892-45a0-9fd8-37a0ebbb8741 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:18.396330 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bbf5a-6892-45a0-9fd8-37a0ebbb8741 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:18.414021 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 357/698] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:18.414902 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bbf5a-6892-45a0-9fd8-37a0ebbb8741 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:18.423402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231a1eb-8094-4005-8a8f-3c4b3642dc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:18.424070 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231a1eb-8094-4005-8a8f-3c4b3642dc72 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:18.424408 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231a1eb-8094-4005-8a8f-3c4b3642dc72 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:18.424697 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231a1eb-8094-4005-8a8f-3c4b3642dc72 None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:18.425546 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231a1eb-8094-4005-8a8f-3c4b3642dc72 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:18.425876 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231a1eb-8094-4005-8a8f-3c4b3642dc72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:18.427380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231a1eb-8094-4005-8a8f-3c4b3642dc72 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:18.436372 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:18.446113 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 342/699] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jun 23 15:38:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:18.446973 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231a1eb-8094-4005-8a8f-3c4b3642dc72 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:18.558071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bbf5a-6892-45a0-9fd8-37a0ebbb8741 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:18.558608 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231a1eb-8094-4005-8a8f-3c4b3642dc72 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:18.597937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7151c94-dedd-43c5-b91e-0f356244ebd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:18.598892 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7151c94-dedd-43c5-b91e-0f356244ebd3 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:18.599390 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7151c94-dedd-43c5-b91e-0f356244ebd3 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:18.599823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7151c94-dedd-43c5-b91e-0f356244ebd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:18.600805 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7151c94-dedd-43c5-b91e-0f356244ebd3 None admin] RBAC: Adding query filter params (role.id=e004305755a2468aa60ab6632d39207a, scope.project.id=ff90b874f5b84d28a2752bc95419ad95, user.id=5824ee17e276483faf20db88a93545f3) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:18.601123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a615b-3e17-4c58-ba99-4e8030884a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:18.601447 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7151c94-dedd-43c5-b91e-0f356244ebd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:18.601945 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a615b-3e17-4c58-ba99-4e8030884a0e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:18.602233 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a615b-3e17-4c58-ba99-4e8030884a0e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:18.602511 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a615b-3e17-4c58-ba99-4e8030884a0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:18.603588 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7151c94-dedd-43c5-b91e-0f356244ebd3 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:18.614982 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a615b-3e17-4c58-ba99-4e8030884a0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:18.616717 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a615b-3e17-4c58-ba99-4e8030884a0e None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:18.622103 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 343/700] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:38:18 2022] GET /identity/v3/role_assignments?user.id=5824ee17e276483faf20db88a93545f3&scope.project.id=ff90b874f5b84d28a2752bc95419ad95&role.id=e004305755a2468aa60ab6632d39207a => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:18.623409 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7151c94-dedd-43c5-b91e-0f356244ebd3 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:18.649221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-896a615b-3e17-4c58-ba99-4e8030884a0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:18.649221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:18.649221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:18.649221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:18.649221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:18.649221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:18.649221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:18.649221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:18.649221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:18.649221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:18.649221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:18.649221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:18.649221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:18.649221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:18.649221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:18.650209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:18.650209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:18.650209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:18.650209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:18.650209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:18.650209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:18.650209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:18.650209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:18.650209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:18.650209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:18.650209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:18.650209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:18.650209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:18.650209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:18.650209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:18.650209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:18.650209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:18.651138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:18.651138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:18.651138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:18.651138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:18.658135 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 358/701] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:18.662234 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:18.665170 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a615b-3e17-4c58-ba99-4e8030884a0e None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:18.806885 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:18.838789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7151c94-dedd-43c5-b91e-0f356244ebd3 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:18.857358 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a615b-3e17-4c58-ba99-4e8030884a0e None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:18.882178 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cee9e-8e27-4c70-8fc9-549d5b89bd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:18.883395 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cee9e-8e27-4c70-8fc9-549d5b89bd42 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:18.883691 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cee9e-8e27-4c70-8fc9-549d5b89bd42 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:18.883978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cee9e-8e27-4c70-8fc9-549d5b89bd42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:18.904594 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a5e55-6852-47e4-8800-1938b8b6ecb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:18.905261 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a5e55-6852-47e4-8800-1938b8b6ecb4 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:18.905591 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a5e55-6852-47e4-8800-1938b8b6ecb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:18.906839 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9a5e55-6852-47e4-8800-1938b8b6ecb4 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:18.907576 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a5e55-6852-47e4-8800-1938b8b6ecb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:18.907887 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a5e55-6852-47e4-8800-1938b8b6ecb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:18.909315 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9a5e55-6852-47e4-8800-1938b8b6ecb4 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:18.923775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 359/702] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:18.930001 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a5e55-6852-47e4-8800-1938b8b6ecb4 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:18.987198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976cee9e-8e27-4c70-8fc9-549d5b89bd42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:18.989326 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976cee9e-8e27-4c70-8fc9-549d5b89bd42 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:19.017724 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:19.060665 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9a5e55-6852-47e4-8800-1938b8b6ecb4 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:19.092124 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:19.103097 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f92f8-a39d-4d53-a4f5-64650cce70dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:19.103900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f92f8-a39d-4d53-a4f5-64650cce70dd None admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:19.104186 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f92f8-a39d-4d53-a4f5-64650cce70dd None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:19.104637 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f92f8-a39d-4d53-a4f5-64650cce70dd None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:19.105355 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f92f8-a39d-4d53-a4f5-64650cce70dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:19.107051 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f92f8-a39d-4d53-a4f5-64650cce70dd None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:19.131266 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 344/703] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:38:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:38:19.137492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 360/704] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 23 15:38:18 2022] POST /identity/v3/users => generated 254 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:38:19.138693 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cee9e-8e27-4c70-8fc9-549d5b89bd42 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:19.185088 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc3a50-8900-407f-b997-2933f5dd35c9 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:19.185626 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc3a50-8900-407f-b997-2933f5dd35c9 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:19.186422 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc3a50-8900-407f-b997-2933f5dd35c9 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:19.189821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 361/705] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:38:19.201421 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d84eab-ff80-41f8-9fae-ff34d45eebbb None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:19.202125 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d84eab-ff80-41f8-9fae-ff34d45eebbb None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:19.202629 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d84eab-ff80-41f8-9fae-ff34d45eebbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:19.228936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-c8d84eab-ff80-41f8-9fae-ff34d45eebbb None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:19.231389 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-c8d84eab-ff80-41f8-9fae-ff34d45eebbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:19.275389 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cee9e-8e27-4c70-8fc9-549d5b89bd42 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:19.294374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:19.320113 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2c096-3c52-44d4-b45a-546ca35b3aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:19.320813 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2c096-3c52-44d4-b45a-546ca35b3aba None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:19.321187 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2c096-3c52-44d4-b45a-546ca35b3aba None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:19.321527 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2c096-3c52-44d4-b45a-546ca35b3aba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:19.334071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2c096-3c52-44d4-b45a-546ca35b3aba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:19.334971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 362/706] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 15:38:19.338073 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2c096-3c52-44d4-b45a-546ca35b3aba None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:19.356398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-9ab2c096-3c52-44d4-b45a-546ca35b3aba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:19.356398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:19.356398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:19.356398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:19.356398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:19.356398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:19.356398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:19.356398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:19.356398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:19.356398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:19.356398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:19.356398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:19.356398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:19.356398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:19.356398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:19.357545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:19.357545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:19.357545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:19.357545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:19.357545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:19.357545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:19.357545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:19.357545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:19.357545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:19.357545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:19.357545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:19.357545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:19.357545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:19.357545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:19.357545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:19.357545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:19.357545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:19.358668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:19.358668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:19.358668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:19.358668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:19.360772 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 345/707] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:19.361315 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d84eab-ff80-41f8-9fae-ff34d45eebbb None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:19.374533 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2c096-3c52-44d4-b45a-546ca35b3aba None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:19.467537 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d84eab-ff80-41f8-9fae-ff34d45eebbb None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:19.482214 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:19.496172 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2c096-3c52-44d4-b45a-546ca35b3aba None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:19.506236 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06764c14-557d-4940-bb84-1ffdb80c408f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:19.507159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06764c14-557d-4940-bb84-1ffdb80c408f None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:19.507657 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06764c14-557d-4940-bb84-1ffdb80c408f None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:19.508399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06764c14-557d-4940-bb84-1ffdb80c408f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:19.509483 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06764c14-557d-4940-bb84-1ffdb80c408f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:19.511284 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06764c14-557d-4940-bb84-1ffdb80c408f None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:19.526534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-06764c14-557d-4940-bb84-1ffdb80c408f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 15:38:19.526534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:19.526534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:38:19.526534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:38:19.526534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:38:19.526534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:38:19.526534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:38:19.526534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:19.526534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 15:38:19.526534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:19.526534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:38:19.526534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:19.526534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:19.526534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:19.526534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:19.526534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:19.528265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:19.528265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:19.528265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:19.528265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:19.528265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:19.528265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:19.528265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:19.528265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:38:19.528265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:38:19.528265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:38:19.528265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:38:19.528265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:19.528265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:19.528265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:19.528265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:19.528265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:19.529086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:19.529086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:19.529086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:19.529086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:19.529086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:19.529086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:19.529086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:19.529086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:19.529086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:19.529086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:19.529086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:19.529086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:38:19.529086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:19.529086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 15:38:19.529086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:19.530224 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 363/708] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Jun 23 15:38:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:38:19.535350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06764c14-557d-4940-bb84-1ffdb80c408f None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:19.543813 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848841f-9eaf-4a4e-9e37-e8867504f99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:19.544855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848841f-9eaf-4a4e-9e37-e8867504f99b None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:19.545321 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848841f-9eaf-4a4e-9e37-e8867504f99b None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:19.545804 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848841f-9eaf-4a4e-9e37-e8867504f99b None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:19.546808 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848841f-9eaf-4a4e-9e37-e8867504f99b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:19.547316 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848841f-9eaf-4a4e-9e37-e8867504f99b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:19.549038 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8848841f-9eaf-4a4e-9e37-e8867504f99b None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:19.567567 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 346/709] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:19.569961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848841f-9eaf-4a4e-9e37-e8867504f99b None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:19.601628 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:19.650363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06764c14-557d-4940-bb84-1ffdb80c408f None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:19.688511 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848841f-9eaf-4a4e-9e37-e8867504f99b None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:19.688816 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d16be3-c35b-4e73-914b-55c90244e7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:19.689588 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d16be3-c35b-4e73-914b-55c90244e7d7 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:19.689975 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d16be3-c35b-4e73-914b-55c90244e7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:19.690322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d16be3-c35b-4e73-914b-55c90244e7d7 None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:19.691105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d16be3-c35b-4e73-914b-55c90244e7d7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:19.691477 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d16be3-c35b-4e73-914b-55c90244e7d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:19.693197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d16be3-c35b-4e73-914b-55c90244e7d7 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:19.700369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 364/710] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Jun 23 15:38:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:19.705942 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d16be3-c35b-4e73-914b-55c90244e7d7 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:19.729610 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11304484-c716-474a-bf52-e3b47e723a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:19.731278 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11304484-c716-474a-bf52-e3b47e723a00 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:19.731738 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11304484-c716-474a-bf52-e3b47e723a00 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:19.732188 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11304484-c716-474a-bf52-e3b47e723a00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:19.740259 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11304484-c716-474a-bf52-e3b47e723a00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:19.742056 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11304484-c716-474a-bf52-e3b47e723a00 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:19.753084 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:19.758750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-11304484-c716-474a-bf52-e3b47e723a00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:19.758750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:19.758750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:19.758750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:19.758750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:19.758750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:19.758750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:19.758750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:19.758750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:19.758750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:19.758750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:19.758750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:19.758750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:19.758750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:19.758750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:19.759669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:19.759669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:19.759669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:19.759669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:19.759669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:19.759669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:19.759669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:19.759669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:19.759669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:19.759669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:19.759669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:19.759669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:19.759669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:19.759669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:19.759669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:19.759669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:19.759669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:19.760560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:19.760560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:19.760560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:19.760560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:19.760560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:19.760560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:19.760560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:19.760560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:19.767948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 347/711] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:19.769469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11304484-c716-474a-bf52-e3b47e723a00 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:19.819014 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d16be3-c35b-4e73-914b-55c90244e7d7 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:19.855530 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b1fb5-31cf-4f0a-bb61-d877934145a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:19.856528 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b1fb5-31cf-4f0a-bb61-d877934145a0 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:19.856641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b1fb5-31cf-4f0a-bb61-d877934145a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:19.857029 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b1fb5-31cf-4f0a-bb61-d877934145a0 None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:19.857812 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b1fb5-31cf-4f0a-bb61-d877934145a0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:19.858216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b1fb5-31cf-4f0a-bb61-d877934145a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:19.859759 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b1fb5-31cf-4f0a-bb61-d877934145a0 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:19.866082 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 365/712] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Jun 23 15:38:19 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:19.866388 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:19.897607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11304484-c716-474a-bf52-e3b47e723a00 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:19.950726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179096a0-38bf-4396-b8a4-6c7642dba438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:19.951442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179096a0-38bf-4396-b8a4-6c7642dba438 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:19.951728 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179096a0-38bf-4396-b8a4-6c7642dba438 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:19.952001 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179096a0-38bf-4396-b8a4-6c7642dba438 None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:19.952790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179096a0-38bf-4396-b8a4-6c7642dba438 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:19.953096 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179096a0-38bf-4396-b8a4-6c7642dba438 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:19.954567 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179096a0-38bf-4396-b8a4-6c7642dba438 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:19.973249 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 348/713] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:19.979451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b1fb5-31cf-4f0a-bb61-d877934145a0 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:20.095586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b1fb5-31cf-4f0a-bb61-d877934145a0 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:20.097879 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:20.107775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d280d7-21a7-48dd-a72f-63b587b78757 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:20.108334 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d280d7-21a7-48dd-a72f-63b587b78757 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:20.108334 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d280d7-21a7-48dd-a72f-63b587b78757 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:20.110817 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 349/714] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:20.120471 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5efbe-9ff7-43c7-98be-8212052c87a9 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:20.120882 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5efbe-9ff7-43c7-98be-8212052c87a9 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:20.121797 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5efbe-9ff7-43c7-98be-8212052c87a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:20.144847 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-98d5efbe-9ff7-43c7-98be-8212052c87a9 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:20.147982 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-98d5efbe-9ff7-43c7-98be-8212052c87a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:20.150870 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d360f-9b8f-4361-a683-70ae1480790c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:20.152866 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d360f-9b8f-4361-a683-70ae1480790c None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:20.153323 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d360f-9b8f-4361-a683-70ae1480790c None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:20.153949 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d360f-9b8f-4361-a683-70ae1480790c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:20.155612 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d360f-9b8f-4361-a683-70ae1480790c None admin] RBAC: Adding query filter params (role.id=abdc0e0957534149b3653eaa33cbd054, scope.project.id=ff90b874f5b84d28a2752bc95419ad95, user.id=d54521ea1dca44c98d6723d0b9fd6468) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:20.156807 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d360f-9b8f-4361-a683-70ae1480790c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:20.158500 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d360f-9b8f-4361-a683-70ae1480790c None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:20.165611 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 366/715] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:38:19 2022] GET /identity/v3/role_assignments?user.id=d54521ea1dca44c98d6723d0b9fd6468&scope.project.id=ff90b874f5b84d28a2752bc95419ad95&role.id=abdc0e0957534149b3653eaa33cbd054 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:20.270779 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 350/716] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 15:38:20.305284 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d360f-9b8f-4361-a683-70ae1480790c None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:20.429982 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d360f-9b8f-4361-a683-70ae1480790c None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:20.481412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615f768-4de7-4489-9dcb-cee3ca8ef659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:20.482955 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615f768-4de7-4489-9dcb-cee3ca8ef659 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:20.483547 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615f768-4de7-4489-9dcb-cee3ca8ef659 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:20.484107 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615f768-4de7-4489-9dcb-cee3ca8ef659 None admin] PATH_INFO: `/v3/services/network` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:20.485344 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615f768-4de7-4489-9dcb-cee3ca8ef659 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:20.487885 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615f768-4de7-4489-9dcb-cee3ca8ef659 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:20.510021 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-1615f768-4de7-4489-9dcb-cee3ca8ef659 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 15:38:20.510021 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:20.510021 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:38:20.510021 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:38:20.510021 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:38:20.510021 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:38:20.510021 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:38:20.510021 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:20.510021 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 15:38:20.510021 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:20.510021 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:38:20.510021 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:20.510021 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:20.510021 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:20.510021 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:20.510021 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:20.510021 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:20.511294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:20.511294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:20.511294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:20.511294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:20.511294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:20.511294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:20.511294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:38:20.511294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:38:20.511294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:38:20.511294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:38:20.511294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:20.511294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:20.511294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:20.511294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:20.511294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:20.511294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:20.512820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:20.512820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:20.512820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:20.512820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:20.512820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:20.512820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:20.512820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:20.512820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:20.512820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:20.512820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:20.512820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:38:20.512820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:20.512820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 15:38:20.512820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:20.516111 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 367/717] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:20 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:20.523000 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5efbe-9ff7-43c7-98be-8212052c87a9 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:20.660646 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:20.698144 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5efbe-9ff7-43c7-98be-8212052c87a9 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:20.756579 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097552b9-8b05-4fb8-9c96-9f12dc33f29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:20.756579 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097552b9-8b05-4fb8-9c96-9f12dc33f29a None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:20.756579 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097552b9-8b05-4fb8-9c96-9f12dc33f29a None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:20.756579 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097552b9-8b05-4fb8-9c96-9f12dc33f29a None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:20.757036 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097552b9-8b05-4fb8-9c96-9f12dc33f29a None admin] RBAC: Adding query filter params (name=network) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:20.757036 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097552b9-8b05-4fb8-9c96-9f12dc33f29a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:20.757036 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097552b9-8b05-4fb8-9c96-9f12dc33f29a None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:20.762674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 351/718] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 23 15:38:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:20.767194 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615f768-4de7-4489-9dcb-cee3ca8ef659 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:20.820868 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:20.905210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615f768-4de7-4489-9dcb-cee3ca8ef659 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:20.949392 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167e77f-6ca2-4022-8138-cb65bb1ae55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:20.950108 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167e77f-6ca2-4022-8138-cb65bb1ae55f None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:20.950394 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167e77f-6ca2-4022-8138-cb65bb1ae55f None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:20.950669 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167e77f-6ca2-4022-8138-cb65bb1ae55f None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:20.951382 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167e77f-6ca2-4022-8138-cb65bb1ae55f None admin] RBAC: Adding query filter params (type=network) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:20.951690 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167e77f-6ca2-4022-8138-cb65bb1ae55f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:20.953061 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167e77f-6ca2-4022-8138-cb65bb1ae55f None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:20.966506 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 368/719] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 23 15:38:20 2022] GET /identity/v3/services?type=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:21.859942 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee63a2-ca09-420b-99bd-e9bd556f1d12 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:21.860435 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee63a2-ca09-420b-99bd-e9bd556f1d12 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:21.860435 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee63a2-ca09-420b-99bd-e9bd556f1d12 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:21.862040 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 352/720] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:21.867555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab751b10-1e4e-49f1-a8a5-c2841c5c83ac None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:21.867999 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab751b10-1e4e-49f1-a8a5-c2841c5c83ac None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:21.868181 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab751b10-1e4e-49f1-a8a5-c2841c5c83ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:21.898130 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-ab751b10-1e4e-49f1-a8a5-c2841c5c83ac None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:21.899351 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ab751b10-1e4e-49f1-a8a5-c2841c5c83ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:22.000289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 369/721] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 15:38:22.004514 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff12df7-2b73-49ef-87c2-875a48e2160c None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:22.005220 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff12df7-2b73-49ef-87c2-875a48e2160c None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:22.005955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff12df7-2b73-49ef-87c2-875a48e2160c None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:22.009012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 353/722] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:22.013941 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596d78f-feae-4e11-9da8-96c5c573fafc None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:22.014242 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596d78f-feae-4e11-9da8-96c5c573fafc None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:22.014527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596d78f-feae-4e11-9da8-96c5c573fafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:22.032050 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-4596d78f-feae-4e11-9da8-96c5c573fafc None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:22.033261 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-4596d78f-feae-4e11-9da8-96c5c573fafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:22.045529 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff12df7-2b73-49ef-87c2-875a48e2160c None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:22.055915 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:22.107381 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 370/723] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:38:22.156023 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596d78f-feae-4e11-9da8-96c5c573fafc None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:22.237625 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff12df7-2b73-49ef-87c2-875a48e2160c None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:22.315994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4725436-2d6b-4ec6-97f6-36c5d33878f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:22.316802 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4725436-2d6b-4ec6-97f6-36c5d33878f2 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:22.317092 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4725436-2d6b-4ec6-97f6-36c5d33878f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:22.317371 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4725436-2d6b-4ec6-97f6-36c5d33878f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:22.331373 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4725436-2d6b-4ec6-97f6-36c5d33878f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:38:22.339539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-f4725436-2d6b-4ec6-97f6-36c5d33878f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:38:22.339539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:22.339539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:22.339539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:22.339539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:22.339539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:22.339539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:22.339539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:22.339539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:22.339539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:22.339539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:22.339539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:22.339539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:38:22.339539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:38:22.339539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:38:22.339539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:38:22.341052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:38:22.341052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:38:22.341052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:38:22.341052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:38:22.341052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:22.341052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:22.341052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:22.341052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:22.341052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:22.341052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:22.341052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:22.341052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:22.341052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:22.341052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:22.341052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:22.341052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:22.341904 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:22.341904 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:22.341904 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:22.341904 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:22.341904 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:38:22.341904 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:38:22.341904 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:38:22.341904 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:38:22.341904 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:38:22.341904 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:38:22.341904 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:38:22.341904 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:22.342713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 354/724] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:38:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:22.346077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:22.350488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4725436-2d6b-4ec6-97f6-36c5d33878f2 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:22.362228 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596d78f-feae-4e11-9da8-96c5c573fafc None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:22.399459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a3a42-c0d7-4ac3-b68f-e6b8ed11cdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:22.400267 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a3a42-c0d7-4ac3-b68f-e6b8ed11cdc7 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:22.400579 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a3a42-c0d7-4ac3-b68f-e6b8ed11cdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:22.401041 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a3a42-c0d7-4ac3-b68f-e6b8ed11cdc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:22.415249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a3a42-c0d7-4ac3-b68f-e6b8ed11cdc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:38:22.433353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-059a3a42-c0d7-4ac3-b68f-e6b8ed11cdc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:22.433353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:22.433353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:22.433353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:22.433353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:22.433353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:22.433353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:22.433353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:22.433353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:22.433353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:22.433353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:22.433353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:22.433353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:38:22.433353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:38:22.433353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:38:22.433353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:38:22.434918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:38:22.434918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:38:22.434918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:38:22.434918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:38:22.434918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:22.434918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:22.434918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:22.434918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:22.434918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:22.434918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:22.434918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:22.434918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:22.434918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:22.434918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:22.434918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:22.434918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:22.435810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:22.435810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:22.435810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:22.435810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:22.435810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:38:22.435810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:38:22.435810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:38:22.435810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:38:22.435810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:38:22.435810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:38:22.435810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:22.435810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:22.442135 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 371/725] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 23 15:38:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:38:22.448009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a3a42-c0d7-4ac3-b68f-e6b8ed11cdc7 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:22.483507 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:22.537889 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4725436-2d6b-4ec6-97f6-36c5d33878f2 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:22.577292 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174f2e5-c824-4b01-bc5e-c5731c49732c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:22.578012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174f2e5-c824-4b01-bc5e-c5731c49732c None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:22.578304 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174f2e5-c824-4b01-bc5e-c5731c49732c None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:22.578652 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174f2e5-c824-4b01-bc5e-c5731c49732c None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:22.579341 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174f2e5-c824-4b01-bc5e-c5731c49732c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:22.579652 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174f2e5-c824-4b01-bc5e-c5731c49732c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:22.581123 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174f2e5-c824-4b01-bc5e-c5731c49732c None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:22.584509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a3a42-c0d7-4ac3-b68f-e6b8ed11cdc7 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:22.590966 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 355/726] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:38:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:22.597142 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0e9c6-e417-413f-abb7-e9a49c0695c9 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:22.597439 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0e9c6-e417-413f-abb7-e9a49c0695c9 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:22.597715 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0e9c6-e417-413f-abb7-e9a49c0695c9 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:22.599500 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 356/727] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:22.600306 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0e9c6-e417-413f-abb7-e9a49c0695c9 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:22.626344 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b746309b-ed89-4efb-bc8d-7d2a8e31f79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:22.627499 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746309b-ed89-4efb-bc8d-7d2a8e31f79d None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:22.627793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746309b-ed89-4efb-bc8d-7d2a8e31f79d None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:22.628078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b746309b-ed89-4efb-bc8d-7d2a8e31f79d None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:22.629001 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746309b-ed89-4efb-bc8d-7d2a8e31f79d None admin] RBAC: Adding query filter params (name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:22.629319 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746309b-ed89-4efb-bc8d-7d2a8e31f79d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:22.630739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b746309b-ed89-4efb-bc8d-7d2a8e31f79d None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:22.639859 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 372/728] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 23 15:38:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:22.641139 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074d151-1b88-4f95-8c67-32ddb33a5c18 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:22.641432 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074d151-1b88-4f95-8c67-32ddb33a5c18 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:22.641715 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074d151-1b88-4f95-8c67-32ddb33a5c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:22.659247 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-0074d151-1b88-4f95-8c67-32ddb33a5c18 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:22.660457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-0074d151-1b88-4f95-8c67-32ddb33a5c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:22.676417 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:22.720686 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0e9c6-e417-413f-abb7-e9a49c0695c9 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:22.733134 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 373/729] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:38:22.734500 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028eeaf-bdff-4966-8c50-a4f7d8b58db1 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:22.734792 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028eeaf-bdff-4966-8c50-a4f7d8b58db1 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:22.735073 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028eeaf-bdff-4966-8c50-a4f7d8b58db1 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:22.738019 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 374/730] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:22.738019 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028eeaf-bdff-4966-8c50-a4f7d8b58db1 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:22.760193 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:22.768860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4817f717-0123-49dc-9219-fab77045786f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:22.769666 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817f717-0123-49dc-9219-fab77045786f None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:22.769984 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817f717-0123-49dc-9219-fab77045786f None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:22.770269 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4817f717-0123-49dc-9219-fab77045786f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:22.782663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817f717-0123-49dc-9219-fab77045786f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:22.784121 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4817f717-0123-49dc-9219-fab77045786f None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:22.801931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-4817f717-0123-49dc-9219-fab77045786f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:22.801931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:22.801931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:22.801931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:22.801931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:22.801931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:22.801931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:22.801931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:22.801931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:22.801931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:22.801931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:22.801931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:22.801931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:22.801931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:22.801931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:22.802851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:22.802851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:22.802851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:22.802851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:22.802851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:22.802851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:22.802851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:22.802851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:22.802851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:22.802851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:22.802851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:22.802851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:22.802851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:22.802851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:22.802851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:22.802851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:22.802851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:22.803738 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:22.803738 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:22.803738 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:22.803738 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:22.803738 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 357/731] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:22.804315 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9761d6-ad24-49c1-b856-a198b85b8de2 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:22.804608 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9761d6-ad24-49c1-b856-a198b85b8de2 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:22.804887 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9761d6-ad24-49c1-b856-a198b85b8de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:22.825598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-4c9761d6-ad24-49c1-b856-a198b85b8de2 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:22.827292 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-4c9761d6-ad24-49c1-b856-a198b85b8de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:22.858091 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028eeaf-bdff-4966-8c50-a4f7d8b58db1 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:22.894068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142b19d-de9b-493d-9571-21e029caf664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:22.894985 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142b19d-de9b-493d-9571-21e029caf664 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:22.895242 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142b19d-de9b-493d-9571-21e029caf664 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:22.895515 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f142b19d-de9b-493d-9571-21e029caf664 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:22.909893 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 358/732] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:38:22.909893 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9761d6-ad24-49c1-b856-a198b85b8de2 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:22.917249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142b19d-de9b-493d-9571-21e029caf664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:22.919370 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f142b19d-de9b-493d-9571-21e029caf664 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:22.938374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-f142b19d-de9b-493d-9571-21e029caf664 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:22.938374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:22.938374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:22.938374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:22.938374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:22.938374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:22.938374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:22.938374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:22.938374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:22.938374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:22.938374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:22.938374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:22.938374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:22.938374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:22.938374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:22.939488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:22.939488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:22.939488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:22.939488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:22.939488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:22.939488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:22.939488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:22.939488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:22.939488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:22.939488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:22.939488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:22.939488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:22.939488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:22.939488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:22.939488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:22.939488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:22.939488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:22.940383 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:22.940383 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:22.940383 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:22.940383 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:22.940383 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 375/733] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:22.940383 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142b19d-de9b-493d-9571-21e029caf664 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:22.963989 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:23.000867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:23.023586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9761d6-ad24-49c1-b856-a198b85b8de2 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:23.056006 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f142b19d-de9b-493d-9571-21e029caf664 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:23.069973 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491e258-b9e6-4cbb-94a4-0cd57bf6797c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:23.070654 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491e258-b9e6-4cbb-94a4-0cd57bf6797c None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:23.070941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491e258-b9e6-4cbb-94a4-0cd57bf6797c None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:23.071219 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491e258-b9e6-4cbb-94a4-0cd57bf6797c None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:23.071942 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491e258-b9e6-4cbb-94a4-0cd57bf6797c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:23.073315 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491e258-b9e6-4cbb-94a4-0cd57bf6797c None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:23.101963 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 359/734] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 23 15:38:22 2022] POST /identity/v3/services => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:38:23.101963 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491e258-b9e6-4cbb-94a4-0cd57bf6797c None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:23.111709 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513001b3-69ed-4dd6-bc12-92d56c1f5f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:23.112535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513001b3-69ed-4dd6-bc12-92d56c1f5f23 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:23.112928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513001b3-69ed-4dd6-bc12-92d56c1f5f23 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:23.113263 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513001b3-69ed-4dd6-bc12-92d56c1f5f23 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:23.114146 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513001b3-69ed-4dd6-bc12-92d56c1f5f23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:23.114524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513001b3-69ed-4dd6-bc12-92d56c1f5f23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:23.116119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513001b3-69ed-4dd6-bc12-92d56c1f5f23 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:23.134061 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 376/735] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:23.135032 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513001b3-69ed-4dd6-bc12-92d56c1f5f23 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:23.231993 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491e258-b9e6-4cbb-94a4-0cd57bf6797c None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:23.235516 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:23.265093 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513001b3-69ed-4dd6-bc12-92d56c1f5f23 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:23.283068 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9074b-fc2e-4d64-889b-ec93cd42e23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:23.284331 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9074b-fc2e-4d64-889b-ec93cd42e23d None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:23.284618 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9074b-fc2e-4d64-889b-ec93cd42e23d None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:23.284896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9074b-fc2e-4d64-889b-ec93cd42e23d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:23.287007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:23.300292 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9074b-fc2e-4d64-889b-ec93cd42e23d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:38:23.310789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-c9d9074b-fc2e-4d64-889b-ec93cd42e23d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:38:23.310789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:23.310789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:23.310789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:23.310789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:23.310789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:23.310789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:23.310789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:23.310789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:23.310789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:23.310789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:23.310789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:23.310789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:38:23.310789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:38:23.310789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:38:23.310789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:38:23.311931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:38:23.311931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:38:23.311931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:38:23.311931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:38:23.311931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:23.311931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:23.311931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:23.311931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:23.311931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:23.311931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:23.311931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:23.311931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:23.311931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:23.311931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:23.311931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:23.311931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:23.312935 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:23.312935 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:23.312935 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:23.312935 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:23.312935 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:38:23.312935 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:38:23.312935 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:38:23.312935 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:38:23.312935 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:38:23.312935 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:38:23.312935 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:38:23.312935 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:23.314602 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb065e7-5e81-40bc-b7c7-7f931f8bd076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:23.315182 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 360/736] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:38:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:23.315770 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb065e7-5e81-40bc-b7c7-7f931f8bd076 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:23.315960 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9074b-fc2e-4d64-889b-ec93cd42e23d None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:23.316234 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb065e7-5e81-40bc-b7c7-7f931f8bd076 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:23.318481 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb065e7-5e81-40bc-b7c7-7f931f8bd076 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:23.318481 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb065e7-5e81-40bc-b7c7-7f931f8bd076 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:23.318828 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb065e7-5e81-40bc-b7c7-7f931f8bd076 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:23.320416 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb065e7-5e81-40bc-b7c7-7f931f8bd076 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:23.338774 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 377/737] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:23.340740 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb065e7-5e81-40bc-b7c7-7f931f8bd076 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:23.446955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9074b-fc2e-4d64-889b-ec93cd42e23d None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:23.483187 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb065e7-5e81-40bc-b7c7-7f931f8bd076 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:23.485056 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3557504-b23c-4878-838d-ec33ffd073b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:23.485885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3557504-b23c-4878-838d-ec33ffd073b1 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:23.486180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3557504-b23c-4878-838d-ec33ffd073b1 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:23.486459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3557504-b23c-4878-838d-ec33ffd073b1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:23.495292 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3557504-b23c-4878-838d-ec33ffd073b1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:23.496819 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3557504-b23c-4878-838d-ec33ffd073b1 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:23.512463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-e3557504-b23c-4878-838d-ec33ffd073b1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 15:38:23.512463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:23.512463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:23.512463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:23.512463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:23.512463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:23.512463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:23.512463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:23.512463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:23.512463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:23.512463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:23.512463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:23.512463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:38:23.512463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:38:23.512463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:38:23.512463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:38:23.513663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:23.513663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:23.513663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:23.513663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:23.513663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:23.513663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:23.513663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:23.513663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:23.513663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:23.513663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:23.513663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:23.513663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:23.513663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:23.513663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:23.513663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:23.513663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:23.513663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:23.513663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:23.514789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:23.514789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:23.514789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:38:23.514789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:38:23.514789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:38:23.514789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:38:23.514789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:38:23.514789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:38:23.514789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 15:38:23.514789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:23.514789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 361/738] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:38:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:23.514789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3557504-b23c-4878-838d-ec33ffd073b1 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:23.530432 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad4787-8691-4a3c-bc74-2e9fb76ea23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:23.531962 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad4787-8691-4a3c-bc74-2e9fb76ea23a None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:23.532399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad4787-8691-4a3c-bc74-2e9fb76ea23a None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:23.533137 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad4787-8691-4a3c-bc74-2e9fb76ea23a None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:23.534364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad4787-8691-4a3c-bc74-2e9fb76ea23a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:23.534852 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad4787-8691-4a3c-bc74-2e9fb76ea23a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:23.536900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad4787-8691-4a3c-bc74-2e9fb76ea23a None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:23.551837 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:23.559205 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 378/739] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:38:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:23.560337 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad4787-8691-4a3c-bc74-2e9fb76ea23a None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:23.606284 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:23.650445 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3557504-b23c-4878-838d-ec33ffd073b1 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:23.681906 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad4787-8691-4a3c-bc74-2e9fb76ea23a None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:23.692267 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dab1c-c708-4486-95e8-6dc9c04f1509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:23.693091 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dab1c-c708-4486-95e8-6dc9c04f1509 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:23.693378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dab1c-c708-4486-95e8-6dc9c04f1509 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:23.693658 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dab1c-c708-4486-95e8-6dc9c04f1509 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:23.702047 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427dab1c-c708-4486-95e8-6dc9c04f1509 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:23.703426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427dab1c-c708-4486-95e8-6dc9c04f1509 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:23.717602 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad9834-b2a4-4b36-9755-94112a319b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:23.718602 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad9834-b2a4-4b36-9755-94112a319b81 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:23.718879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-427dab1c-c708-4486-95e8-6dc9c04f1509 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 15:38:23.718879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:23.718879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:23.718879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:23.718879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:23.718879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:23.718879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:23.718879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:23.718879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:23.718879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:23.718879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:23.718879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:23.718879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:38:23.718879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:38:23.718879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:38:23.718879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:38:23.719770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:23.719770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:23.719770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:23.719770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:23.719770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:23.719770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:23.719770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:23.719770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:23.719770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:23.719770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:23.719770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:23.719770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:23.719770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:23.719770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:23.719770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:23.719770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:23.719770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:23.719770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:23.720696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:23.720696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:23.720696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:38:23.720696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:38:23.720696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:38:23.720696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:38:23.720696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:38:23.720696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:38:23.720696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 15:38:23.720696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:23.720696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 362/740] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jun 23 15:38:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:23.721277 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dab1c-c708-4486-95e8-6dc9c04f1509 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:23.722243 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad9834-b2a4-4b36-9755-94112a319b81 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:23.722547 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad9834-b2a4-4b36-9755-94112a319b81 None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:23.723456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad9834-b2a4-4b36-9755-94112a319b81 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:23.723777 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad9834-b2a4-4b36-9755-94112a319b81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:23.725294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad9834-b2a4-4b36-9755-94112a319b81 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:23.752060 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 379/741] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Jun 23 15:38:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:23.752060 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b676b-8b19-4de6-b176-3d2e57648a15 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:23.752060 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b676b-8b19-4de6-b176-3d2e57648a15 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:23.752060 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b676b-8b19-4de6-b176-3d2e57648a15 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:23.755253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 380/742] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:23.756230 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b676b-8b19-4de6-b176-3d2e57648a15 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:23.838422 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:23.857336 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dab1c-c708-4486-95e8-6dc9c04f1509 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:23.864270 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:23.873757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b676b-8b19-4de6-b176-3d2e57648a15 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:23.895355 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca85a2f-56c7-478c-adb8-96effaaa1347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:23.896268 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca85a2f-56c7-478c-adb8-96effaaa1347 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:23.896560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca85a2f-56c7-478c-adb8-96effaaa1347 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:23.896960 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca85a2f-56c7-478c-adb8-96effaaa1347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:23.909241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19623860-470b-4d48-80a1-d36856ce91c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:23.909835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca85a2f-56c7-478c-adb8-96effaaa1347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:23.909948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19623860-470b-4d48-80a1-d36856ce91c4 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:23.910244 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19623860-470b-4d48-80a1-d36856ce91c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:23.910523 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19623860-470b-4d48-80a1-d36856ce91c4 None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:23.911038 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca85a2f-56c7-478c-adb8-96effaaa1347 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:23.911407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19623860-470b-4d48-80a1-d36856ce91c4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:23.911655 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19623860-470b-4d48-80a1-d36856ce91c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:23.913061 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19623860-470b-4d48-80a1-d36856ce91c4 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:23.930095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-3ca85a2f-56c7-478c-adb8-96effaaa1347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:23.930095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:23.930095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:23.930095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:23.930095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:23.930095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:23.930095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:23.930095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:23.930095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:23.930095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:23.930095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:23.930095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:23.930095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:23.930095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:23.930095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:23.931034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:23.931034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:23.931034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:23.931034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:23.931034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:23.931034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:23.931034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:23.931034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:23.931034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:23.931034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:23.931034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:23.931034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:23.931034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:23.931034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:23.931034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:23.931034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:23.931034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:23.940887 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:23.940887 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:23.940887 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:23.940887 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:23.940887 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 363/744] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:23.941175 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 381/744] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Jun 23 15:38:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:23.941248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca85a2f-56c7-478c-adb8-96effaaa1347 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:23.941314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6684b9-d076-4cac-8559-fac2c79ad14a None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:23.941314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6684b9-d076-4cac-8559-fac2c79ad14a None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:23.941314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6684b9-d076-4cac-8559-fac2c79ad14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:23.955885 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-6b6684b9-d076-4cac-8559-fac2c79ad14a None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:23.957085 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-6b6684b9-d076-4cac-8559-fac2c79ad14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:24.033961 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 382/745] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 15:38:24.033961 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6684b9-d076-4cac-8559-fac2c79ad14a None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:24.053837 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca85a2f-56c7-478c-adb8-96effaaa1347 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:24.089592 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6a617-244c-41f0-b469-e137bbfc80d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:24.090835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6a617-244c-41f0-b469-e137bbfc80d0 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:24.091123 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6a617-244c-41f0-b469-e137bbfc80d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:24.091403 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6a617-244c-41f0-b469-e137bbfc80d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:24.095310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:24.123265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:24.145638 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6684b9-d076-4cac-8559-fac2c79ad14a None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:24.171547 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6a617-244c-41f0-b469-e137bbfc80d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:24.173016 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6a617-244c-41f0-b469-e137bbfc80d0 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:24.183031 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8e77d-67b2-4b7b-af95-7aaee9b71a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:24.183723 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8e77d-67b2-4b7b-af95-7aaee9b71a99 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:24.184243 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8e77d-67b2-4b7b-af95-7aaee9b71a99 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:24.184360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8e77d-67b2-4b7b-af95-7aaee9b71a99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:24.261331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8e77d-67b2-4b7b-af95-7aaee9b71a99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:24.263601 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8e77d-67b2-4b7b-af95-7aaee9b71a99 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:24.285663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 364/746] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:38:23 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:38:24.286366 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6a617-244c-41f0-b469-e137bbfc80d0 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:24.324136 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:24.367223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:24.385396 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 383/747] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:38:24 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 15:38:24.386262 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8e77d-67b2-4b7b-af95-7aaee9b71a99 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:24.402044 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6a617-244c-41f0-b469-e137bbfc80d0 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:24.440013 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35729cd-ae29-4e79-91ea-8be04c406f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:24.440989 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35729cd-ae29-4e79-91ea-8be04c406f20 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:24.441460 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35729cd-ae29-4e79-91ea-8be04c406f20 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:24.441935 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35729cd-ae29-4e79-91ea-8be04c406f20 None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:24.442832 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35729cd-ae29-4e79-91ea-8be04c406f20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:24.443290 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35729cd-ae29-4e79-91ea-8be04c406f20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:24.444828 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35729cd-ae29-4e79-91ea-8be04c406f20 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:24.457908 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 365/748] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:24.459029 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35729cd-ae29-4e79-91ea-8be04c406f20 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:24.501075 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8e77d-67b2-4b7b-af95-7aaee9b71a99 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:24.537186 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672b80a-85ef-4af7-afb2-ca2cf9eff249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:24.537781 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672b80a-85ef-4af7-afb2-ca2cf9eff249 None admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:24.538600 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672b80a-85ef-4af7-afb2-ca2cf9eff249 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:24.538890 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672b80a-85ef-4af7-afb2-ca2cf9eff249 None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:24.539627 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672b80a-85ef-4af7-afb2-ca2cf9eff249 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:24.541009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672b80a-85ef-4af7-afb2-ca2cf9eff249 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:24.559805 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 384/749] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 23 15:38:24 2022] POST /identity/v3/services => generated 240 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:38:24.560762 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672b80a-85ef-4af7-afb2-ca2cf9eff249 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:24.583394 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35729cd-ae29-4e79-91ea-8be04c406f20 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:24.585467 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:24.648474 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:24.654588 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838013c5-f750-4a8f-8dd6-0d57edaa0c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:24.657029 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838013c5-f750-4a8f-8dd6-0d57edaa0c09 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:24.657563 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838013c5-f750-4a8f-8dd6-0d57edaa0c09 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:24.658078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838013c5-f750-4a8f-8dd6-0d57edaa0c09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:24.675953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838013c5-f750-4a8f-8dd6-0d57edaa0c09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:24.677937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838013c5-f750-4a8f-8dd6-0d57edaa0c09 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:24.700257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-838013c5-f750-4a8f-8dd6-0d57edaa0c09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:24.700257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:24.700257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:24.700257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:24.700257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:24.700257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:24.700257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:24.700257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:24.700257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:24.700257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:24.700257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:24.700257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:24.700257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:24.700257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:24.700257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:24.701203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:24.701203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:24.701203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:24.701203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:24.701203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:24.701203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:24.701203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:24.701203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:24.701203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:24.701203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:24.701203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:24.701203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:24.701203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:24.701203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:24.701203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:24.701203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:24.701203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:24.702104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:24.702104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:24.702104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:24.702104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:24.705233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 366/750] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:24.706371 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838013c5-f750-4a8f-8dd6-0d57edaa0c09 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:24.757228 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672b80a-85ef-4af7-afb2-ca2cf9eff249 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:24.815724 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f24176-3d7c-4de6-9b62-13fe59b38c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:24.817223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f24176-3d7c-4de6-9b62-13fe59b38c9d None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:24.817712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f24176-3d7c-4de6-9b62-13fe59b38c9d None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:24.818102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f24176-3d7c-4de6-9b62-13fe59b38c9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:24.834278 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f24176-3d7c-4de6-9b62-13fe59b38c9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:24.836511 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f24176-3d7c-4de6-9b62-13fe59b38c9d None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:24.848195 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838013c5-f750-4a8f-8dd6-0d57edaa0c09 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:24.861046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-40f24176-3d7c-4de6-9b62-13fe59b38c9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:24.861046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:24.861046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:24.861046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:24.861046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:24.861046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:24.861046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:24.861046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:24.861046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:24.861046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:24.861046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:24.861046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:24.861046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:24.861046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:24.861046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:24.862022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:24.862022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:24.862022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:24.862022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:24.862022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:24.862022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:24.862022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:24.862022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:24.862022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:24.862022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:24.862022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:24.862022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:24.862022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:24.862022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:24.862022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:24.862022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:24.862022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:24.862926 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:24.862926 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:24.862926 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:24.862926 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:24.863153 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 385/751] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:24.863881 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f24176-3d7c-4de6-9b62-13fe59b38c9d None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:24.896203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1482a-4e5b-4868-b419-1cb511ddcb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:24.897045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1482a-4e5b-4868-b419-1cb511ddcb8c None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:24.897342 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1482a-4e5b-4868-b419-1cb511ddcb8c None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:24.897629 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1482a-4e5b-4868-b419-1cb511ddcb8c None admin] PATH_INFO: `/v3/users/nova` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:24.907508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1482a-4e5b-4868-b419-1cb511ddcb8c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:24.909136 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1482a-4e5b-4868-b419-1cb511ddcb8c None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:24.925402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-71e1482a-4e5b-4868-b419-1cb511ddcb8c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 15:38:24.925402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:24.925402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:24.925402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:24.925402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:24.925402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:24.925402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:24.925402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:24.925402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:24.925402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:24.925402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:24.925402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:24.925402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:38:24.925402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:38:24.925402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:38:24.925402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:38:24.926834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:24.926834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:24.926834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:24.926834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:24.926834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:24.926834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:24.926834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:24.926834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:24.926834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:24.926834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:24.926834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:24.926834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:24.926834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:24.926834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:24.926834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:24.926834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:24.926834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:24.926834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:24.927763 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:24.927763 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:24.927763 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:38:24.927763 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:38:24.927763 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:38:24.927763 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:38:24.927763 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:38:24.927763 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:38:24.927763 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 15:38:24.927763 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:24.927763 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 367/752] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jun 23 15:38:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:24.928340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1482a-4e5b-4868-b419-1cb511ddcb8c None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:24.938223 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:24.981947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:24.989657 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f24176-3d7c-4de6-9b62-13fe59b38c9d None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:25.030532 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94685e7b-03fe-4a0d-9650-8b1c38f72a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:25.031852 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94685e7b-03fe-4a0d-9650-8b1c38f72a0a None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:25.032377 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94685e7b-03fe-4a0d-9650-8b1c38f72a0a None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:25.032871 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94685e7b-03fe-4a0d-9650-8b1c38f72a0a None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:25.033820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94685e7b-03fe-4a0d-9650-8b1c38f72a0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:25.034384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94685e7b-03fe-4a0d-9650-8b1c38f72a0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:25.036144 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94685e7b-03fe-4a0d-9650-8b1c38f72a0a None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:25.046609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1482a-4e5b-4868-b419-1cb511ddcb8c None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:25.055567 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 386/753] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:25.056964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94685e7b-03fe-4a0d-9650-8b1c38f72a0a None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:25.088053 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba5644-fee2-4a5a-9d35-07c55bb72225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:25.088928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba5644-fee2-4a5a-9d35-07c55bb72225 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:25.089113 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba5644-fee2-4a5a-9d35-07c55bb72225 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:25.089362 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba5644-fee2-4a5a-9d35-07c55bb72225 None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:25.090784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba5644-fee2-4a5a-9d35-07c55bb72225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:25.091056 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba5644-fee2-4a5a-9d35-07c55bb72225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:25.092539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba5644-fee2-4a5a-9d35-07c55bb72225 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:25.110041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 368/754] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:25.111134 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba5644-fee2-4a5a-9d35-07c55bb72225 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:25.174802 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94685e7b-03fe-4a0d-9650-8b1c38f72a0a None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:25.178901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:25.217503 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90403c5f-e92d-4cfe-b262-6587a1a5ce81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:25.218634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90403c5f-e92d-4cfe-b262-6587a1a5ce81 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:25.219172 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90403c5f-e92d-4cfe-b262-6587a1a5ce81 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:25.219648 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90403c5f-e92d-4cfe-b262-6587a1a5ce81 None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:25.220173 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba5644-fee2-4a5a-9d35-07c55bb72225 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:25.220939 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90403c5f-e92d-4cfe-b262-6587a1a5ce81 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:25.221486 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90403c5f-e92d-4cfe-b262-6587a1a5ce81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:25.223327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90403c5f-e92d-4cfe-b262-6587a1a5ce81 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:25.243535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 387/755] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jun 23 15:38:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:25.245011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90403c5f-e92d-4cfe-b262-6587a1a5ce81 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:25.256216 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ebfa8-ad00-444e-9918-fb1b759cabc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:25.257026 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ebfa8-ad00-444e-9918-fb1b759cabc0 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:25.257317 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ebfa8-ad00-444e-9918-fb1b759cabc0 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:25.257599 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ebfa8-ad00-444e-9918-fb1b759cabc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:25.264877 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:25.265745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ebfa8-ad00-444e-9918-fb1b759cabc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:25.267011 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ebfa8-ad00-444e-9918-fb1b759cabc0 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:25.282907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-b61ebfa8-ad00-444e-9918-fb1b759cabc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:25.282907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:25.282907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:25.282907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:25.282907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:25.282907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:25.282907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:25.282907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:25.282907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:25.282907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:25.282907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:25.282907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:25.282907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:25.282907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:25.282907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:25.283843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:25.283843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:25.283843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:25.283843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:25.283843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:25.283843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:25.283843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:25.283843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:25.283843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:25.283843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:25.283843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:25.283843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:25.283843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:25.283843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:25.283843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:25.283843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:25.283843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:25.284804 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:25.284804 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:25.284804 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:25.284804 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:25.284804 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:25.284804 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:25.284804 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:25.284804 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:25.286706 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 369/756] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:25.287685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ebfa8-ad00-444e-9918-fb1b759cabc0 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:25.361572 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90403c5f-e92d-4cfe-b262-6587a1a5ce81 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:25.393801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ebfa8-ad00-444e-9918-fb1b759cabc0 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:25.399294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119951d3-3da0-458b-ad93-f3f08b6fa3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:25.400104 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119951d3-3da0-458b-ad93-f3f08b6fa3f3 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:25.400392 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119951d3-3da0-458b-ad93-f3f08b6fa3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:25.400671 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119951d3-3da0-458b-ad93-f3f08b6fa3f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:25.409497 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119951d3-3da0-458b-ad93-f3f08b6fa3f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:25.410836 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119951d3-3da0-458b-ad93-f3f08b6fa3f3 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:25.421568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:25.425952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-119951d3-3da0-458b-ad93-f3f08b6fa3f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:25.425952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:25.425952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:25.425952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:25.425952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:25.425952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:25.425952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:25.425952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:25.425952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:25.425952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:25.425952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:25.425952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:25.425952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:25.425952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:25.425952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:25.427089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:25.427089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:25.427089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:25.427089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:25.427089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:25.427089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:25.427089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:25.427089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:25.427089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:25.427089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:25.427089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:25.427089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:25.427089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:25.427089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:25.427089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:25.427089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:25.427089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:25.428006 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:25.428006 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:25.428006 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:25.428006 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:25.428006 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:25.428006 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:25.428006 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:25.428006 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:25.428006 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 388/757] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:25.428891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae645c-9790-466d-b471-fa71cc37f550 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:25.429178 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae645c-9790-466d-b471-fa71cc37f550 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:25.429460 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae645c-9790-466d-b471-fa71cc37f550 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:25.430887 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 389/758] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:25.435443 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae645c-9790-466d-b471-fa71cc37f550 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:25.440069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ce85c-9f6e-4b69-a62c-98173038b5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:25.440872 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ce85c-9f6e-4b69-a62c-98173038b5be None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:25.441158 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ce85c-9f6e-4b69-a62c-98173038b5be None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:25.441437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ce85c-9f6e-4b69-a62c-98173038b5be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:25.453256 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ce85c-9f6e-4b69-a62c-98173038b5be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:25.454762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ce85c-9f6e-4b69-a62c-98173038b5be None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:25.472970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-e36ce85c-9f6e-4b69-a62c-98173038b5be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:25.472970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:25.472970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:25.472970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:25.472970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:25.472970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:25.472970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:25.472970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:25.472970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:25.472970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:25.472970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:25.472970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:25.472970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:25.472970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:25.472970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:25.474251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:25.474251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:25.474251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:25.474251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:25.474251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:25.474251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:25.474251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:25.474251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:25.474251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:25.474251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:25.474251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:25.474251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:25.474251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:25.474251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:25.474251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:25.474251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:25.474251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:25.475135 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:25.475135 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:25.475135 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:25.475135 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:25.478764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 370/759] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:25.479434 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ce85c-9f6e-4b69-a62c-98173038b5be None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:25.523153 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:25.554005 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae645c-9790-466d-b471-fa71cc37f550 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:25.590724 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51216de8-57b5-4730-aa37-9d2db7f956c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:25.591392 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51216de8-57b5-4730-aa37-9d2db7f956c2 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:25.591680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51216de8-57b5-4730-aa37-9d2db7f956c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:25.592190 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51216de8-57b5-4730-aa37-9d2db7f956c2 None admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:25.592759 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51216de8-57b5-4730-aa37-9d2db7f956c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:25.593168 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51216de8-57b5-4730-aa37-9d2db7f956c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:25.594552 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51216de8-57b5-4730-aa37-9d2db7f956c2 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:25.601279 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ce85c-9f6e-4b69-a62c-98173038b5be None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:25.608290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 390/760] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:25.609397 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7770964-05ea-47c1-abc9-cb295e607eeb None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:25.609683 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7770964-05ea-47c1-abc9-cb295e607eeb None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:25.610007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7770964-05ea-47c1-abc9-cb295e607eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:25.627320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-d7770964-05ea-47c1-abc9-cb295e607eeb None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:25.628452 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-d7770964-05ea-47c1-abc9-cb295e607eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:25.645525 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0a9e2-9239-456a-a2c9-f5f5e9f87a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:25.646244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0a9e2-9239-456a-a2c9-f5f5e9f87a32 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:25.646587 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0a9e2-9239-456a-a2c9-f5f5e9f87a32 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:25.646878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0a9e2-9239-456a-a2c9-f5f5e9f87a32 None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:25.647694 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0a9e2-9239-456a-a2c9-f5f5e9f87a32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:25.648006 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0a9e2-9239-456a-a2c9-f5f5e9f87a32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:25.649432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0a9e2-9239-456a-a2c9-f5f5e9f87a32 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:25.662632 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 371/761] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:25.663472 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0a9e2-9239-456a-a2c9-f5f5e9f87a32 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:25.704207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:25.719571 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 391/762] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:38:25.720260 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7770964-05ea-47c1-abc9-cb295e607eeb None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:25.792081 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:25.796050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0a9e2-9239-456a-a2c9-f5f5e9f87a32 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:25.832466 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4b2a2-c783-4825-b9e2-dbe54b4fd75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:25.833142 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4b2a2-c783-4825-b9e2-dbe54b4fd75e None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:25.833431 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4b2a2-c783-4825-b9e2-dbe54b4fd75e None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:25.833706 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4b2a2-c783-4825-b9e2-dbe54b4fd75e None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:25.834468 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4b2a2-c783-4825-b9e2-dbe54b4fd75e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:25.834773 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4b2a2-c783-4825-b9e2-dbe54b4fd75e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:25.836145 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4b2a2-c783-4825-b9e2-dbe54b4fd75e None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:25.837945 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7770964-05ea-47c1-abc9-cb295e607eeb None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:25.848215 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 372/763] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:25.848842 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4b2a2-c783-4825-b9e2-dbe54b4fd75e None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:25.879573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47290d0-d6f6-4fa9-ab77-451a78e1865e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:25.880272 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47290d0-d6f6-4fa9-ab77-451a78e1865e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:25.880559 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47290d0-d6f6-4fa9-ab77-451a78e1865e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:25.880835 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47290d0-d6f6-4fa9-ab77-451a78e1865e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:25.881677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47290d0-d6f6-4fa9-ab77-451a78e1865e None admin] RBAC: Adding query filter params (role.id=abdc0e0957534149b3653eaa33cbd054, scope.project.id=ff90b874f5b84d28a2752bc95419ad95, user.id=5824ee17e276483faf20db88a93545f3) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:25.882068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47290d0-d6f6-4fa9-ab77-451a78e1865e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:25.883731 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47290d0-d6f6-4fa9-ab77-451a78e1865e None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:25.890365 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 392/764] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:38:25 2022] GET /identity/v3/role_assignments?user.id=5824ee17e276483faf20db88a93545f3&scope.project.id=ff90b874f5b84d28a2752bc95419ad95&role.id=abdc0e0957534149b3653eaa33cbd054 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:25.891295 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47290d0-d6f6-4fa9-ab77-451a78e1865e None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:25.980046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:25.989270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4b2a2-c783-4825-b9e2-dbe54b4fd75e None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:26.033225 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47290d0-d6f6-4fa9-ab77-451a78e1865e None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:26.034816 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f3b5d-b1bc-412a-906d-0e81352d8e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:26.035596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f3b5d-b1bc-412a-906d-0e81352d8e21 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:26.035948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f3b5d-b1bc-412a-906d-0e81352d8e21 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:26.036373 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f3b5d-b1bc-412a-906d-0e81352d8e21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:26.037241 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f3b5d-b1bc-412a-906d-0e81352d8e21 None admin] RBAC: Adding query filter params (role.id=e004305755a2468aa60ab6632d39207a, scope.project.id=ff90b874f5b84d28a2752bc95419ad95, user.id=dbf2c12174e94e2db9be178973183ced) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:26.038465 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f3b5d-b1bc-412a-906d-0e81352d8e21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:26.039242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f3b5d-b1bc-412a-906d-0e81352d8e21 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:26.046681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 373/765] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:38:25 2022] GET /identity/v3/role_assignments?user.id=dbf2c12174e94e2db9be178973183ced&scope.project.id=ff90b874f5b84d28a2752bc95419ad95&role.id=e004305755a2468aa60ab6632d39207a => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:26.047757 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f3b5d-b1bc-412a-906d-0e81352d8e21 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:26.085722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:26.102113 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d871add-2984-48d5-b126-46ba9da0b8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:26.102963 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d871add-2984-48d5-b126-46ba9da0b8dd None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:26.103252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d871add-2984-48d5-b126-46ba9da0b8dd None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:26.103534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d871add-2984-48d5-b126-46ba9da0b8dd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:26.104216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d871add-2984-48d5-b126-46ba9da0b8dd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:26.105771 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d871add-2984-48d5-b126-46ba9da0b8dd None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:26.122474 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-2d871add-2984-48d5-b126-46ba9da0b8dd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 15:38:26.122474 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:26.122474 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:38:26.122474 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:38:26.122474 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:38:26.122474 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:38:26.122474 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:38:26.122474 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:26.122474 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 15:38:26.122474 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:26.122474 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:38:26.122474 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:26.122474 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:26.122474 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:26.122474 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:26.122474 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:26.123459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:26.123459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:26.123459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:26.123459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:26.123459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:26.123459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:26.123459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:26.123459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:38:26.123459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:38:26.123459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:38:26.123459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:38:26.123459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:26.123459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:26.123459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:26.123459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:26.123459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:26.124721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:26.124721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:26.124721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:26.124721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:26.124721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:26.124721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:26.124721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:26.124721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:26.124721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:26.124721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:26.124721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:26.124721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:38:26.124721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:26.124721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 15:38:26.124721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:26.124721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 393/766] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Jun 23 15:38:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:26.132801 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d871add-2984-48d5-b126-46ba9da0b8dd None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:26.251425 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f3b5d-b1bc-412a-906d-0e81352d8e21 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:26.298186 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d871add-2984-48d5-b126-46ba9da0b8dd None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:26.327516 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b0039-e32a-4f74-b6ec-52c85b075fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:26.328670 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b0039-e32a-4f74-b6ec-52c85b075fb8 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:26.329182 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b0039-e32a-4f74-b6ec-52c85b075fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:26.329654 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b0039-e32a-4f74-b6ec-52c85b075fb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:26.338055 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a0ab2-d3f6-4187-a66e-b0061c44c28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:26.338727 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a0ab2-d3f6-4187-a66e-b0061c44c28f None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:26.339017 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a0ab2-d3f6-4187-a66e-b0061c44c28f None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:26.339300 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a0ab2-d3f6-4187-a66e-b0061c44c28f None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:26.341125 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a0ab2-d3f6-4187-a66e-b0061c44c28f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:26.341444 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a0ab2-d3f6-4187-a66e-b0061c44c28f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:26.342849 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a0ab2-d3f6-4187-a66e-b0061c44c28f None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:26.348397 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 394/767] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Jun 23 15:38:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:26.349544 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b0039-e32a-4f74-b6ec-52c85b075fb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:26.351272 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b0039-e32a-4f74-b6ec-52c85b075fb8 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:26.354738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a0ab2-d3f6-4187-a66e-b0061c44c28f None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:26.375679 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-cd4b0039-e32a-4f74-b6ec-52c85b075fb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:26.375679 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:26.375679 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:26.375679 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:26.375679 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:26.375679 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:26.375679 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:26.375679 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:26.375679 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:26.375679 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:26.375679 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:26.375679 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:26.375679 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:26.375679 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:26.375679 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:26.376614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:26.376614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:26.376614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:26.376614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:26.376614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:26.376614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:26.376614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:26.376614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:26.376614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:26.376614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:26.376614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:26.376614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:26.376614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:26.376614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:26.376614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:26.376614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:26.376614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:26.377469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:26.377469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:26.377469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:26.377469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:26.377469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:26.377469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:26.377469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:26.377469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:26.380463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 374/768] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:26.390989 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b0039-e32a-4f74-b6ec-52c85b075fb8 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:26.434832 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:26.457789 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:26.510578 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a0ab2-d3f6-4187-a66e-b0061c44c28f None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:26.549599 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04352bdc-2d65-4771-8b39-3d03fedb8032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:26.550451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04352bdc-2d65-4771-8b39-3d03fedb8032 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:26.550748 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04352bdc-2d65-4771-8b39-3d03fedb8032 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:26.551034 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04352bdc-2d65-4771-8b39-3d03fedb8032 None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:26.551761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04352bdc-2d65-4771-8b39-3d03fedb8032 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:26.552076 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04352bdc-2d65-4771-8b39-3d03fedb8032 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:26.553629 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04352bdc-2d65-4771-8b39-3d03fedb8032 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:26.559634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 395/769] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Jun 23 15:38:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:26.567933 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04352bdc-2d65-4771-8b39-3d03fedb8032 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:26.671727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b0039-e32a-4f74-b6ec-52c85b075fb8 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:26.681611 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04352bdc-2d65-4771-8b39-3d03fedb8032 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:26.706267 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:26.720002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1501ed-eaeb-48d7-90c2-9ad5c554e7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:26.720687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1501ed-eaeb-48d7-90c2-9ad5c554e7e8 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:26.720984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1501ed-eaeb-48d7-90c2-9ad5c554e7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:26.721335 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1501ed-eaeb-48d7-90c2-9ad5c554e7e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:26.722174 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1501ed-eaeb-48d7-90c2-9ad5c554e7e8 None admin] RBAC: Adding query filter params (interface=public, service_id=0eec1fcfdcac4aabaedad3d181b73d55, region_id=RegionOne) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:26.722547 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1501ed-eaeb-48d7-90c2-9ad5c554e7e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:26.723938 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1501ed-eaeb-48d7-90c2-9ad5c554e7e8 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:26.732673 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 396/770] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Jun 23 15:38:26 2022] GET /identity/v3/endpoints?service_id=0eec1fcfdcac4aabaedad3d181b73d55&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:26.738164 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1501ed-eaeb-48d7-90c2-9ad5c554e7e8 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:26.802620 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1d148-7708-482d-91da-0f9df3f832b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:26.803705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1d148-7708-482d-91da-0f9df3f832b8 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:26.804213 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1d148-7708-482d-91da-0f9df3f832b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:26.804689 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1d148-7708-482d-91da-0f9df3f832b8 None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:26.805688 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1d148-7708-482d-91da-0f9df3f832b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:26.806229 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1d148-7708-482d-91da-0f9df3f832b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:26.807911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e1d148-7708-482d-91da-0f9df3f832b8 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:26.840773 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 375/771] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:26.852087 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1501ed-eaeb-48d7-90c2-9ad5c554e7e8 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:26.858856 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1d148-7708-482d-91da-0f9df3f832b8 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:26.895001 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf3099-aa7e-49ee-b012-9e77fdd0c7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:26.896118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf3099-aa7e-49ee-b012-9e77fdd0c7ce None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:26.896414 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf3099-aa7e-49ee-b012-9e77fdd0c7ce None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:26.896700 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf3099-aa7e-49ee-b012-9e77fdd0c7ce None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:26.897493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf3099-aa7e-49ee-b012-9e77fdd0c7ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:26.899019 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf3099-aa7e-49ee-b012-9e77fdd0c7ce None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:26.905462 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 397/772] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jun 23 15:38:26 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:26.916566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443ed35-421c-42dc-9ec2-fd0ad3d3e506 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:26.916884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443ed35-421c-42dc-9ec2-fd0ad3d3e506 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:26.917147 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443ed35-421c-42dc-9ec2-fd0ad3d3e506 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:26.918966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 398/773] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:38:26.931223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc5078-b16f-4fb8-8e37-11a7976b6934 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:26.931517 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc5078-b16f-4fb8-8e37-11a7976b6934 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:26.931708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc5078-b16f-4fb8-8e37-11a7976b6934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:26.954560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-58cc5078-b16f-4fb8-8e37-11a7976b6934 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:26.956156 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-58cc5078-b16f-4fb8-8e37-11a7976b6934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:27.034283 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:27.044576 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 399/774] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 15:38:27.097587 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:27.110502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc5078-b16f-4fb8-8e37-11a7976b6934 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:27.125429 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e1d148-7708-482d-91da-0f9df3f832b8 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:27.185589 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16014800-3abc-4e58-89ba-3b43b1159f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:27.186688 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16014800-3abc-4e58-89ba-3b43b1159f83 None admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:27.186978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16014800-3abc-4e58-89ba-3b43b1159f83 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:27.187500 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16014800-3abc-4e58-89ba-3b43b1159f83 None admin] PATH_INFO: `/v3/projects/ff90b874f5b84d28a2752bc95419ad95/users/d54521ea1dca44c98d6723d0b9fd6468/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:27.190210 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16014800-3abc-4e58-89ba-3b43b1159f83 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff90b874f5b84d28a2752bc95419ad95, user_id=d54521ea1dca44c98d6723d0b9fd6468, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:27.192135 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16014800-3abc-4e58-89ba-3b43b1159f83 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:27.227466 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 376/775] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 23 15:38:26 2022] PUT /identity/v3/projects/ff90b874f5b84d28a2752bc95419ad95/users/d54521ea1dca44c98d6723d0b9fd6468/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:38:27.251900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc5078-b16f-4fb8-8e37-11a7976b6934 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:27.292853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb88ff-c7db-4d8d-9864-fee02cc94e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:27.293700 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb88ff-c7db-4d8d-9864-fee02cc94e12 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:27.294022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb88ff-c7db-4d8d-9864-fee02cc94e12 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:27.294301 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb88ff-c7db-4d8d-9864-fee02cc94e12 None admin] PATH_INFO: `/v3/services/network` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:27.294968 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb88ff-c7db-4d8d-9864-fee02cc94e12 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:27.296368 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb88ff-c7db-4d8d-9864-fee02cc94e12 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:27.310033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-7dcb88ff-c7db-4d8d-9864-fee02cc94e12 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 15:38:27.310033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:27.310033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:38:27.310033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:38:27.310033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:38:27.310033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:38:27.310033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:38:27.310033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:27.310033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 15:38:27.310033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:27.310033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:38:27.310033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:27.310033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:27.310033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:27.310033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:27.310033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:27.310033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:27.311069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:27.311069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:27.311069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:27.311069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:27.311069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:27.311069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:27.311069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:38:27.311069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:38:27.311069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:38:27.311069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:38:27.311069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:27.311069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:27.311069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:27.311069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:27.311069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:27.311069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:27.311916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:27.311916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:27.311916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:27.311916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:27.311916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:27.311916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:27.311916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:27.311916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:27.311916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:27.311916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:27.311916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:38:27.311916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:27.311916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 15:38:27.311916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:27.311916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 400/776] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:27 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:27.318803 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16014800-3abc-4e58-89ba-3b43b1159f83 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:27.444854 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16014800-3abc-4e58-89ba-3b43b1159f83 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:27.484417 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25590398-c998-4c48-aed2-529b7e5a8cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:27.485121 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25590398-c998-4c48-aed2-529b7e5a8cc3 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:27.485393 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25590398-c998-4c48-aed2-529b7e5a8cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:27.485785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25590398-c998-4c48-aed2-529b7e5a8cc3 None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:27.486554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25590398-c998-4c48-aed2-529b7e5a8cc3 None admin] RBAC: Adding query filter params (name=network) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:27.486866 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25590398-c998-4c48-aed2-529b7e5a8cc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:27.488244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25590398-c998-4c48-aed2-529b7e5a8cc3 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:27.493911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 377/777] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 23 15:38:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:27.501769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb88ff-c7db-4d8d-9864-fee02cc94e12 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:27.555118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:27.622585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb88ff-c7db-4d8d-9864-fee02cc94e12 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:27.658440 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908fb66-2d48-4c24-8959-f5faa2f745c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:27.659109 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908fb66-2d48-4c24-8959-f5faa2f745c2 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:27.659397 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908fb66-2d48-4c24-8959-f5faa2f745c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:27.659680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908fb66-2d48-4c24-8959-f5faa2f745c2 None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:27.660394 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908fb66-2d48-4c24-8959-f5faa2f745c2 None admin] RBAC: Adding query filter params (type=network) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:27.660706 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908fb66-2d48-4c24-8959-f5faa2f745c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:27.662108 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908fb66-2d48-4c24-8959-f5faa2f745c2 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:27.667760 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 401/778] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 23 15:38:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:27.673908 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25590398-c998-4c48-aed2-529b7e5a8cc3 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:27.681430 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:27.804352 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25590398-c998-4c48-aed2-529b7e5a8cc3 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:27.841397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fe871-51db-4356-ae42-df9c0134912a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:27.842102 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fe871-51db-4356-ae42-df9c0134912a None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:27.842389 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fe871-51db-4356-ae42-df9c0134912a None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:27.842667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fe871-51db-4356-ae42-df9c0134912a None admin] PATH_INFO: `/v3/endpoints` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:27.843474 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fe871-51db-4356-ae42-df9c0134912a None admin] RBAC: Adding query filter params (interface=public, service_id=fae98e4cee5543e18bf8efe294d6b149, region_id=RegionOne) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:27.843788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fe871-51db-4356-ae42-df9c0134912a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:27.845173 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fe871-51db-4356-ae42-df9c0134912a None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:27.853787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 378/779] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Jun 23 15:38:27 2022] GET /identity/v3/endpoints?service_id=fae98e4cee5543e18bf8efe294d6b149&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:27.859709 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908fb66-2d48-4c24-8959-f5faa2f745c2 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:27.974064 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908fb66-2d48-4c24-8959-f5faa2f745c2 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:27.982263 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:28.012892 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4ff98-7568-4325-af6e-8de6d3ee2742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:28.013620 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4ff98-7568-4325-af6e-8de6d3ee2742 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:28.013935 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4ff98-7568-4325-af6e-8de6d3ee2742 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:28.014218 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4ff98-7568-4325-af6e-8de6d3ee2742 None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:28.014922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4ff98-7568-4325-af6e-8de6d3ee2742 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:28.016304 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4ff98-7568-4325-af6e-8de6d3ee2742 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:28.022549 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 402/780] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jun 23 15:38:27 2022] GET /identity/v3/services => generated 772 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:28.355702 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969f38f-efb0-4997-89f5-195ae89dac26 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:28.356267 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969f38f-efb0-4997-89f5-195ae89dac26 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:28.356267 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969f38f-efb0-4997-89f5-195ae89dac26 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:28.357890 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 379/781] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:28.363444 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686bc22-3580-4287-8e54-f40e92524ffa None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:28.363868 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686bc22-3580-4287-8e54-f40e92524ffa None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:28.364017 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686bc22-3580-4287-8e54-f40e92524ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:28.383343 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-1686bc22-3580-4287-8e54-f40e92524ffa None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:28.384556 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-1686bc22-3580-4287-8e54-f40e92524ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:28.475897 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 403/782] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:38:28.510787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969f38f-efb0-4997-89f5-195ae89dac26 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:28.590433 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:28.627155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969f38f-efb0-4997-89f5-195ae89dac26 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:28.663378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46486a-942e-424f-982e-b13b9a76537c None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:28.663711 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46486a-942e-424f-982e-b13b9a76537c None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:28.663954 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46486a-942e-424f-982e-b13b9a76537c None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:28.665336 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 404/783] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:28.675030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e251e-3f27-4796-adb6-3d0c508004de None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:28.675383 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e251e-3f27-4796-adb6-3d0c508004de None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:28.675672 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e251e-3f27-4796-adb6-3d0c508004de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:28.678250 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c04ad-c40e-4192-923c-fa9def2ce0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:28.679048 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c04ad-c40e-4192-923c-fa9def2ce0da None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:28.679434 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c04ad-c40e-4192-923c-fa9def2ce0da None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:28.679720 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c04ad-c40e-4192-923c-fa9def2ce0da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:28.691046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04c04ad-c40e-4192-923c-fa9def2ce0da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:38:28.693375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-342e251e-3f27-4796-adb6-3d0c508004de None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:28.694602 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-342e251e-3f27-4796-adb6-3d0c508004de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:28.698861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-b04c04ad-c40e-4192-923c-fa9def2ce0da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:38:28.698861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:28.698861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:28.698861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:28.698861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:28.698861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:28.698861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:28.698861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:28.698861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:28.698861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:28.698861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:28.698861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:28.698861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:38:28.698861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:38:28.698861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:38:28.698861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:38:28.700397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:38:28.700397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:38:28.700397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:38:28.700397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:38:28.700397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:28.700397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:28.700397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:28.700397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:28.700397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:28.700397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:28.700397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:28.700397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:28.700397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:28.700397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:28.700397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:28.700397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:28.701209 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:28.701209 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:28.701209 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:28.701209 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:28.701209 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:38:28.701209 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:38:28.701209 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:38:28.701209 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:38:28.701209 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:38:28.701209 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:38:28.701209 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:38:28.701209 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:28.701209 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 380/784] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:38:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:28.706950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c04ad-c40e-4192-923c-fa9def2ce0da None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:28.770163 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 405/785] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:38:28.791460 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e251e-3f27-4796-adb6-3d0c508004de None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:28.826333 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:28.868065 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c04ad-c40e-4192-923c-fa9def2ce0da None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:28.898419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e251e-3f27-4796-adb6-3d0c508004de None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:28.925888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:28.936819 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0964d8-3aea-4c43-9e6c-7bd2b0a49196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:28.937735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0964d8-3aea-4c43-9e6c-7bd2b0a49196 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:28.938147 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0964d8-3aea-4c43-9e6c-7bd2b0a49196 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:28.938524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0964d8-3aea-4c43-9e6c-7bd2b0a49196 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:28.949673 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0964d8-3aea-4c43-9e6c-7bd2b0a49196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:38:28.954579 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da9a1f-00d7-4574-a242-428f8150743e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:28.955261 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da9a1f-00d7-4574-a242-428f8150743e None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:28.955539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da9a1f-00d7-4574-a242-428f8150743e None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:28.955810 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da9a1f-00d7-4574-a242-428f8150743e None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:28.956570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da9a1f-00d7-4574-a242-428f8150743e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:28.956877 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da9a1f-00d7-4574-a242-428f8150743e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:28.958401 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da9a1f-00d7-4574-a242-428f8150743e None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:28.959101 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-3d0964d8-3aea-4c43-9e6c-7bd2b0a49196 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:28.959101 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:28.959101 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:28.959101 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:28.959101 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:28.959101 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:28.959101 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:28.959101 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:28.959101 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:28.959101 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:28.959101 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:28.959101 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:28.959101 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:38:28.959101 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:38:28.959101 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:38:28.959101 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:38:28.961035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:38:28.961035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:38:28.961035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:38:28.961035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:38:28.961035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:28.961035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:28.961035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:28.961035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:28.961035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:28.961035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:28.961035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:28.961035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:28.961035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:28.961035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:28.961035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:28.961035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:28.963002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:28.963002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:28.963002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:28.963002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:28.963002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:38:28.963002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:38:28.963002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:38:28.963002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:38:28.963002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:38:28.963002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:38:28.963002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:28.963002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:28.967391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 406/786] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 23 15:38:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:28.968763 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0964d8-3aea-4c43-9e6c-7bd2b0a49196 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:28.988145 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 381/787] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:38:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:28.994837 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da9a1f-00d7-4574-a242-428f8150743e None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:29.066246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:29.084639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0964d8-3aea-4c43-9e6c-7bd2b0a49196 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:29.157078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3096b-6652-45cc-8c44-d982998dc379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:29.157747 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3096b-6652-45cc-8c44-d982998dc379 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:29.158084 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3096b-6652-45cc-8c44-d982998dc379 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:29.158375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3096b-6652-45cc-8c44-d982998dc379 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:29.159195 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3096b-6652-45cc-8c44-d982998dc379 None admin] RBAC: Adding query filter params (name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:29.159508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3096b-6652-45cc-8c44-d982998dc379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:29.160904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3096b-6652-45cc-8c44-d982998dc379 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:29.183223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 407/788] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 23 15:38:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:29.189361 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3096b-6652-45cc-8c44-d982998dc379 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:29.218768 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da9a1f-00d7-4574-a242-428f8150743e None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:29.289620 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c66cca-cbac-4a62-993e-7603791c0ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:29.290511 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c66cca-cbac-4a62-993e-7603791c0ae6 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:29.290807 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c66cca-cbac-4a62-993e-7603791c0ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:29.291115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c66cca-cbac-4a62-993e-7603791c0ae6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:29.311684 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c66cca-cbac-4a62-993e-7603791c0ae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:29.315736 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c66cca-cbac-4a62-993e-7603791c0ae6 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:29.347207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-c4c66cca-cbac-4a62-993e-7603791c0ae6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:29.347207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:29.347207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:29.347207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:29.347207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:29.347207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:29.347207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:29.347207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:29.347207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:29.347207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:29.347207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:29.347207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:29.347207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:29.347207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:29.347207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:29.349233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:29.349233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:29.349233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:29.349233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:29.349233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:29.349233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:29.349233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:29.349233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:29.349233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:29.349233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:29.349233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:29.349233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:29.349233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:29.349233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:29.349233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:29.349233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:29.349233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:29.351860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:29.351860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:29.351860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:29.351860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:29.351860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 382/789] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:29.354403 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c66cca-cbac-4a62-993e-7603791c0ae6 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:29.401922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3096b-6652-45cc-8c44-d982998dc379 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:29.416498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:29.456246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd1c18-28c6-47d7-8b17-96d9f8713402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:29.457101 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd1c18-28c6-47d7-8b17-96d9f8713402 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:29.457391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd1c18-28c6-47d7-8b17-96d9f8713402 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:29.457667 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd1c18-28c6-47d7-8b17-96d9f8713402 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:29.471046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd1c18-28c6-47d7-8b17-96d9f8713402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:29.472839 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd1c18-28c6-47d7-8b17-96d9f8713402 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:29.494527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-a0bd1c18-28c6-47d7-8b17-96d9f8713402 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:29.494527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:29.494527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:29.494527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:29.494527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:29.494527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:29.494527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:29.494527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:29.494527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:29.494527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:29.494527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:29.494527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:29.494527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:29.494527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:29.494527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:29.495563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:29.495563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:29.495563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:29.495563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:29.495563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:29.495563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:29.495563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:29.495563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:29.495563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:29.495563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:29.495563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:29.495563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:29.495563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:29.495563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:29.495563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:29.495563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:29.495563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:29.496491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:29.496491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:29.496491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:29.496491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:29.500460 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 408/790] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:29.501649 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd1c18-28c6-47d7-8b17-96d9f8713402 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:29.505707 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:29.576065 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c66cca-cbac-4a62-993e-7603791c0ae6 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:29.626938 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd1c18-28c6-47d7-8b17-96d9f8713402 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:29.645454 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9abc7-028c-4d80-9ac1-b9fd400d80b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:29.646166 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9abc7-028c-4d80-9ac1-b9fd400d80b0 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:29.646456 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9abc7-028c-4d80-9ac1-b9fd400d80b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:29.646739 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9abc7-028c-4d80-9ac1-b9fd400d80b0 None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:29.647478 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9abc7-028c-4d80-9ac1-b9fd400d80b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:29.647804 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9abc7-028c-4d80-9ac1-b9fd400d80b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:29.649239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9abc7-028c-4d80-9ac1-b9fd400d80b0 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:29.663484 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 383/791] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:29.664818 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862ac84-c96c-49f9-a18a-6029fa2f4070 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:29.665111 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862ac84-c96c-49f9-a18a-6029fa2f4070 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:29.665391 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862ac84-c96c-49f9-a18a-6029fa2f4070 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:29.667063 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 384/792] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:29.667715 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2ba06-85e3-4bca-b43c-ddc7d16e0ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:29.671677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2ba06-85e3-4bca-b43c-ddc7d16e0ca3 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:29.671677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2ba06-85e3-4bca-b43c-ddc7d16e0ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:29.671677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2ba06-85e3-4bca-b43c-ddc7d16e0ca3 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:29.671909 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2ba06-85e3-4bca-b43c-ddc7d16e0ca3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:29.672108 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2ba06-85e3-4bca-b43c-ddc7d16e0ca3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:29.673441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2ba06-85e3-4bca-b43c-ddc7d16e0ca3 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:29.673732 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7727464-02c2-4134-b10b-7020035a8b7a None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:29.674236 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7727464-02c2-4134-b10b-7020035a8b7a None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:29.674702 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7727464-02c2-4134-b10b-7020035a8b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:29.692152 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-b7727464-02c2-4134-b10b-7020035a8b7a None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:29.692507 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 409/793] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:29.693434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2ba06-85e3-4bca-b43c-ddc7d16e0ca3 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:29.694431 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-b7727464-02c2-4134-b10b-7020035a8b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:29.758852 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:29.782213 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 385/794] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:38:29.783452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7727464-02c2-4134-b10b-7020035a8b7a None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:29.805610 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2ba06-85e3-4bca-b43c-ddc7d16e0ca3 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:29.834408 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:29.842127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633c58a-cc02-4ba7-b01b-6c3094a066af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:29.842934 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633c58a-cc02-4ba7-b01b-6c3094a066af None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:29.843223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633c58a-cc02-4ba7-b01b-6c3094a066af None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:29.843501 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633c58a-cc02-4ba7-b01b-6c3094a066af None admin] PATH_INFO: `/v3/users/swift` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:29.851205 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633c58a-cc02-4ba7-b01b-6c3094a066af None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:29.852663 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633c58a-cc02-4ba7-b01b-6c3094a066af None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:29.869004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-c633c58a-cc02-4ba7-b01b-6c3094a066af None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 15:38:29.869004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:29.869004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:29.869004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:29.869004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:29.869004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:29.869004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:29.869004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:29.869004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:29.869004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:29.869004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:29.869004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:29.869004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:38:29.869004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:38:29.869004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:38:29.869004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:38:29.870043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:29.870043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:29.870043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:29.870043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:29.870043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:29.870043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:29.870043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:29.870043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:29.870043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:29.870043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:29.870043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:29.870043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:29.870043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:29.870043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:29.870043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:29.870043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:29.870043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:29.870043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:29.870982 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:29.870982 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:29.870982 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:38:29.870982 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:38:29.870982 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:38:29.870982 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:38:29.870982 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:38:29.870982 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:38:29.870982 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 15:38:29.870982 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:29.870982 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 410/795] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:38:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:29.872179 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633c58a-cc02-4ba7-b01b-6c3094a066af None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:29.915238 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7727464-02c2-4134-b10b-7020035a8b7a None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:29.955956 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16a23c-23c9-46c1-80b3-ca21daaba5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:29.956415 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16a23c-23c9-46c1-80b3-ca21daaba5ce None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:29.956779 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16a23c-23c9-46c1-80b3-ca21daaba5ce None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:29.957404 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16a23c-23c9-46c1-80b3-ca21daaba5ce None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:29.966366 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16a23c-23c9-46c1-80b3-ca21daaba5ce None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:29.967939 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16a23c-23c9-46c1-80b3-ca21daaba5ce None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:29.979449 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633c58a-cc02-4ba7-b01b-6c3094a066af None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:29.984640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-ea16a23c-23c9-46c1-80b3-ca21daaba5ce None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 15:38:29.984640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:29.984640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:29.984640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:29.984640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:29.984640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:29.984640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:29.984640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:29.984640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:29.984640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:29.984640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:29.984640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:29.984640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:38:29.984640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:38:29.984640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:38:29.984640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:38:29.985586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:29.985586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:29.985586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:29.985586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:29.985586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:29.985586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:29.985586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:29.985586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:29.985586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:29.985586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:29.985586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:29.985586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:29.985586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:29.985586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:29.985586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:29.985586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:29.985586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:29.985586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:29.986547 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:29.986547 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:29.986547 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:38:29.986547 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:38:29.986547 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:38:29.986547 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:38:29.986547 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:38:29.986547 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:38:29.986547 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 15:38:29.986547 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:29.986547 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 386/796] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jun 23 15:38:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:29.987610 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c10cc9-7bc2-465e-8f3f-79d6a30d4aec None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:29.987822 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c10cc9-7bc2-465e-8f3f-79d6a30d4aec None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:29.988103 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c10cc9-7bc2-465e-8f3f-79d6a30d4aec None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:29.993307 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 387/797] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:29.993307 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c10cc9-7bc2-465e-8f3f-79d6a30d4aec None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:30.014586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:30.028945 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113aa17e-be38-4dec-9e22-6f723f51851d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:30.030599 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113aa17e-be38-4dec-9e22-6f723f51851d None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:30.031144 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113aa17e-be38-4dec-9e22-6f723f51851d None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:30.031428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113aa17e-be38-4dec-9e22-6f723f51851d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:30.032148 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113aa17e-be38-4dec-9e22-6f723f51851d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:30.033544 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113aa17e-be38-4dec-9e22-6f723f51851d None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:30.050068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-113aa17e-be38-4dec-9e22-6f723f51851d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 15:38:30.050068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:30.050068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:38:30.050068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:38:30.050068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:38:30.050068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:38:30.050068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:38:30.050068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:30.050068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 15:38:30.050068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:30.050068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:38:30.050068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:30.050068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:30.050068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:30.050068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:30.050068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:30.051009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:30.051009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:30.051009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:30.051009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:30.051009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:30.051009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:30.051009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:30.051009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:38:30.051009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:38:30.051009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:38:30.051009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:38:30.051009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:30.051009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:30.051009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:30.051009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:30.051009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:30.051833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:30.051833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:30.051833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:30.051833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:30.051833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:30.051833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:30.051833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:30.051833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:30.051833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:30.051833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:30.051833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:30.051833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:38:30.051833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:30.051833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 15:38:30.051833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:30.051833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 411/798] 10.222.0.15 () {56 vars in 1129 bytes} [Thu Jun 23 15:38:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:30.053500 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113aa17e-be38-4dec-9e22-6f723f51851d None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:30.094664 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:30.112086 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c10cc9-7bc2-465e-8f3f-79d6a30d4aec None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:30.175166 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91cd0a-b796-4246-aaef-2745987428d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:30.175844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91cd0a-b796-4246-aaef-2745987428d8 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:30.176132 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91cd0a-b796-4246-aaef-2745987428d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:30.176410 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91cd0a-b796-4246-aaef-2745987428d8 None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:30.177257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91cd0a-b796-4246-aaef-2745987428d8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:30.177727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91cd0a-b796-4246-aaef-2745987428d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:30.179041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91cd0a-b796-4246-aaef-2745987428d8 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:30.184125 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113aa17e-be38-4dec-9e22-6f723f51851d None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:30.203597 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 388/799] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Jun 23 15:38:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:30.203597 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ea317-dc68-4889-9ae5-0e9cd3ae0cff None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:30.203597 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ea317-dc68-4889-9ae5-0e9cd3ae0cff None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:30.203597 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ea317-dc68-4889-9ae5-0e9cd3ae0cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:30.220012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-b75ea317-dc68-4889-9ae5-0e9cd3ae0cff None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:30.221113 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-b75ea317-dc68-4889-9ae5-0e9cd3ae0cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:30.226398 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a7c2c-ac09-4a07-8821-494b7bdaeb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:30.227080 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a7c2c-ac09-4a07-8821-494b7bdaeb49 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:30.227370 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a7c2c-ac09-4a07-8821-494b7bdaeb49 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:30.227654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a7c2c-ac09-4a07-8821-494b7bdaeb49 None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:30.228501 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a7c2c-ac09-4a07-8821-494b7bdaeb49 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:30.228816 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a7c2c-ac09-4a07-8821-494b7bdaeb49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:30.230333 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a7c2c-ac09-4a07-8821-494b7bdaeb49 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:30.249771 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 412/800] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Jun 23 15:38:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:30.250928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a7c2c-ac09-4a07-8821-494b7bdaeb49 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:30.299928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:30.307277 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 389/801] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:38:30.318827 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ea317-dc68-4889-9ae5-0e9cd3ae0cff None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:30.355345 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a7c2c-ac09-4a07-8821-494b7bdaeb49 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:30.398806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3d567-e3bf-4e80-824d-e0d58469881a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:30.399875 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3d567-e3bf-4e80-824d-e0d58469881a None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:30.400364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3d567-e3bf-4e80-824d-e0d58469881a None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:30.400845 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3d567-e3bf-4e80-824d-e0d58469881a None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:30.401764 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3d567-e3bf-4e80-824d-e0d58469881a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:30.402261 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3d567-e3bf-4e80-824d-e0d58469881a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:30.404761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3d567-e3bf-4e80-824d-e0d58469881a None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:30.409794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 413/802] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Jun 23 15:38:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:30.410009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:30.411356 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3d567-e3bf-4e80-824d-e0d58469881a None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:30.436234 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ea317-dc68-4889-9ae5-0e9cd3ae0cff None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:30.472227 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3225da-ebe7-4bfd-b79c-b974404d30ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:30.472947 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3225da-ebe7-4bfd-b79c-b974404d30ca None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:30.473233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3225da-ebe7-4bfd-b79c-b974404d30ca None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:30.473508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3225da-ebe7-4bfd-b79c-b974404d30ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:30.484322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3225da-ebe7-4bfd-b79c-b974404d30ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:30.485770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3225da-ebe7-4bfd-b79c-b974404d30ca None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:30.503535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-3b3225da-ebe7-4bfd-b79c-b974404d30ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:30.503535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:30.503535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:30.503535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:30.503535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:30.503535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:30.503535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:30.503535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:30.503535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:30.503535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:30.503535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:30.503535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:30.503535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:30.503535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:30.503535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:30.504442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:30.504442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:30.504442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:30.504442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:30.504442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:30.504442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:30.504442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:30.504442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:30.504442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:30.504442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:30.504442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:30.504442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:30.504442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:30.504442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:30.504442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:30.504442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:30.504442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:30.505333 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:30.505333 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:30.505333 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:30.505333 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:30.505333 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 390/803] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:30.505604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3225da-ebe7-4bfd-b79c-b974404d30ca None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:30.521897 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3d567-e3bf-4e80-824d-e0d58469881a None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:30.533565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:30.560342 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4983de8-e7b1-4c43-9538-22820aee2f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:30.561162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4983de8-e7b1-4c43-9538-22820aee2f49 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:30.564287 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4983de8-e7b1-4c43-9538-22820aee2f49 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:30.564287 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4983de8-e7b1-4c43-9538-22820aee2f49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:30.575650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4983de8-e7b1-4c43-9538-22820aee2f49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:30.577094 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4983de8-e7b1-4c43-9538-22820aee2f49 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:30.595307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-c4983de8-e7b1-4c43-9538-22820aee2f49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:30.595307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:30.595307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:30.595307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:30.595307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:30.595307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:30.595307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:30.595307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:30.595307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:30.595307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:30.595307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:30.595307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:30.595307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:30.595307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:30.595307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:30.596246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:30.596246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:30.596246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:30.596246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:30.596246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:30.596246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:30.596246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:30.596246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:30.596246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:30.596246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:30.596246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:30.596246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:30.596246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:30.596246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:30.596246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:30.596246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:30.596246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:30.597107 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:30.597107 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:30.597107 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:30.597107 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:30.597107 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 414/804] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:30.597372 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4983de8-e7b1-4c43-9538-22820aee2f49 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:30.609799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3225da-ebe7-4bfd-b79c-b974404d30ca None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:30.640408 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:30.645737 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9108d3e-7b0d-466a-8934-7184f221ca72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:30.646557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9108d3e-7b0d-466a-8934-7184f221ca72 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:30.646843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9108d3e-7b0d-466a-8934-7184f221ca72 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:30.647120 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9108d3e-7b0d-466a-8934-7184f221ca72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:30.657556 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9108d3e-7b0d-466a-8934-7184f221ca72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:38:30.665031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-f9108d3e-7b0d-466a-8934-7184f221ca72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:38:30.665031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:30.665031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:30.665031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:30.665031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:30.665031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:30.665031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:30.665031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:30.665031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:30.665031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:30.665031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:30.665031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:30.665031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:38:30.665031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:38:30.665031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:38:30.665031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:38:30.666002 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:38:30.666002 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:38:30.666002 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:38:30.666002 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:38:30.666002 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:30.666002 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:30.666002 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:30.666002 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:30.666002 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:30.666002 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:30.666002 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:30.666002 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:30.666002 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:30.666002 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:30.666002 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:30.666002 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:30.666870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:30.666870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:30.666870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:30.666870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:30.666870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:38:30.666870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:38:30.666870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:38:30.666870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:38:30.666870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:38:30.666870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:38:30.666870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:38:30.666870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:30.666870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 391/805] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:38:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:30.668796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9108d3e-7b0d-466a-8934-7184f221ca72 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:30.698367 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4983de8-e7b1-4c43-9538-22820aee2f49 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:30.734138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaec53d-2339-46c2-9da5-d34bd31a53cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:30.734715 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaec53d-2339-46c2-9da5-d34bd31a53cf None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:30.735001 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaec53d-2339-46c2-9da5-d34bd31a53cf None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:30.735278 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaec53d-2339-46c2-9da5-d34bd31a53cf None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:30.735986 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaec53d-2339-46c2-9da5-d34bd31a53cf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:30.736294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaec53d-2339-46c2-9da5-d34bd31a53cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:30.737682 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaec53d-2339-46c2-9da5-d34bd31a53cf None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:30.744561 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 415/806] 10.222.0.15 () {56 vars in 1124 bytes} [Thu Jun 23 15:38:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:30.745872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91d8cc-87ac-452c-9679-741d65650295 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:30.746668 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91d8cc-87ac-452c-9679-741d65650295 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:30.746949 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91d8cc-87ac-452c-9679-741d65650295 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:30.749962 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 416/807] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:30.749962 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91d8cc-87ac-452c-9679-741d65650295 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:30.773826 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9108d3e-7b0d-466a-8934-7184f221ca72 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:30.779813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:30.807168 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262388bc-3bcb-4f18-9fac-53f230b36afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:30.807832 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262388bc-3bcb-4f18-9fac-53f230b36afe None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:30.808125 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262388bc-3bcb-4f18-9fac-53f230b36afe None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:30.808403 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262388bc-3bcb-4f18-9fac-53f230b36afe None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:30.809657 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262388bc-3bcb-4f18-9fac-53f230b36afe None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:30.809997 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262388bc-3bcb-4f18-9fac-53f230b36afe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:30.811364 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262388bc-3bcb-4f18-9fac-53f230b36afe None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:30.823907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 392/808] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:30.825311 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262388bc-3bcb-4f18-9fac-53f230b36afe None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:30.856283 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91d8cc-87ac-452c-9679-741d65650295 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:30.877669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:30.889682 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78f969-87f7-4dd1-9440-08393638ab9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:30.890366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78f969-87f7-4dd1-9440-08393638ab9d None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:30.890647 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78f969-87f7-4dd1-9440-08393638ab9d None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:30.890921 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78f969-87f7-4dd1-9440-08393638ab9d None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:30.891639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78f969-87f7-4dd1-9440-08393638ab9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:30.891944 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78f969-87f7-4dd1-9440-08393638ab9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:30.893290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a78f969-87f7-4dd1-9440-08393638ab9d None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:30.904991 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 417/809] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:30.906072 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78f969-87f7-4dd1-9440-08393638ab9d None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:30.926043 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262388bc-3bcb-4f18-9fac-53f230b36afe None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:30.960092 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e5872-db9e-4b97-9641-75ef632db3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:30.960760 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e5872-db9e-4b97-9641-75ef632db3af None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:30.961044 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e5872-db9e-4b97-9641-75ef632db3af None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:30.961323 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e5872-db9e-4b97-9641-75ef632db3af None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:30.962099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e5872-db9e-4b97-9641-75ef632db3af None admin] RBAC: Adding query filter params (name=admin) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:30.962410 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e5872-db9e-4b97-9641-75ef632db3af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:30.963780 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e5872-db9e-4b97-9641-75ef632db3af None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:30.972281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 393/810] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:38:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:30.973462 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a6f41-ac2b-463a-af91-33ede5ef22ff None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:30.973752 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a6f41-ac2b-463a-af91-33ede5ef22ff None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:30.974184 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a6f41-ac2b-463a-af91-33ede5ef22ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:30.990919 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-7d4a6f41-ac2b-463a-af91-33ede5ef22ff None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:30.992325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-7d4a6f41-ac2b-463a-af91-33ede5ef22ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:30.994822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:31.010086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78f969-87f7-4dd1-9440-08393638ab9d None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:31.046803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de80899-d0bb-4666-a071-d13d451a2e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:31.047469 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de80899-d0bb-4666-a071-d13d451a2e91 None admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:31.047752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de80899-d0bb-4666-a071-d13d451a2e91 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:31.048031 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de80899-d0bb-4666-a071-d13d451a2e91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:31.048772 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de80899-d0bb-4666-a071-d13d451a2e91 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:31.050173 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de80899-d0bb-4666-a071-d13d451a2e91 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:31.061346 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 394/811] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:38:31.062347 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a6f41-ac2b-463a-af91-33ede5ef22ff None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:31.080900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 418/812] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jun 23 15:38:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:38:31.080900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de80899-d0bb-4666-a071-d13d451a2e91 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:31.126798 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:31.201811 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a6f41-ac2b-463a-af91-33ede5ef22ff None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:31.241076 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de80899-d0bb-4666-a071-d13d451a2e91 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:31.245320 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4e313-8ab6-4c66-b212-696f777c752d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:31.245729 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4e313-8ab6-4c66-b212-696f777c752d None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:31.246737 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4e313-8ab6-4c66-b212-696f777c752d None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:31.247626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4e313-8ab6-4c66-b212-696f777c752d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:31.254627 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4e313-8ab6-4c66-b212-696f777c752d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:31.256788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4e313-8ab6-4c66-b212-696f777c752d None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:31.272508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-3fd4e313-8ab6-4c66-b212-696f777c752d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:31.272508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:31.272508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:31.272508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:31.272508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:31.272508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:31.272508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:31.272508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:31.272508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:31.272508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:31.272508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:31.272508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:31.272508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:31.272508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:31.272508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:31.273420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:31.273420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:31.273420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:31.273420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:31.273420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:31.273420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:31.273420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:31.273420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:31.273420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:31.273420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:31.273420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:31.273420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:31.273420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:31.273420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:31.273420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:31.273420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:31.273420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:31.274305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:31.274305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:31.274305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:31.274305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:31.274305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:31.274305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:31.274305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:31.274305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:31.274305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 395/813] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:31.274807 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4e313-8ab6-4c66-b212-696f777c752d None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:31.284803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f8064-4985-4044-b2a4-ff876ab9de3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:31.285908 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f8064-4985-4044-b2a4-ff876ab9de3e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:31.286034 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f8064-4985-4044-b2a4-ff876ab9de3e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:31.286239 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f8064-4985-4044-b2a4-ff876ab9de3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:31.293874 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f8064-4985-4044-b2a4-ff876ab9de3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:31.295346 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f8064-4985-4044-b2a4-ff876ab9de3e None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:31.297276 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:31.311737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-a08f8064-4985-4044-b2a4-ff876ab9de3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:31.311737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:31.311737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:31.311737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:31.311737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:31.311737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:31.311737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:31.311737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:31.311737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:31.311737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:31.311737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:31.311737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:31.311737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:31.311737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:31.311737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:31.312815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:31.312815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:31.312815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:31.312815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:31.312815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:31.312815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:31.312815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:31.312815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:31.312815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:31.312815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:31.312815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:31.312815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:31.312815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:31.312815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:31.312815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:31.312815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:31.312815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:31.313769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:31.313769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:31.313769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:31.313769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:31.313769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:31.313769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:31.313769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:31.313769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:31.313769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 419/814] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:31.314276 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f8064-4985-4044-b2a4-ff876ab9de3e None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:31.380764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:31.383716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4e313-8ab6-4c66-b212-696f777c752d None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:31.419837 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f8064-4985-4044-b2a4-ff876ab9de3e None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:31.422377 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc3cbc-c55d-475c-bf9e-0dca35d56b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:31.423176 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc3cbc-c55d-475c-bf9e-0dca35d56b01 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:31.423458 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc3cbc-c55d-475c-bf9e-0dca35d56b01 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:31.423731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc3cbc-c55d-475c-bf9e-0dca35d56b01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:31.435151 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc3cbc-c55d-475c-bf9e-0dca35d56b01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:31.436601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc3cbc-c55d-475c-bf9e-0dca35d56b01 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:31.453901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-e6bc3cbc-c55d-475c-bf9e-0dca35d56b01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:31.453901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:31.453901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:31.453901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:31.453901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:31.453901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:31.453901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:31.453901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:31.453901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:31.453901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:31.453901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:31.453901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:31.453901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:31.453901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:31.453901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:31.454896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:31.454896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:31.454896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:31.454896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:31.454896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:31.454896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:31.454896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:31.454896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:31.454896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:31.454896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:31.454896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:31.454896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:31.454896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:31.454896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:31.454896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:31.454896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:31.454896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:31.456244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:31.456244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:31.456244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:31.456244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:31.456244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 396/815] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:31.456244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc3cbc-c55d-475c-bf9e-0dca35d56b01 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:31.462320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c34b9-b482-4b9a-a142-3f5ff3a40ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:31.463189 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c34b9-b482-4b9a-a142-3f5ff3a40ab9 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:31.463476 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c34b9-b482-4b9a-a142-3f5ff3a40ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:31.463754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86c34b9-b482-4b9a-a142-3f5ff3a40ab9 None admin] PATH_INFO: `/v3/services/network` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:31.464417 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c34b9-b482-4b9a-a142-3f5ff3a40ab9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:31.466903 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86c34b9-b482-4b9a-a142-3f5ff3a40ab9 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:31.480976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-e86c34b9-b482-4b9a-a142-3f5ff3a40ab9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 15:38:31.480976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:31.480976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:38:31.480976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:38:31.480976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:38:31.480976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:38:31.480976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:38:31.480976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:31.480976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 15:38:31.480976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:31.480976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:38:31.480976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:31.480976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:31.480976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:31.480976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:31.480976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:31.480976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:31.482043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:31.482043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:31.482043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:31.482043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:31.482043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:31.482043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:31.482043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:38:31.482043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:38:31.482043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:38:31.482043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:38:31.482043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:31.482043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:31.482043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:31.482043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:31.482043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:31.482043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:31.482873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:31.482873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:31.482873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:31.482873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:31.482873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:31.482873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:31.482873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:31.482873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:31.482873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:31.482873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:31.482873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:38:31.482873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:31.482873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 15:38:31.482873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:31.482873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 420/816] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:31 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:31.484344 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c34b9-b482-4b9a-a142-3f5ff3a40ab9 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:31.553690 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:31.572847 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc3cbc-c55d-475c-bf9e-0dca35d56b01 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:31.597746 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86c34b9-b482-4b9a-a142-3f5ff3a40ab9 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:31.609738 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b8869-a691-4e06-b2e9-cec570058da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:31.610411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b8869-a691-4e06-b2e9-cec570058da9 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:31.610696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b8869-a691-4e06-b2e9-cec570058da9 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:31.610972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b8869-a691-4e06-b2e9-cec570058da9 None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:31.611760 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b8869-a691-4e06-b2e9-cec570058da9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:31.612071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b8869-a691-4e06-b2e9-cec570058da9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:31.613520 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b8869-a691-4e06-b2e9-cec570058da9 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:31.628261 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 397/817] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:31.628913 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b8869-a691-4e06-b2e9-cec570058da9 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:31.635106 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e98f8a-f5c0-42e9-b4c0-d83503c811fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:31.635776 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e98f8a-f5c0-42e9-b4c0-d83503c811fd None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:31.636063 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e98f8a-f5c0-42e9-b4c0-d83503c811fd None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:31.636341 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e98f8a-f5c0-42e9-b4c0-d83503c811fd None admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:31.637782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e98f8a-f5c0-42e9-b4c0-d83503c811fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:31.638127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e98f8a-f5c0-42e9-b4c0-d83503c811fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:31.639566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e98f8a-f5c0-42e9-b4c0-d83503c811fd None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:31.645616 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:31.658183 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 421/818] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:31.658183 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e98f8a-f5c0-42e9-b4c0-d83503c811fd None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:31.743650 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b8869-a691-4e06-b2e9-cec570058da9 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:31.759969 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e98f8a-f5c0-42e9-b4c0-d83503c811fd None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:31.783222 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:31.786834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8c45f-1c81-43c0-936c-c61ea12b82c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:31.787541 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8c45f-1c81-43c0-936c-c61ea12b82c1 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:31.787900 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8c45f-1c81-43c0-936c-c61ea12b82c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:31.788093 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8c45f-1c81-43c0-936c-c61ea12b82c1 None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:31.788804 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8c45f-1c81-43c0-936c-c61ea12b82c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:31.789171 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8c45f-1c81-43c0-936c-c61ea12b82c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:31.790517 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f8c45f-1c81-43c0-936c-c61ea12b82c1 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:31.795669 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530bfc7a-646d-4ca4-b042-0d8a7c1ba137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:31.796333 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bfc7a-646d-4ca4-b042-0d8a7c1ba137 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:31.796616 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bfc7a-646d-4ca4-b042-0d8a7c1ba137 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:31.796888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bfc7a-646d-4ca4-b042-0d8a7c1ba137 None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:31.797588 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530bfc7a-646d-4ca4-b042-0d8a7c1ba137 None admin] RBAC: Adding query filter params (name=network) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:31.797940 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530bfc7a-646d-4ca4-b042-0d8a7c1ba137 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:31.799288 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530bfc7a-646d-4ca4-b042-0d8a7c1ba137 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:31.803425 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 398/819] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:31.809351 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 422/820] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 23 15:38:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:31.809494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8c45f-1c81-43c0-936c-c61ea12b82c1 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:31.809574 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530bfc7a-646d-4ca4-b042-0d8a7c1ba137 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:31.885175 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:31.915897 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8c45f-1c81-43c0-936c-c61ea12b82c1 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:31.916374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530bfc7a-646d-4ca4-b042-0d8a7c1ba137 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:31.951984 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719b266-ea36-4b9a-b9ca-92fc1521d7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:31.952875 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719b266-ea36-4b9a-b9ca-92fc1521d7e4 None admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:31.953162 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719b266-ea36-4b9a-b9ca-92fc1521d7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:31.953439 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719b266-ea36-4b9a-b9ca-92fc1521d7e4 None admin] PATH_INFO: `/v3/projects/ff90b874f5b84d28a2752bc95419ad95/users/5824ee17e276483faf20db88a93545f3/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:31.954142 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5bb11-d24b-410b-83ab-83650b094ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:31.955194 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5bb11-d24b-410b-83ab-83650b094ba5 None admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:31.955481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719b266-ea36-4b9a-b9ca-92fc1521d7e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff90b874f5b84d28a2752bc95419ad95, user_id=5824ee17e276483faf20db88a93545f3, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:31.955770 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5bb11-d24b-410b-83ab-83650b094ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:31.956194 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5bb11-d24b-410b-83ab-83650b094ba5 None admin] PATH_INFO: `/v3/projects/ff90b874f5b84d28a2752bc95419ad95/users/dbf2c12174e94e2db9be178973183ced/roles/e004305755a2468aa60ab6632d39207a` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:31.956906 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719b266-ea36-4b9a-b9ca-92fc1521d7e4 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:31.970952 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 399/821] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 23 15:38:31 2022] PUT /identity/v3/projects/ff90b874f5b84d28a2752bc95419ad95/users/5824ee17e276483faf20db88a93545f3/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:38:31.971897 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719b266-ea36-4b9a-b9ca-92fc1521d7e4 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:31.985022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5bb11-d24b-410b-83ab-83650b094ba5 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff90b874f5b84d28a2752bc95419ad95, user_id=dbf2c12174e94e2db9be178973183ced, role_id=e004305755a2468aa60ab6632d39207a)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:31.986929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5bb11-d24b-410b-83ab-83650b094ba5 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:32.014410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 423/822] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 23 15:38:31 2022] PUT /identity/v3/projects/ff90b874f5b84d28a2752bc95419ad95/users/dbf2c12174e94e2db9be178973183ced/roles/e004305755a2468aa60ab6632d39207a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:38:32.016624 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5bb11-d24b-410b-83ab-83650b094ba5 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:32.108122 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:32.165196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719b266-ea36-4b9a-b9ca-92fc1521d7e4 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:32.206961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:32.215763 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dd505-2051-45e4-9421-c77fb03fc735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:32.216743 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dd505-2051-45e4-9421-c77fb03fc735 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:32.217028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dd505-2051-45e4-9421-c77fb03fc735 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:32.217619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dd505-2051-45e4-9421-c77fb03fc735 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:32.227104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dd505-2051-45e4-9421-c77fb03fc735 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:32.228649 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dd505-2051-45e4-9421-c77fb03fc735 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:32.237848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5bb11-d24b-410b-83ab-83650b094ba5 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:32.248247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-b59dd505-2051-45e4-9421-c77fb03fc735 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 15:38:32.248247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:32.248247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:32.248247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:32.248247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:32.248247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:32.248247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:32.248247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:32.248247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:32.248247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:32.248247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:32.248247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:32.248247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:38:32.248247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:38:32.248247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:38:32.248247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:38:32.249211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:32.249211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:32.249211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:32.249211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:32.249211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:32.249211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:32.249211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:32.249211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:32.249211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:32.249211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:32.249211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:32.249211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:32.249211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:32.249211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:32.249211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:32.249211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:32.249211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:32.249211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:32.250156 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:32.250156 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:32.250156 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:38:32.250156 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:38:32.250156 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:38:32.250156 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:38:32.250156 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:38:32.250156 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:38:32.250156 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 15:38:32.250156 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:32.252833 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 400/823] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jun 23 15:38:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:32.258485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dd505-2051-45e4-9421-c77fb03fc735 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:32.282586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b2408-ed73-4f1d-a42e-e4dcd552fddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:32.283265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b2408-ed73-4f1d-a42e-e4dcd552fddd None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:32.283547 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b2408-ed73-4f1d-a42e-e4dcd552fddd None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:32.283823 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b2408-ed73-4f1d-a42e-e4dcd552fddd None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:32.284539 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b2408-ed73-4f1d-a42e-e4dcd552fddd None admin] RBAC: Adding query filter params (type=network) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:32.284854 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b2408-ed73-4f1d-a42e-e4dcd552fddd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:32.290023 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b2408-ed73-4f1d-a42e-e4dcd552fddd None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:32.300020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 424/824] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 23 15:38:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:32.305781 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b2408-ed73-4f1d-a42e-e4dcd552fddd None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:32.419997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:32.424549 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b2408-ed73-4f1d-a42e-e4dcd552fddd None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:32.465489 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee5d4d-9b2d-4250-8bf0-2395b42510cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:32.466393 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee5d4d-9b2d-4250-8bf0-2395b42510cd None admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:32.467099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee5d4d-9b2d-4250-8bf0-2395b42510cd None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:32.467393 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee5d4d-9b2d-4250-8bf0-2395b42510cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:32.468150 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee5d4d-9b2d-4250-8bf0-2395b42510cd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:32.469532 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee5d4d-9b2d-4250-8bf0-2395b42510cd None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:32.492233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dd505-2051-45e4-9421-c77fb03fc735 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:32.513595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 425/825] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jun 23 15:38:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:38:32.548675 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106640c-da62-417f-8972-7ac89dfaf2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:32.549356 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106640c-da62-417f-8972-7ac89dfaf2e1 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:32.549638 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106640c-da62-417f-8972-7ac89dfaf2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:32.549946 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106640c-da62-417f-8972-7ac89dfaf2e1 None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:32.550795 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106640c-da62-417f-8972-7ac89dfaf2e1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:32.551106 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106640c-da62-417f-8972-7ac89dfaf2e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:32.552532 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106640c-da62-417f-8972-7ac89dfaf2e1 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:32.575785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 401/826] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jun 23 15:38:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:32.581512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee5d4d-9b2d-4250-8bf0-2395b42510cd None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:32.745288 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee5d4d-9b2d-4250-8bf0-2395b42510cd None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:32.782809 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2e313-ac9c-489f-9b31-d59045d4d4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:32.783468 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2e313-ac9c-489f-9b31-d59045d4d4a2 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:32.783759 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2e313-ac9c-489f-9b31-d59045d4d4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:32.784042 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2e313-ac9c-489f-9b31-d59045d4d4a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:32.812337 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:32.860072 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2e313-ac9c-489f-9b31-d59045d4d4a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:32.861522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2e313-ac9c-489f-9b31-d59045d4d4a2 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:32.989529 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 426/827] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:38:32 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 15:38:32.994986 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106640c-da62-417f-8972-7ac89dfaf2e1 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:33.049189 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:33.113391 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106640c-da62-417f-8972-7ac89dfaf2e1 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:33.151621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bc969-8fe2-48c5-bf3c-4fcb1e23653f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:33.153011 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bc969-8fe2-48c5-bf3c-4fcb1e23653f None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:33.153310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bc969-8fe2-48c5-bf3c-4fcb1e23653f None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:33.153588 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bc969-8fe2-48c5-bf3c-4fcb1e23653f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:33.165197 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bc969-8fe2-48c5-bf3c-4fcb1e23653f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:33.166698 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bc969-8fe2-48c5-bf3c-4fcb1e23653f None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:33.185910 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-9c2bc969-8fe2-48c5-bf3c-4fcb1e23653f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:33.185910 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:33.185910 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:33.185910 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:33.185910 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:33.185910 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:33.185910 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:33.185910 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:33.185910 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:33.185910 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:33.185910 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:33.185910 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:33.185910 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:33.185910 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:33.185910 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:33.186977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:33.186977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:33.186977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:33.186977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:33.186977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:33.186977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:33.186977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:33.186977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:33.186977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:33.186977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:33.186977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:33.186977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:33.186977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:33.186977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:33.186977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:33.186977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:33.186977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:33.187867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:33.187867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:33.187867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:33.187867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:33.187867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 402/828] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:33.194953 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2e313-ac9c-489f-9b31-d59045d4d4a2 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:33.250773 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:33.296657 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2e313-ac9c-489f-9b31-d59045d4d4a2 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:33.332093 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93d71f-bafd-4766-abca-83b03090ccf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:33.332991 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93d71f-bafd-4766-abca-83b03090ccf9 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:33.333440 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93d71f-bafd-4766-abca-83b03090ccf9 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:33.333888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93d71f-bafd-4766-abca-83b03090ccf9 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:33.334764 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93d71f-bafd-4766-abca-83b03090ccf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:33.335210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93d71f-bafd-4766-abca-83b03090ccf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:33.336712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93d71f-bafd-4766-abca-83b03090ccf9 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:33.350189 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 427/829] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:33.355792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bc969-8fe2-48c5-bf3c-4fcb1e23653f None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:33.359543 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8067a0a-5215-410d-82e3-f08afa3a8ffe None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:33.360145 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8067a0a-5215-410d-82e3-f08afa3a8ffe None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:33.360435 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8067a0a-5215-410d-82e3-f08afa3a8ffe None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:33.362184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 428/830] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:33.367877 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e339823-51d4-4e48-be19-339357529cbf None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:33.368194 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e339823-51d4-4e48-be19-339357529cbf None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:33.368440 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e339823-51d4-4e48-be19-339357529cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:33.386395 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-9e339823-51d4-4e48-be19-339357529cbf None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:33.388473 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-9e339823-51d4-4e48-be19-339357529cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:33.466126 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 429/831] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 15:38:33.470178 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bc969-8fe2-48c5-bf3c-4fcb1e23653f None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:33.471962 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:33.488616 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e339823-51d4-4e48-be19-339357529cbf None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:33.507286 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f04ed-ded1-4e3b-975f-4a93a16b3141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:33.508078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f04ed-ded1-4e3b-975f-4a93a16b3141 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:33.508358 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f04ed-ded1-4e3b-975f-4a93a16b3141 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:33.508628 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f04ed-ded1-4e3b-975f-4a93a16b3141 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:33.515839 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f04ed-ded1-4e3b-975f-4a93a16b3141 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:33.517292 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f04ed-ded1-4e3b-975f-4a93a16b3141 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:33.531402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-233f04ed-ded1-4e3b-975f-4a93a16b3141 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:33.531402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:33.531402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:33.531402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:33.531402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:33.531402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:33.531402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:33.531402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:33.531402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:33.531402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:33.531402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:33.531402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:33.531402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:33.531402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:33.531402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:33.532338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:33.532338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:33.532338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:33.532338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:33.532338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:33.532338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:33.532338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:33.532338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:33.532338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:33.532338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:33.532338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:33.532338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:33.532338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:33.532338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:33.532338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:33.532338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:33.532338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:33.534244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:33.534244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:33.534244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:33.534244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:33.534244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:33.534244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:33.534244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:33.534244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:33.534244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 403/832] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:33.541469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f04ed-ded1-4e3b-975f-4a93a16b3141 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:33.542286 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:33.607708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e339823-51d4-4e48-be19-339357529cbf None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:33.642250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163c56e-1271-43e0-9788-44934179dae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:33.643050 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163c56e-1271-43e0-9788-44934179dae7 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:33.643333 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163c56e-1271-43e0-9788-44934179dae7 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:33.643610 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163c56e-1271-43e0-9788-44934179dae7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:33.644263 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163c56e-1271-43e0-9788-44934179dae7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:33.645651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163c56e-1271-43e0-9788-44934179dae7 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:33.660958 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f04ed-ded1-4e3b-975f-4a93a16b3141 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:33.661794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-0163c56e-1271-43e0-9788-44934179dae7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 15:38:33.661794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:33.661794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:38:33.661794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:38:33.661794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:38:33.661794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:38:33.661794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:38:33.661794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:33.661794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 15:38:33.661794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:33.661794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:38:33.661794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:33.661794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:33.661794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:33.661794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:33.661794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:33.661794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:33.662780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:33.662780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:33.662780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:33.662780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:33.662780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:33.662780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:33.662780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:38:33.662780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:38:33.662780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:38:33.662780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:38:33.662780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:33.662780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:33.662780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:33.662780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:33.662780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:33.662780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:33.664235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:33.664235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:33.664235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:33.664235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:33.664235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:33.664235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:33.664235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:33.664235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:33.664235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:33.664235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:33.664235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:38:33.664235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:33.664235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 15:38:33.664235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:33.664235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 430/833] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 23 15:38:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:38:33.669394 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163c56e-1271-43e0-9788-44934179dae7 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:33.702425 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a7417-09ba-40c4-b29d-4290000797f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:33.703510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a7417-09ba-40c4-b29d-4290000797f8 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:33.704070 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a7417-09ba-40c4-b29d-4290000797f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:33.704360 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a7417-09ba-40c4-b29d-4290000797f8 None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:33.705409 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a7417-09ba-40c4-b29d-4290000797f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:33.705731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a7417-09ba-40c4-b29d-4290000797f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:33.707888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a7417-09ba-40c4-b29d-4290000797f8 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:33.726101 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 404/834] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:33.730359 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a7417-09ba-40c4-b29d-4290000797f8 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:33.750036 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:33.790775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163c56e-1271-43e0-9788-44934179dae7 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:33.802435 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:33.830387 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ea7a1-9e53-4a55-9c40-1db2cfbb7e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:33.831091 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ea7a1-9e53-4a55-9c40-1db2cfbb7e82 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:33.831343 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ea7a1-9e53-4a55-9c40-1db2cfbb7e82 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:33.831628 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ea7a1-9e53-4a55-9c40-1db2cfbb7e82 None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:33.832360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ea7a1-9e53-4a55-9c40-1db2cfbb7e82 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:33.832665 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ea7a1-9e53-4a55-9c40-1db2cfbb7e82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:33.834072 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ea7a1-9e53-4a55-9c40-1db2cfbb7e82 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:33.841804 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a7417-09ba-40c4-b29d-4290000797f8 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:33.845169 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 431/835] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 23 15:38:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:33.845420 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ea7a1-9e53-4a55-9c40-1db2cfbb7e82 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:33.878946 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3960f82-13c7-4e2a-a9ac-b1c396ba660f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:33.879948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3960f82-13c7-4e2a-a9ac-b1c396ba660f None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:33.880459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3960f82-13c7-4e2a-a9ac-b1c396ba660f None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:33.880937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3960f82-13c7-4e2a-a9ac-b1c396ba660f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:33.882003 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3960f82-13c7-4e2a-a9ac-b1c396ba660f None admin] RBAC: Adding query filter params (role.id=abdc0e0957534149b3653eaa33cbd054, scope.project.id=ff90b874f5b84d28a2752bc95419ad95, user.id=d54521ea1dca44c98d6723d0b9fd6468) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:33.882519 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3960f82-13c7-4e2a-a9ac-b1c396ba660f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:33.884153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3960f82-13c7-4e2a-a9ac-b1c396ba660f None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:33.891105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 405/836] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:38:33 2022] GET /identity/v3/role_assignments?user.id=d54521ea1dca44c98d6723d0b9fd6468&scope.project.id=ff90b874f5b84d28a2752bc95419ad95&role.id=abdc0e0957534149b3653eaa33cbd054 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:33.966036 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ea7a1-9e53-4a55-9c40-1db2cfbb7e82 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:34.004104 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49e071-17a2-4ae2-8102-bf7cb30d526a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:34.005179 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49e071-17a2-4ae2-8102-bf7cb30d526a None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:34.005704 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49e071-17a2-4ae2-8102-bf7cb30d526a None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:34.006234 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49e071-17a2-4ae2-8102-bf7cb30d526a None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:34.007187 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49e071-17a2-4ae2-8102-bf7cb30d526a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:34.007710 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49e071-17a2-4ae2-8102-bf7cb30d526a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:34.009384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49e071-17a2-4ae2-8102-bf7cb30d526a None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:34.015949 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 432/837] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 23 15:38:33 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:34.349212 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198acf46-cb69-4fae-8eb0-fc5c9f8165e5 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:34.349598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198acf46-cb69-4fae-8eb0-fc5c9f8165e5 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:34.349774 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198acf46-cb69-4fae-8eb0-fc5c9f8165e5 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:34.351422 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 406/838] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:34.357213 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b17e6-3ee6-41d7-8d44-3bcbbd32cf3a None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:34.357779 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b17e6-3ee6-41d7-8d44-3bcbbd32cf3a None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:34.358297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b17e6-3ee6-41d7-8d44-3bcbbd32cf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:34.429193 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf23275-72b5-43da-afb3-9602ac9c8a6d None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:34.429529 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf23275-72b5-43da-afb3-9602ac9c8a6d None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:34.429743 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf23275-72b5-43da-afb3-9602ac9c8a6d None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:34.432667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 407/839] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:34.437437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a229c-064d-418c-bd22-6b56eb2c42a1 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:34.438037 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a229c-064d-418c-bd22-6b56eb2c42a1 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:34.438037 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a229c-064d-418c-bd22-6b56eb2c42a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:34.456721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-a00a229c-064d-418c-bd22-6b56eb2c42a1 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:34.457986 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-a00a229c-064d-418c-bd22-6b56eb2c42a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:34.505964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-8b0b17e6-3ee6-41d7-8d44-3bcbbd32cf3a None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:34.507181 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-8b0b17e6-3ee6-41d7-8d44-3bcbbd32cf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:34.541534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:34.544305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 408/840] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:38:34.575480 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a229c-064d-418c-bd22-6b56eb2c42a1 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:34.583587 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 433/841] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:38:34.594636 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:34.606798 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b17e6-3ee6-41d7-8d44-3bcbbd32cf3a None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:34.693204 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a229c-064d-418c-bd22-6b56eb2c42a1 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:34.730010 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a3f2e-5cef-4e20-84bd-c2e22dbdc7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:34.731676 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a3f2e-5cef-4e20-84bd-c2e22dbdc7e5 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:34.732167 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a3f2e-5cef-4e20-84bd-c2e22dbdc7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:34.732541 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a3f2e-5cef-4e20-84bd-c2e22dbdc7e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:34.739390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b17e6-3ee6-41d7-8d44-3bcbbd32cf3a None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:34.743737 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a3f2e-5cef-4e20-84bd-c2e22dbdc7e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:38:34.752077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-544a3f2e-5cef-4e20-84bd-c2e22dbdc7e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:34.752077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:34.752077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:34.752077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:34.752077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:34.752077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:34.752077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:34.752077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:34.752077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:34.752077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:34.752077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:34.752077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:34.752077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:38:34.752077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:38:34.752077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:38:34.752077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:38:34.753021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:38:34.753021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:38:34.753021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:38:34.753021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:38:34.753021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:34.753021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:34.753021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:34.753021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:34.753021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:34.753021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:34.753021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:34.753021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:34.753021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:34.753021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:34.753021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:34.753021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:34.753841 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:34.753841 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:34.753841 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:34.753841 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:34.753841 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:38:34.753841 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:38:34.753841 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:38:34.753841 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:38:34.753841 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:38:34.753841 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:38:34.753841 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:38:34.753841 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:34.753841 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 409/842] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 23 15:38:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:38:34.759881 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a3f2e-5cef-4e20-84bd-c2e22dbdc7e5 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:34.789570 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4e4ad-3e17-4641-96cf-c79399209b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:34.790492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4e4ad-3e17-4641-96cf-c79399209b75 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:34.790785 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4e4ad-3e17-4641-96cf-c79399209b75 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:34.791068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4e4ad-3e17-4641-96cf-c79399209b75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:34.802356 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc4e4ad-3e17-4641-96cf-c79399209b75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:38:34.811964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-6bc4e4ad-3e17-4641-96cf-c79399209b75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:38:34.811964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:34.811964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:34.811964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:34.811964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:34.811964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:34.811964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:34.811964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:34.811964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:34.811964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:34.811964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:34.811964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:34.811964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:38:34.811964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:38:34.811964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:38:34.811964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:38:34.813008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:38:34.813008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:38:34.813008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:38:34.813008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:38:34.813008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:34.813008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:34.813008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:34.813008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:34.813008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:34.813008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:34.813008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:34.813008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:34.813008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:34.813008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:34.813008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:34.813008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:34.813901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:34.813901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:34.813901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:34.813901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:34.813901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:38:34.813901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:38:34.813901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:38:34.813901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:38:34.813901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:38:34.813901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:38:34.813901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:38:34.813901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:34.818076 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 434/843] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:38:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:34.818936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4e4ad-3e17-4641-96cf-c79399209b75 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:34.849198 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:34.874409 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:34.916243 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a3f2e-5cef-4e20-84bd-c2e22dbdc7e5 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:34.932177 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4e4ad-3e17-4641-96cf-c79399209b75 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:34.968678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caac50f-df76-4efb-b09a-6e62357d4ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:34.969375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caac50f-df76-4efb-b09a-6e62357d4ef6 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:34.969657 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caac50f-df76-4efb-b09a-6e62357d4ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:34.969974 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caac50f-df76-4efb-b09a-6e62357d4ef6 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:34.970305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928e065-c6f0-4c5f-b3e2-90e0ea352567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:34.970732 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caac50f-df76-4efb-b09a-6e62357d4ef6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:34.971037 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caac50f-df76-4efb-b09a-6e62357d4ef6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:34.971773 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928e065-c6f0-4c5f-b3e2-90e0ea352567 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:34.972315 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928e065-c6f0-4c5f-b3e2-90e0ea352567 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:34.972441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caac50f-df76-4efb-b09a-6e62357d4ef6 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:34.972918 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928e065-c6f0-4c5f-b3e2-90e0ea352567 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:34.975377 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928e065-c6f0-4c5f-b3e2-90e0ea352567 None admin] RBAC: Adding query filter params (name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:34.975954 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928e065-c6f0-4c5f-b3e2-90e0ea352567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:34.977650 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928e065-c6f0-4c5f-b3e2-90e0ea352567 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:34.992618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 435/845] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:38:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:34.992618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caac50f-df76-4efb-b09a-6e62357d4ef6 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:34.993274 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 410/845] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 23 15:38:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:34.994726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928e065-c6f0-4c5f-b3e2-90e0ea352567 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:35.106880 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:35.118840 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caac50f-df76-4efb-b09a-6e62357d4ef6 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:35.120784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928e065-c6f0-4c5f-b3e2-90e0ea352567 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:35.159173 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af8ada-3042-4557-bfb0-ba8d6e4f61e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:35.160072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af8ada-3042-4557-bfb0-ba8d6e4f61e9 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:35.160430 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af8ada-3042-4557-bfb0-ba8d6e4f61e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:35.160739 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af8ada-3042-4557-bfb0-ba8d6e4f61e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:35.161157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd22b66-6cd0-47d5-801c-00f70f44a8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:35.169256 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:35.171085 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd22b66-6cd0-47d5-801c-00f70f44a8ec None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:35.171608 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd22b66-6cd0-47d5-801c-00f70f44a8ec None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:35.172114 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd22b66-6cd0-47d5-801c-00f70f44a8ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:35.178723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af8ada-3042-4557-bfb0-ba8d6e4f61e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:35.180220 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2af8ada-3042-4557-bfb0-ba8d6e4f61e9 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:35.187810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd22b66-6cd0-47d5-801c-00f70f44a8ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:35.190160 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd22b66-6cd0-47d5-801c-00f70f44a8ec None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:35.200801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-f2af8ada-3042-4557-bfb0-ba8d6e4f61e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:35.200801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:35.200801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:35.200801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:35.200801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:35.200801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:35.200801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:35.200801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:35.200801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:35.200801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:35.200801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:35.200801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:35.200801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:35.200801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:35.200801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:35.201682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:35.201682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:35.201682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:35.201682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:35.201682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:35.201682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:35.201682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:35.201682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:35.201682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:35.201682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:35.201682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:35.201682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:35.201682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:35.201682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:35.201682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:35.201682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:35.201682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:35.202576 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:35.202576 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:35.202576 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:35.202576 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:35.206776 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 411/846] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:35.207628 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af8ada-3042-4557-bfb0-ba8d6e4f61e9 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:35.212749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-1dd22b66-6cd0-47d5-801c-00f70f44a8ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:35.212749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:35.212749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:35.212749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:35.212749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:35.212749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:35.212749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:35.212749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:35.212749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:35.212749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:35.212749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:35.212749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:35.212749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:35.212749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:35.212749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:35.213639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:35.213639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:35.213639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:35.213639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:35.213639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:35.213639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:35.213639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:35.213639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:35.213639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:35.213639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:35.213639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:35.213639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:35.213639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:35.213639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:35.213639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:35.213639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:35.213639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:35.214534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:35.214534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:35.214534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:35.214534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:35.216986 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 436/847] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:35.222294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd22b66-6cd0-47d5-801c-00f70f44a8ec None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:35.314831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af8ada-3042-4557-bfb0-ba8d6e4f61e9 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:35.332204 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd22b66-6cd0-47d5-801c-00f70f44a8ec None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:35.349294 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7d720-599c-489a-b079-13075f9efda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:35.350008 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7d720-599c-489a-b079-13075f9efda3 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:35.350292 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7d720-599c-489a-b079-13075f9efda3 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:35.350566 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7d720-599c-489a-b079-13075f9efda3 None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:35.351288 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7d720-599c-489a-b079-13075f9efda3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:35.351592 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7d720-599c-489a-b079-13075f9efda3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:35.352938 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7d720-599c-489a-b079-13075f9efda3 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:35.370166 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 412/848] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:35.371791 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7d720-599c-489a-b079-13075f9efda3 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:35.374479 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821dc33-f3b4-4431-9ef3-cc9ed7a07453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:35.375482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821dc33-f3b4-4431-9ef3-cc9ed7a07453 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:35.375965 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821dc33-f3b4-4431-9ef3-cc9ed7a07453 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:35.376438 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821dc33-f3b4-4431-9ef3-cc9ed7a07453 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:35.377400 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821dc33-f3b4-4431-9ef3-cc9ed7a07453 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:35.378051 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821dc33-f3b4-4431-9ef3-cc9ed7a07453 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:35.379614 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821dc33-f3b4-4431-9ef3-cc9ed7a07453 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:35.393960 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 437/849] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:35.398975 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821dc33-f3b4-4431-9ef3-cc9ed7a07453 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:35.403216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:35.433947 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:35.509562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7d720-599c-489a-b079-13075f9efda3 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:35.525547 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821dc33-f3b4-4431-9ef3-cc9ed7a07453 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:35.567043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f77986-e9dc-4dcb-8e72-32a5141e0ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:35.567726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c994ed-95da-41ed-97fd-77ec642021e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:35.568528 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f77986-e9dc-4dcb-8e72-32a5141e0ddf None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:35.568742 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c994ed-95da-41ed-97fd-77ec642021e0 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:35.569100 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f77986-e9dc-4dcb-8e72-32a5141e0ddf None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:35.569209 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c994ed-95da-41ed-97fd-77ec642021e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:35.569541 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c994ed-95da-41ed-97fd-77ec642021e0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:35.569766 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f77986-e9dc-4dcb-8e72-32a5141e0ddf None admin] PATH_INFO: `/v3/users/swift` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:35.578618 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c994ed-95da-41ed-97fd-77ec642021e0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:35.578856 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f77986-e9dc-4dcb-8e72-32a5141e0ddf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:35.580287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c994ed-95da-41ed-97fd-77ec642021e0 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:35.580615 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f77986-e9dc-4dcb-8e72-32a5141e0ddf None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:35.596678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-d4f77986-e9dc-4dcb-8e72-32a5141e0ddf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 15:38:35.596678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:35.596678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:35.596678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:35.596678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:35.596678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:35.596678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:35.596678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:35.596678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:35.596678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:35.596678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:35.596678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:35.596678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:38:35.596678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:38:35.596678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:38:35.596678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:38:35.597811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:35.597811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:35.597811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:35.597811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:35.597811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:35.597811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:35.597811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:35.597811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:35.597811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:35.597811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:35.597811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:35.597811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:35.597811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:35.597811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:35.597811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:35.597811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:35.597811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:35.597811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:35.598744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:35.598744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:35.598744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:38:35.598744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:38:35.598744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:38:35.598744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:38:35.598744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:38:35.598744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:38:35.598744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 15:38:35.598744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:35.599264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-92c994ed-95da-41ed-97fd-77ec642021e0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 15:38:35.599264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:35.599264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:35.599264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:35.599264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:35.599264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:35.599264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:35.599264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:35.599264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:35.599264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:35.599264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:35.599264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:35.599264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:38:35.599264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:38:35.599264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:38:35.599264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:38:35.600157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:35.600157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:35.600157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:35.600157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:35.600157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:35.600157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:35.600157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:35.600157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:35.600157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:35.600157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:35.600157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:35.600157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:35.600157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:35.600157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:35.600157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:35.600157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:35.600157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:35.600157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:35.601617 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:35.601617 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:35.601617 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:38:35.601617 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:38:35.601617 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:38:35.601617 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:38:35.601617 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:38:35.601617 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:38:35.601617 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 15:38:35.601617 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:35.603923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 413/850] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jun 23 15:38:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:35.608829 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c994ed-95da-41ed-97fd-77ec642021e0 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:35.609285 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 438/851] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:38:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:35.610598 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f77986-e9dc-4dcb-8e72-32a5141e0ddf None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:35.675165 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:35.716987 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c994ed-95da-41ed-97fd-77ec642021e0 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:35.717492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f77986-e9dc-4dcb-8e72-32a5141e0ddf None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:35.726085 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:35.753886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2590e5-ac83-4e2f-9764-c989c7848fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:35.755048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2590e5-ac83-4e2f-9764-c989c7848fc9 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:35.755477 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2590e5-ac83-4e2f-9764-c989c7848fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:35.755994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2590e5-ac83-4e2f-9764-c989c7848fc9 None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:35.756414 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae651e-fee4-4012-94f4-334cd579d975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:35.757170 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2590e5-ac83-4e2f-9764-c989c7848fc9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:35.757297 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae651e-fee4-4012-94f4-334cd579d975 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:35.757637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae651e-fee4-4012-94f4-334cd579d975 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:35.757913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2590e5-ac83-4e2f-9764-c989c7848fc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:35.758131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae651e-fee4-4012-94f4-334cd579d975 None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:35.759075 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae651e-fee4-4012-94f4-334cd579d975 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:35.759476 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae651e-fee4-4012-94f4-334cd579d975 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:35.759964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2590e5-ac83-4e2f-9764-c989c7848fc9 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:35.761084 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae651e-fee4-4012-94f4-334cd579d975 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:35.786312 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 439/852] 10.222.0.15 () {56 vars in 1135 bytes} [Thu Jun 23 15:38:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:35.787939 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2590e5-ac83-4e2f-9764-c989c7848fc9 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:35.903486 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 414/853] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Jun 23 15:38:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:35.904805 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae651e-fee4-4012-94f4-334cd579d975 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:35.906967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2590e5-ac83-4e2f-9764-c989c7848fc9 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:35.928316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:35.944672 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278569d-a838-4a0a-947a-98528ecbeeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:35.945577 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278569d-a838-4a0a-947a-98528ecbeeba None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:35.946050 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278569d-a838-4a0a-947a-98528ecbeeba None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:35.946498 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278569d-a838-4a0a-947a-98528ecbeeba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:36.018029 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae651e-fee4-4012-94f4-334cd579d975 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:36.022815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278569d-a838-4a0a-947a-98528ecbeeba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:36.024452 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278569d-a838-4a0a-947a-98528ecbeeba None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:36.073066 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfdc32-b122-4bd2-8bc3-11638d3625c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:36.073930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfdc32-b122-4bd2-8bc3-11638d3625c4 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:36.074351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfdc32-b122-4bd2-8bc3-11638d3625c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:36.074737 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfdc32-b122-4bd2-8bc3-11638d3625c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:36.131465 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:36.166556 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 440/854] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:38:35 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 15:38:36.166556 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58faf6b-002e-4899-a495-89c78baee278 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:36.166556 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58faf6b-002e-4899-a495-89c78baee278 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:36.166556 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58faf6b-002e-4899-a495-89c78baee278 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:36.169988 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 441/855] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:36.172214 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6820d8-c9cc-4f40-9917-eb6a2f594e37 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:36.172521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6820d8-c9cc-4f40-9917-eb6a2f594e37 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:36.172809 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6820d8-c9cc-4f40-9917-eb6a2f594e37 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:36.174435 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 442/856] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:36.175169 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6820d8-c9cc-4f40-9917-eb6a2f594e37 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:36.181050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcfdc32-b122-4bd2-8bc3-11638d3625c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:36.182651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcfdc32-b122-4bd2-8bc3-11638d3625c4 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:36.198105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:36.296091 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 415/857] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:38:35 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 15:38:36.297146 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6820d8-c9cc-4f40-9917-eb6a2f594e37 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:36.297402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53204391-aa29-4c32-9937-e9df63d174c2 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:36.297702 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53204391-aa29-4c32-9937-e9df63d174c2 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:36.298027 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53204391-aa29-4c32-9937-e9df63d174c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:36.316444 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-53204391-aa29-4c32-9937-e9df63d174c2 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:36.317655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-53204391-aa29-4c32-9937-e9df63d174c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:36.337530 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c7073-3312-4e5f-97d4-ff89622dc600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:36.338383 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c7073-3312-4e5f-97d4-ff89622dc600 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:36.338665 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c7073-3312-4e5f-97d4-ff89622dc600 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:36.338940 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c7073-3312-4e5f-97d4-ff89622dc600 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:36.350485 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c7073-3312-4e5f-97d4-ff89622dc600 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:36.352033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c7073-3312-4e5f-97d4-ff89622dc600 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:36.371269 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-d76c7073-3312-4e5f-97d4-ff89622dc600 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:36.371269 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:36.371269 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:36.371269 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:36.371269 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:36.371269 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:36.371269 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:36.371269 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:36.371269 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:36.371269 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:36.371269 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:36.371269 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:36.371269 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:36.371269 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:36.371269 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:36.372210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:36.372210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:36.372210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:36.372210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:36.372210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:36.372210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:36.372210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:36.372210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:36.372210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:36.372210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:36.372210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:36.372210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:36.372210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:36.372210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:36.372210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:36.372210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:36.372210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:36.373091 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:36.373091 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:36.373091 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:36.373091 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:36.373091 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 443/858] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:36.373719 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aac2b3-688c-41b9-bb47-b41540368d56 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:36.374047 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aac2b3-688c-41b9-bb47-b41540368d56 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:36.374327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aac2b3-688c-41b9-bb47-b41540368d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:36.390472 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:36.391317 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-91aac2b3-688c-41b9-bb47-b41540368d56 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:36.392367 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-91aac2b3-688c-41b9-bb47-b41540368d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:36.399412 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 416/859] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:38:36.400239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53204391-aa29-4c32-9937-e9df63d174c2 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:36.470574 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 444/860] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:38:36.471414 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aac2b3-688c-41b9-bb47-b41540368d56 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:36.473706 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:36.501246 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53204391-aa29-4c32-9937-e9df63d174c2 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:36.534537 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f0855-f01b-4026-9491-c9ff5f2a1e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:36.535329 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f0855-f01b-4026-9491-c9ff5f2a1e3f None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:36.535610 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f0855-f01b-4026-9491-c9ff5f2a1e3f None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:36.535885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f0855-f01b-4026-9491-c9ff5f2a1e3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:36.549980 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f0855-f01b-4026-9491-c9ff5f2a1e3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:36.551360 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f0855-f01b-4026-9491-c9ff5f2a1e3f None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:36.569959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-ae9f0855-f01b-4026-9491-c9ff5f2a1e3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:36.569959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:36.569959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:36.569959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:36.569959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:36.569959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:36.569959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:36.569959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:36.569959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:36.569959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:36.569959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:36.569959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:36.569959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:36.569959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:36.569959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:36.571457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:36.571457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:36.571457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:36.571457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:36.571457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:36.571457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:36.571457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:36.571457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:36.571457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:36.571457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:36.571457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:36.571457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:36.571457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:36.571457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:36.571457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:36.571457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:36.571457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:36.572356 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:36.572356 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:36.572356 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:36.572356 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:36.572356 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 417/861] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:36.572356 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f0855-f01b-4026-9491-c9ff5f2a1e3f None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:36.588877 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aac2b3-688c-41b9-bb47-b41540368d56 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:36.621784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:36.622982 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d79f9-37cf-485b-8b78-f0aca4ecbd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:36.623660 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d79f9-37cf-485b-8b78-f0aca4ecbd8e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:36.623946 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d79f9-37cf-485b-8b78-f0aca4ecbd8e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:36.624225 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d79f9-37cf-485b-8b78-f0aca4ecbd8e None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:36.624958 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d79f9-37cf-485b-8b78-f0aca4ecbd8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:36.625266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d79f9-37cf-485b-8b78-f0aca4ecbd8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:36.626685 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d79f9-37cf-485b-8b78-f0aca4ecbd8e None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:36.638857 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 445/862] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:36.639677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d79f9-37cf-485b-8b78-f0aca4ecbd8e None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:36.679706 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f0855-f01b-4026-9491-c9ff5f2a1e3f None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:36.701076 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:36.713483 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd755eae-7b5a-4a78-bbb4-5985e4ff7820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:36.714329 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd755eae-7b5a-4a78-bbb4-5985e4ff7820 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:36.715284 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd755eae-7b5a-4a78-bbb4-5985e4ff7820 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:36.715584 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd755eae-7b5a-4a78-bbb4-5985e4ff7820 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:36.716235 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd755eae-7b5a-4a78-bbb4-5985e4ff7820 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:36.717604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd755eae-7b5a-4a78-bbb4-5985e4ff7820 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:36.731898 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-dd755eae-7b5a-4a78-bbb4-5985e4ff7820 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 15:38:36.731898 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:36.731898 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:38:36.731898 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:38:36.731898 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:38:36.731898 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:38:36.731898 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:38:36.731898 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:36.731898 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 15:38:36.731898 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:36.731898 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:38:36.731898 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:36.731898 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:36.731898 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:36.731898 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:36.731898 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:36.733129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:36.733129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:36.733129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:36.733129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:36.733129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:36.733129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:36.733129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:36.733129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:38:36.733129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:38:36.733129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:38:36.733129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:38:36.733129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:36.733129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:36.733129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:36.733129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:36.733129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:36.734721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:36.734721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:36.734721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:36.734721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:36.734721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:36.734721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:36.734721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:36.734721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:36.734721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:36.734721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:36.734721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:36.734721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:38:36.734721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:36.734721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 15:38:36.734721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:36.734721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 418/863] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Jun 23 15:38:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:36.735761 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd755eae-7b5a-4a78-bbb4-5985e4ff7820 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:36.747224 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d79f9-37cf-485b-8b78-f0aca4ecbd8e None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:36.782140 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431057fd-3bdc-4e19-b527-33ae5a2f100b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:36.782810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431057fd-3bdc-4e19-b527-33ae5a2f100b None admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:36.783089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431057fd-3bdc-4e19-b527-33ae5a2f100b None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:36.783366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431057fd-3bdc-4e19-b527-33ae5a2f100b None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:36.784085 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431057fd-3bdc-4e19-b527-33ae5a2f100b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:36.785447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431057fd-3bdc-4e19-b527-33ae5a2f100b None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:36.798772 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 446/864] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 23 15:38:36 2022] POST /identity/v3/services => generated 251 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:38:36.799587 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431057fd-3bdc-4e19-b527-33ae5a2f100b None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:36.857755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd755eae-7b5a-4a78-bbb4-5985e4ff7820 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:36.870461 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:36.908350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5624d6-f0dd-457a-8a7f-1823fa20f797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:36.909017 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5624d6-f0dd-457a-8a7f-1823fa20f797 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:36.909303 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5624d6-f0dd-457a-8a7f-1823fa20f797 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:36.909682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5624d6-f0dd-457a-8a7f-1823fa20f797 None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:36.910573 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5624d6-f0dd-457a-8a7f-1823fa20f797 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:36.910886 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5624d6-f0dd-457a-8a7f-1823fa20f797 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:36.912431 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5624d6-f0dd-457a-8a7f-1823fa20f797 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:36.914735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431057fd-3bdc-4e19-b527-33ae5a2f100b None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:36.931135 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 419/865] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:36.931135 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5624d6-f0dd-457a-8a7f-1823fa20f797 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:36.946765 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:36.963085 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a3497-9328-4339-9454-d94ddb534a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:36.964119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a3497-9328-4339-9454-d94ddb534a63 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:36.964505 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a3497-9328-4339-9454-d94ddb534a63 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:36.965257 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a3497-9328-4339-9454-d94ddb534a63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:36.974532 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a3497-9328-4339-9454-d94ddb534a63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:36.974802 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a3497-9328-4339-9454-d94ddb534a63 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:36.997391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-f86a3497-9328-4339-9454-d94ddb534a63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:36.997391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:36.997391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:36.997391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:36.997391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:36.997391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:36.997391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:36.997391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:36.997391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:36.997391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:36.997391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:36.997391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:36.997391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:36.997391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:36.997391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:36.998822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:36.998822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:36.998822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:36.998822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:36.998822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:36.998822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:36.998822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:36.998822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:36.998822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:36.998822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:36.998822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:36.998822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:36.998822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:36.998822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:36.998822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:36.998822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:36.998822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:36.999898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:36.999898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:36.999898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:36.999898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:36.999898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:36.999898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:36.999898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:36.999898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:36.999898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 447/866] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:36.999898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a3497-9328-4339-9454-d94ddb534a63 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:37.061806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5624d6-f0dd-457a-8a7f-1823fa20f797 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:37.099317 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634926c0-20c7-4f8a-96dc-9dd47a0ee9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:37.099996 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634926c0-20c7-4f8a-96dc-9dd47a0ee9d9 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:37.100269 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634926c0-20c7-4f8a-96dc-9dd47a0ee9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:37.100547 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634926c0-20c7-4f8a-96dc-9dd47a0ee9d9 None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:37.101257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634926c0-20c7-4f8a-96dc-9dd47a0ee9d9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:37.101566 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634926c0-20c7-4f8a-96dc-9dd47a0ee9d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:37.103213 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634926c0-20c7-4f8a-96dc-9dd47a0ee9d9 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:37.113267 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 420/867] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jun 23 15:38:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:37.113267 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634926c0-20c7-4f8a-96dc-9dd47a0ee9d9 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:37.118515 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a3497-9328-4339-9454-d94ddb534a63 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:37.142735 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:37.157527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9491a24-3e2e-4c65-94e1-aeaf28c8f34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:37.158421 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9491a24-3e2e-4c65-94e1-aeaf28c8f34a None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:37.158705 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9491a24-3e2e-4c65-94e1-aeaf28c8f34a None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:37.159011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9491a24-3e2e-4c65-94e1-aeaf28c8f34a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:37.166256 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9491a24-3e2e-4c65-94e1-aeaf28c8f34a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:37.167718 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9491a24-3e2e-4c65-94e1-aeaf28c8f34a None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:37.184350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-c9491a24-3e2e-4c65-94e1-aeaf28c8f34a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:37.184350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:37.184350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:37.184350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:37.184350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:37.184350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:37.184350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:37.184350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:37.184350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:37.184350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:37.184350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:37.184350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:37.184350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:37.184350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:37.184350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:37.185386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:37.185386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:37.185386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:37.185386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:37.185386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:37.185386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:37.185386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:37.185386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:37.185386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:37.185386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:37.185386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:37.185386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:37.185386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:37.185386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:37.185386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:37.185386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:37.185386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:37.187048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:37.187048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:37.187048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:37.187048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:37.187048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:37.187048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:37.187048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:37.187048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:37.187048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 448/868] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:37.187048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9491a24-3e2e-4c65-94e1-aeaf28c8f34a None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:37.227170 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634926c0-20c7-4f8a-96dc-9dd47a0ee9d9 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:37.244908 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:37.262877 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498aee5d-0ed6-4bff-b9b0-31e986c91baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:37.263675 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498aee5d-0ed6-4bff-b9b0-31e986c91baf None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:37.264027 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498aee5d-0ed6-4bff-b9b0-31e986c91baf None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:37.264371 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498aee5d-0ed6-4bff-b9b0-31e986c91baf None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:37.265237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498aee5d-0ed6-4bff-b9b0-31e986c91baf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:37.265613 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498aee5d-0ed6-4bff-b9b0-31e986c91baf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:37.267156 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498aee5d-0ed6-4bff-b9b0-31e986c91baf None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:37.280156 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 421/869] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:37.285894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498aee5d-0ed6-4bff-b9b0-31e986c91baf None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:37.306807 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9491a24-3e2e-4c65-94e1-aeaf28c8f34a None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:37.342933 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f9f20-4be6-46c6-be2b-c30aed09ecb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:37.343610 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f9f20-4be6-46c6-be2b-c30aed09ecb8 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:37.343897 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f9f20-4be6-46c6-be2b-c30aed09ecb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:37.344176 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f9f20-4be6-46c6-be2b-c30aed09ecb8 None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:37.344891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f9f20-4be6-46c6-be2b-c30aed09ecb8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:37.345202 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f9f20-4be6-46c6-be2b-c30aed09ecb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:37.346594 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f9f20-4be6-46c6-be2b-c30aed09ecb8 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:37.351270 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 449/870] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jun 23 15:38:37 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:37.352060 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f9f20-4be6-46c6-be2b-c30aed09ecb8 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:37.416107 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:37.428314 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498aee5d-0ed6-4bff-b9b0-31e986c91baf None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:37.473459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f9f20-4be6-46c6-be2b-c30aed09ecb8 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:37.473666 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a50e1c-9a1b-4469-aef6-4079ee17de33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:37.474242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a50e1c-9a1b-4469-aef6-4079ee17de33 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:37.474577 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a50e1c-9a1b-4469-aef6-4079ee17de33 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:37.474860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a50e1c-9a1b-4469-aef6-4079ee17de33 None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:37.475674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a50e1c-9a1b-4469-aef6-4079ee17de33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:37.475988 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a50e1c-9a1b-4469-aef6-4079ee17de33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:37.477576 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a50e1c-9a1b-4469-aef6-4079ee17de33 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:37.483550 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:37.497522 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 422/871] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:37.499565 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a50e1c-9a1b-4469-aef6-4079ee17de33 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:37.517273 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797452c7-e90e-4e58-ad3d-f8137b379dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:37.518164 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797452c7-e90e-4e58-ad3d-f8137b379dbc None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:37.518555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797452c7-e90e-4e58-ad3d-f8137b379dbc None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:37.519159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797452c7-e90e-4e58-ad3d-f8137b379dbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:37.520137 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797452c7-e90e-4e58-ad3d-f8137b379dbc None admin] RBAC: Adding query filter params (role.id=abdc0e0957534149b3653eaa33cbd054, scope.project.id=ff90b874f5b84d28a2752bc95419ad95, user.id=5824ee17e276483faf20db88a93545f3) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:37.520562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797452c7-e90e-4e58-ad3d-f8137b379dbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:37.522708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797452c7-e90e-4e58-ad3d-f8137b379dbc None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:37.531733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 450/872] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:38:37 2022] GET /identity/v3/role_assignments?user.id=5824ee17e276483faf20db88a93545f3&scope.project.id=ff90b874f5b84d28a2752bc95419ad95&role.id=abdc0e0957534149b3653eaa33cbd054 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:37.634803 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a50e1c-9a1b-4469-aef6-4079ee17de33 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:37.673898 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb309d8c-4e40-4c81-a8a4-0bdfb3138a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:37.674515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb309d8c-4e40-4c81-a8a4-0bdfb3138a21 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:37.674809 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb309d8c-4e40-4c81-a8a4-0bdfb3138a21 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:37.675089 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb309d8c-4e40-4c81-a8a4-0bdfb3138a21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:37.675943 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb309d8c-4e40-4c81-a8a4-0bdfb3138a21 None admin] RBAC: Adding query filter params (role.id=e004305755a2468aa60ab6632d39207a, scope.project.id=ff90b874f5b84d28a2752bc95419ad95, user.id=dbf2c12174e94e2db9be178973183ced) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:37.676260 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb309d8c-4e40-4c81-a8a4-0bdfb3138a21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:37.677727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb309d8c-4e40-4c81-a8a4-0bdfb3138a21 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:37.685350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 423/873] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:38:37 2022] GET /identity/v3/role_assignments?user.id=dbf2c12174e94e2db9be178973183ced&scope.project.id=ff90b874f5b84d28a2752bc95419ad95&role.id=e004305755a2468aa60ab6632d39207a => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:38.908509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cab587-6a48-4019-b637-53417c14770e None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:38.909003 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cab587-6a48-4019-b637-53417c14770e None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:38.909003 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cab587-6a48-4019-b637-53417c14770e None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:38.910615 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 451/874] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:38.915914 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fce51-85cd-4ab4-ab48-3fd8652b1b41 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:38.916352 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fce51-85cd-4ab4-ab48-3fd8652b1b41 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:38.916437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fce51-85cd-4ab4-ab48-3fd8652b1b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:38.933102 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-e51fce51-85cd-4ab4-ab48-3fd8652b1b41 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:38.934837 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-e51fce51-85cd-4ab4-ab48-3fd8652b1b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:38.944235 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:39.008308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 424/875] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:38 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 15:38:39.036041 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cab587-6a48-4019-b637-53417c14770e None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:39.141080 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cab587-6a48-4019-b637-53417c14770e None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:39.176087 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81420508-af76-4e4e-ba37-b57d9a674c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:39.176808 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81420508-af76-4e4e-ba37-b57d9a674c23 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:39.177090 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81420508-af76-4e4e-ba37-b57d9a674c23 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:39.177366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81420508-af76-4e4e-ba37-b57d9a674c23 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:39.178052 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81420508-af76-4e4e-ba37-b57d9a674c23 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:39.179427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81420508-af76-4e4e-ba37-b57d9a674c23 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:39.195447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-81420508-af76-4e4e-ba37-b57d9a674c23 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 15:38:39.195447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:39.195447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:38:39.195447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:38:39.195447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:38:39.195447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:38:39.195447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:38:39.195447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:39.195447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 15:38:39.195447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:39.195447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:38:39.195447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:39.195447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:39.195447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:39.195447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:39.195447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:39.195447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:39.196508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:39.196508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:39.196508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:39.196508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:39.196508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:39.196508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:39.196508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:38:39.196508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:38:39.196508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:38:39.196508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:38:39.196508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:39.196508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:39.196508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:39.196508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:39.196508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:39.196508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:39.197327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:39.197327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:39.197327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:39.197327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:39.197327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:39.197327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:39.197327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:39.197327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:39.197327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:39.197327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:39.197327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:38:39.197327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:39.197327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 15:38:39.197327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:39.201978 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 452/876] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 23 15:38:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:39.203748 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fce51-85cd-4ab4-ab48-3fd8652b1b41 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:39.307623 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fce51-85cd-4ab4-ab48-3fd8652b1b41 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:39.348914 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a428d75-a0e6-497a-a1ae-0f743375fb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:39.349969 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a428d75-a0e6-497a-a1ae-0f743375fb48 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:39.350462 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a428d75-a0e6-497a-a1ae-0f743375fb48 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:39.350927 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a428d75-a0e6-497a-a1ae-0f743375fb48 None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:39.351824 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a428d75-a0e6-497a-a1ae-0f743375fb48 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:39.352346 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a428d75-a0e6-497a-a1ae-0f743375fb48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:39.353918 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a428d75-a0e6-497a-a1ae-0f743375fb48 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:39.359414 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 425/877] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 23 15:38:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:39.365970 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81420508-af76-4e4e-ba37-b57d9a674c23 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:39.410448 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:39.471410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81420508-af76-4e4e-ba37-b57d9a674c23 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:39.505684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e053ad0-d7cd-49e7-bb3e-2aaeced437a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:39.506384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e053ad0-d7cd-49e7-bb3e-2aaeced437a3 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:39.506671 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e053ad0-d7cd-49e7-bb3e-2aaeced437a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:39.506952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e053ad0-d7cd-49e7-bb3e-2aaeced437a3 None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:39.507668 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e053ad0-d7cd-49e7-bb3e-2aaeced437a3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:39.508045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e053ad0-d7cd-49e7-bb3e-2aaeced437a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:39.509466 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e053ad0-d7cd-49e7-bb3e-2aaeced437a3 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:39.520109 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 453/878] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 23 15:38:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:39.521557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a428d75-a0e6-497a-a1ae-0f743375fb48 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:39.531106 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7dc4d-4390-4393-80c5-9b2d5a9567fe None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:39.531735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7dc4d-4390-4393-80c5-9b2d5a9567fe None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:39.532007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7dc4d-4390-4393-80c5-9b2d5a9567fe None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:39.533649 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 454/879] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:38:39.534406 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:39.539680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31a630-5082-4ac4-8352-c079df43205c None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:39.539680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31a630-5082-4ac4-8352-c079df43205c None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:39.539680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31a630-5082-4ac4-8352-c079df43205c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:39.557985 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-1b31a630-5082-4ac4-8352-c079df43205c None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:39.559252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-1b31a630-5082-4ac4-8352-c079df43205c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:39.633019 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 455/880] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:39 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 15:38:39.649560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f916b-bd03-41cd-932d-d1c110f66f7d None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:39.649884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f916b-bd03-41cd-932d-d1c110f66f7d None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:39.650169 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f916b-bd03-41cd-932d-d1c110f66f7d None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:39.651666 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 456/881] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:38:39.655112 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f916b-bd03-41cd-932d-d1c110f66f7d None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:39.664982 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a428d75-a0e6-497a-a1ae-0f743375fb48 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:39.686007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:39.702603 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f918922-b4e8-4697-8d0e-ac2cd8c03444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:39.703064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f918922-b4e8-4697-8d0e-ac2cd8c03444 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:39.703353 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f918922-b4e8-4697-8d0e-ac2cd8c03444 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:39.703629 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f918922-b4e8-4697-8d0e-ac2cd8c03444 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:39.704412 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f918922-b4e8-4697-8d0e-ac2cd8c03444 None admin] RBAC: Adding query filter params (interface=public, service_id=eda1a9e633bf405c867f1ff99d3780ed, region_id=RegionOne) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:39.704903 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f918922-b4e8-4697-8d0e-ac2cd8c03444 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:39.706107 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f918922-b4e8-4697-8d0e-ac2cd8c03444 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:39.715755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 426/882] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Jun 23 15:38:39 2022] GET /identity/v3/endpoints?service_id=eda1a9e633bf405c867f1ff99d3780ed&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:39.715755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65eb54-92ed-46bf-8787-2c04bddac856 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:39.715755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65eb54-92ed-46bf-8787-2c04bddac856 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:39.715755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65eb54-92ed-46bf-8787-2c04bddac856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:39.730195 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-8e65eb54-92ed-46bf-8787-2c04bddac856 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:39.731297 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-8e65eb54-92ed-46bf-8787-2c04bddac856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:39.774797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f916b-bd03-41cd-932d-d1c110f66f7d None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:39.808939 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 427/883] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:39 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:38:39.809908 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65eb54-92ed-46bf-8787-2c04bddac856 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:39.818127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:39.828385 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162d229-82f1-47c5-8cae-85c8e5825c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:39.829592 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162d229-82f1-47c5-8cae-85c8e5825c6b None admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:39.830544 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162d229-82f1-47c5-8cae-85c8e5825c6b None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:39.831037 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162d229-82f1-47c5-8cae-85c8e5825c6b None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:39.832053 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162d229-82f1-47c5-8cae-85c8e5825c6b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:39.833804 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162d229-82f1-47c5-8cae-85c8e5825c6b None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:39.852034 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 457/884] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 23 15:38:39 2022] POST /identity/v3/services => generated 269 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:38:39.853134 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162d229-82f1-47c5-8cae-85c8e5825c6b None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:39.971272 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65eb54-92ed-46bf-8787-2c04bddac856 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:39.992836 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:40.016376 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162d229-82f1-47c5-8cae-85c8e5825c6b None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:40.016936 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bee615-e2b4-462f-a568-1d94dee626c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:40.017889 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bee615-e2b4-462f-a568-1d94dee626c5 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:40.017889 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bee615-e2b4-462f-a568-1d94dee626c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:40.018175 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bee615-e2b4-462f-a568-1d94dee626c5 None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:40.018851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bee615-e2b4-462f-a568-1d94dee626c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:40.020217 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bee615-e2b4-462f-a568-1d94dee626c5 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:40.035343 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 428/885] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jun 23 15:38:39 2022] GET /identity/v3/services => generated 1268 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:38:40.036954 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f02b4d-ae39-47a6-bcc7-b9e12e9e75cf None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:40.037252 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f02b4d-ae39-47a6-bcc7-b9e12e9e75cf None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:40.037530 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f02b4d-ae39-47a6-bcc7-b9e12e9e75cf None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:40.039134 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 429/886] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:40.045690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9e773-914f-47ed-81fd-90c0372fb4a8 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:40.046061 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9e773-914f-47ed-81fd-90c0372fb4a8 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:40.046295 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9e773-914f-47ed-81fd-90c0372fb4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:40.062486 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db3ef1-0d82-4acc-bda2-1054f2c1eddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:40.063412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db3ef1-0d82-4acc-bda2-1054f2c1eddf None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:40.063700 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db3ef1-0d82-4acc-bda2-1054f2c1eddf None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:40.063974 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db3ef1-0d82-4acc-bda2-1054f2c1eddf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:40.064647 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db3ef1-0d82-4acc-bda2-1054f2c1eddf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:40.066107 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db3ef1-0d82-4acc-bda2-1054f2c1eddf None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:40.066822 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-bbf9e773-914f-47ed-81fd-90c0372fb4a8 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:40.068302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-bbf9e773-914f-47ed-81fd-90c0372fb4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:40.079449 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-a1db3ef1-0d82-4acc-bda2-1054f2c1eddf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 15:38:40.079449 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:40.079449 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:38:40.079449 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:38:40.079449 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:38:40.079449 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:38:40.079449 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:38:40.079449 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:40.079449 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 15:38:40.079449 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:40.079449 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:38:40.079449 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:40.079449 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:40.079449 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:40.079449 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:40.079449 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:40.079449 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:40.080555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:40.080555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:40.080555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:40.080555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:40.080555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:40.080555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:40.080555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:38:40.080555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:38:40.080555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:38:40.080555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:38:40.080555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:40.080555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:40.080555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:40.080555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:40.080555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:40.080555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:40.082566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:40.082566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:40.082566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:40.082566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:40.082566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:40.082566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:40.082566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:40.082566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:40.082566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:40.082566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:40.082566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:38:40.082566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:40.082566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 15:38:40.082566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:40.082566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 458/887] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jun 23 15:38:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:40.087518 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db3ef1-0d82-4acc-bda2-1054f2c1eddf None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:40.146550 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:40.170005 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 430/888] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:38:40.190143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9e773-914f-47ed-81fd-90c0372fb4a8 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:40.226039 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db3ef1-0d82-4acc-bda2-1054f2c1eddf None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:40.264765 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cf9a2-9d94-413f-8dd3-1b7ea25f2646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:40.265785 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cf9a2-9d94-413f-8dd3-1b7ea25f2646 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:40.266358 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cf9a2-9d94-413f-8dd3-1b7ea25f2646 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:40.266857 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cf9a2-9d94-413f-8dd3-1b7ea25f2646 None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:40.267778 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48cf9a2-9d94-413f-8dd3-1b7ea25f2646 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:40.268321 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48cf9a2-9d94-413f-8dd3-1b7ea25f2646 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:40.269923 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48cf9a2-9d94-413f-8dd3-1b7ea25f2646 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:40.275767 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 459/889] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jun 23 15:38:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:40.282943 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cf9a2-9d94-413f-8dd3-1b7ea25f2646 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:40.298723 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:40.322590 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9e773-914f-47ed-81fd-90c0372fb4a8 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:40.373450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c46c49-1983-4dc1-b219-71dfa2b03af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:40.374801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c46c49-1983-4dc1-b219-71dfa2b03af3 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:40.376214 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c46c49-1983-4dc1-b219-71dfa2b03af3 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:40.376333 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c46c49-1983-4dc1-b219-71dfa2b03af3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:40.395934 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c46c49-1983-4dc1-b219-71dfa2b03af3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:38:40.400262 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cf9a2-9d94-413f-8dd3-1b7ea25f2646 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:40.407510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-73c46c49-1983-4dc1-b219-71dfa2b03af3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 15:38:40.407510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:40.407510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:40.407510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:40.407510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:40.407510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:40.407510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:40.407510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:40.407510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:40.407510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:40.407510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:40.407510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:40.407510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:38:40.407510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:38:40.407510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:38:40.407510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:38:40.408488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:38:40.408488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:38:40.408488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:38:40.408488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:38:40.408488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:40.408488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:40.408488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:40.408488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:40.408488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:40.408488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:40.408488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:40.408488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:40.408488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:40.408488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:40.408488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:40.408488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:40.409319 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:40.409319 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:40.409319 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:40.409319 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:40.409319 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:38:40.409319 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:38:40.409319 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:38:40.409319 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:38:40.409319 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:38:40.409319 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:38:40.409319 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 15:38:40.409319 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:40.419512 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 431/890] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Jun 23 15:38:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:38:40.421566 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c46c49-1983-4dc1-b219-71dfa2b03af3 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:40.447414 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513fe80-ea3f-4d15-b8a7-9982d804ce7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:40.448142 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513fe80-ea3f-4d15-b8a7-9982d804ce7d None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:40.448428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513fe80-ea3f-4d15-b8a7-9982d804ce7d None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:40.448705 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513fe80-ea3f-4d15-b8a7-9982d804ce7d None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:40.450042 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513fe80-ea3f-4d15-b8a7-9982d804ce7d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:40.450355 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513fe80-ea3f-4d15-b8a7-9982d804ce7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:40.451817 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513fe80-ea3f-4d15-b8a7-9982d804ce7d None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:40.461993 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 460/891] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jun 23 15:38:40 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:40.494619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:40.551907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c46c49-1983-4dc1-b219-71dfa2b03af3 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:40.590158 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3d3cb-d65d-46c4-a165-442f047e8599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:40.590856 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3d3cb-d65d-46c4-a165-442f047e8599 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:40.591139 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3d3cb-d65d-46c4-a165-442f047e8599 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:40.591418 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3d3cb-d65d-46c4-a165-442f047e8599 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:40.592187 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3d3cb-d65d-46c4-a165-442f047e8599 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:40.592495 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3d3cb-d65d-46c4-a165-442f047e8599 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:40.593896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3d3cb-d65d-46c4-a165-442f047e8599 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:40.608632 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 432/892] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Jun 23 15:38:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:40.610361 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513fe80-ea3f-4d15-b8a7-9982d804ce7d None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:40.697763 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:40.723183 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513fe80-ea3f-4d15-b8a7-9982d804ce7d None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:40.759684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd13e8-76e4-454c-8abb-287c4b49cafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:40.760490 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd13e8-76e4-454c-8abb-287c4b49cafa None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:40.760775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd13e8-76e4-454c-8abb-287c4b49cafa None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:40.761056 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd13e8-76e4-454c-8abb-287c4b49cafa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:40.773248 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd13e8-76e4-454c-8abb-287c4b49cafa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:40.774735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd13e8-76e4-454c-8abb-287c4b49cafa None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:40.793650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-91fd13e8-76e4-454c-8abb-287c4b49cafa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:40.793650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:40.793650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:40.793650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:40.793650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:40.793650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:40.793650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:40.793650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:40.793650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:40.793650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:40.793650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:40.793650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:40.793650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:40.793650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:40.793650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:40.794618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:40.794618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:40.794618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:40.794618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:40.794618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:40.794618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:40.794618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:40.794618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:40.794618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:40.794618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:40.794618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:40.794618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:40.794618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:40.794618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:40.794618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:40.794618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:40.794618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:40.795496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:40.795496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:40.795496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:40.795496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:40.799563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 461/893] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:40.800936 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3d3cb-d65d-46c4-a165-442f047e8599 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:40.911657 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3d3cb-d65d-46c4-a165-442f047e8599 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:40.926542 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:40.949533 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa482cdc-c91e-4a56-88ee-85a730f3ddec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:40.950227 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa482cdc-c91e-4a56-88ee-85a730f3ddec None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:40.950513 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa482cdc-c91e-4a56-88ee-85a730f3ddec None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:40.950788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa482cdc-c91e-4a56-88ee-85a730f3ddec None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:40.951512 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa482cdc-c91e-4a56-88ee-85a730f3ddec None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:40.951820 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa482cdc-c91e-4a56-88ee-85a730f3ddec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:40.953240 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa482cdc-c91e-4a56-88ee-85a730f3ddec None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:40.971113 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 433/894] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:40.972506 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd13e8-76e4-454c-8abb-287c4b49cafa None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:41.083688 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd13e8-76e4-454c-8abb-287c4b49cafa None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:41.111568 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:41.120149 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362350f0-1df4-43a7-907b-09025afcdde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:41.122113 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362350f0-1df4-43a7-907b-09025afcdde2 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:41.122573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362350f0-1df4-43a7-907b-09025afcdde2 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:41.122987 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362350f0-1df4-43a7-907b-09025afcdde2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:41.133127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362350f0-1df4-43a7-907b-09025afcdde2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:41.134641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362350f0-1df4-43a7-907b-09025afcdde2 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:41.150755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-362350f0-1df4-43a7-907b-09025afcdde2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 15:38:41.150755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:41.150755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:41.150755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:41.150755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:41.150755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:41.150755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:41.150755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:41.150755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:41.150755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:41.150755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:41.150755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:41.150755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:38:41.150755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:38:41.150755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:38:41.150755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:38:41.160848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:41.160848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:41.160848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:41.160848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:41.160848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:41.160848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:41.160848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:41.160848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:41.160848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:41.160848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:41.160848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:41.160848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:41.160848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:41.160848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:41.160848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:41.160848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:41.160848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:41.160848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:41.165603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:41.165603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:41.165603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:38:41.165603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:38:41.165603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:38:41.165603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:38:41.165603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:38:41.165603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:38:41.165603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 15:38:41.165603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:41.165603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 462/895] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jun 23 15:38:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:41.166515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa482cdc-c91e-4a56-88ee-85a730f3ddec None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:41.269634 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa482cdc-c91e-4a56-88ee-85a730f3ddec None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:41.307389 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceee4a9-c05a-4d1a-bdd1-18da1a96abe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:41.308075 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceee4a9-c05a-4d1a-bdd1-18da1a96abe1 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:41.308913 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceee4a9-c05a-4d1a-bdd1-18da1a96abe1 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:41.309196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceee4a9-c05a-4d1a-bdd1-18da1a96abe1 None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:41.310104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceee4a9-c05a-4d1a-bdd1-18da1a96abe1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:41.310422 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceee4a9-c05a-4d1a-bdd1-18da1a96abe1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:41.311863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceee4a9-c05a-4d1a-bdd1-18da1a96abe1 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:41.330819 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 434/896] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Jun 23 15:38:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:41.336068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362350f0-1df4-43a7-907b-09025afcdde2 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:41.438713 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362350f0-1df4-43a7-907b-09025afcdde2 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:41.475917 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846149ec-a878-45d2-a396-7887fda93003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:41.476557 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846149ec-a878-45d2-a396-7887fda93003 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:41.476883 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846149ec-a878-45d2-a396-7887fda93003 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:41.477208 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846149ec-a878-45d2-a396-7887fda93003 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:41.536496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:41.549549 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846149ec-a878-45d2-a396-7887fda93003 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:41.551062 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846149ec-a878-45d2-a396-7887fda93003 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:41.651960 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 463/897] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:38:41 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 15:38:41.658415 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceee4a9-c05a-4d1a-bdd1-18da1a96abe1 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:41.693932 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:41.769654 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceee4a9-c05a-4d1a-bdd1-18da1a96abe1 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:41.807548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7064964-e469-4a37-81a2-54e0203f49c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:41.808383 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7064964-e469-4a37-81a2-54e0203f49c0 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:41.808670 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7064964-e469-4a37-81a2-54e0203f49c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:41.808953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7064964-e469-4a37-81a2-54e0203f49c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:41.820234 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7064964-e469-4a37-81a2-54e0203f49c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:41.821702 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7064964-e469-4a37-81a2-54e0203f49c0 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:41.841950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-c7064964-e469-4a37-81a2-54e0203f49c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:41.841950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:41.841950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:41.841950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:41.841950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:41.841950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:41.841950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:41.841950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:41.841950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:41.841950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:41.841950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:41.841950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:41.841950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:41.841950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:41.841950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:41.843018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:41.843018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:41.843018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:41.843018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:41.843018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:41.843018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:41.843018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:41.843018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:41.843018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:41.843018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:41.843018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:41.843018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:41.843018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:41.843018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:41.843018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:41.843018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:41.843018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:41.843908 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:41.843908 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:41.843908 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:41.843908 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:41.843908 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 435/898] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:41.848801 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846149ec-a878-45d2-a396-7887fda93003 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:41.946693 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:41.951680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846149ec-a878-45d2-a396-7887fda93003 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:41.987930 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a433c-9a16-446b-905e-a713ecafc65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:41.988653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a433c-9a16-446b-905e-a713ecafc65f None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:41.988936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a433c-9a16-446b-905e-a713ecafc65f None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:41.989261 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a433c-9a16-446b-905e-a713ecafc65f None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:41.990015 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a433c-9a16-446b-905e-a713ecafc65f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:41.990322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a433c-9a16-446b-905e-a713ecafc65f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:41.991738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a433c-9a16-446b-905e-a713ecafc65f None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:42.003805 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 464/899] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:42.009384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7064964-e469-4a37-81a2-54e0203f49c0 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:42.098964 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:42.115142 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7064964-e469-4a37-81a2-54e0203f49c0 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:42.153888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eb7138-d545-415c-88e2-c2fdb36fb66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:42.154987 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb7138-d545-415c-88e2-c2fdb36fb66f None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:42.155365 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb7138-d545-415c-88e2-c2fdb36fb66f None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:42.155648 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eb7138-d545-415c-88e2-c2fdb36fb66f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:42.164818 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb7138-d545-415c-88e2-c2fdb36fb66f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:42.166814 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eb7138-d545-415c-88e2-c2fdb36fb66f None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:42.181755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-71eb7138-d545-415c-88e2-c2fdb36fb66f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:42.181755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:42.181755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:42.181755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:42.181755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:42.181755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:42.181755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:42.181755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:42.181755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:42.181755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:42.181755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:42.181755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:42.181755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:42.181755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:42.181755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:42.182726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:42.182726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:42.182726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:42.182726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:42.182726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:42.182726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:42.182726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:42.182726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:42.182726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:42.182726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:42.182726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:42.182726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:42.182726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:42.182726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:42.182726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:42.182726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:42.182726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:42.184203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:42.184203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:42.184203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:42.184203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:42.184203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:42.184203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:42.184203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:42.184203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:42.184647 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a41587-ac85-40b7-a5d8-39c20b067b13 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:42.184647 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a41587-ac85-40b7-a5d8-39c20b067b13 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:42.184647 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a41587-ac85-40b7-a5d8-39c20b067b13 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:42.185186 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 436/900] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:42.185267 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 465/901] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:42.189911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5c887-4c16-4c13-bcb5-f3d7daa5b50f None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:42.192839 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5c887-4c16-4c13-bcb5-f3d7daa5b50f None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:42.193034 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a41587-ac85-40b7-a5d8-39c20b067b13 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:42.193196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5c887-4c16-4c13-bcb5-f3d7daa5b50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:42.207688 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-96f5c887-4c16-4c13-bcb5-f3d7daa5b50f None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:42.208864 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-96f5c887-4c16-4c13-bcb5-f3d7daa5b50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:42.281147 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 437/902] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:38:42.296206 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f242c-b292-413d-a0b3-13a775a90759 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:42.296513 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f242c-b292-413d-a0b3-13a775a90759 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:42.296766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f242c-b292-413d-a0b3-13a775a90759 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:42.298399 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 438/903] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:42.303518 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495627bb-eabc-4854-98dc-77226143cdb6 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:42.303803 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495627bb-eabc-4854-98dc-77226143cdb6 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:42.304084 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495627bb-eabc-4854-98dc-77226143cdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:42.315886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a41587-ac85-40b7-a5d8-39c20b067b13 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:42.321935 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-495627bb-eabc-4854-98dc-77226143cdb6 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:42.323116 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-495627bb-eabc-4854-98dc-77226143cdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:42.353393 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6bae6-bff8-4f89-ab74-6620fa448953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:42.354184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6bae6-bff8-4f89-ab74-6620fa448953 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:42.354466 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6bae6-bff8-4f89-ab74-6620fa448953 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:42.354739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6bae6-bff8-4f89-ab74-6620fa448953 None admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:42.356057 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6bae6-bff8-4f89-ab74-6620fa448953 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:42.356372 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6bae6-bff8-4f89-ab74-6620fa448953 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:42.357793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6bae6-bff8-4f89-ab74-6620fa448953 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:42.376127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 466/904] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:42.376127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6bae6-bff8-4f89-ab74-6620fa448953 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:42.384737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:42.401901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 439/905] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 15:38:42.401901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495627bb-eabc-4854-98dc-77226143cdb6 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:42.407292 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:42.498155 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6bae6-bff8-4f89-ab74-6620fa448953 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:42.510761 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495627bb-eabc-4854-98dc-77226143cdb6 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:42.536864 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7288e-2e58-42cb-b8f2-c08c8dc0c772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:42.537674 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7288e-2e58-42cb-b8f2-c08c8dc0c772 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:42.538409 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7288e-2e58-42cb-b8f2-c08c8dc0c772 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:42.538696 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7288e-2e58-42cb-b8f2-c08c8dc0c772 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:42.539380 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7288e-2e58-42cb-b8f2-c08c8dc0c772 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:42.540733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7288e-2e58-42cb-b8f2-c08c8dc0c772 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:42.549557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdb88d-7989-40aa-a0db-bc88416f572c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:42.550240 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdb88d-7989-40aa-a0db-bc88416f572c None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:42.550521 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdb88d-7989-40aa-a0db-bc88416f572c None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:42.550795 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdb88d-7989-40aa-a0db-bc88416f572c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:42.551627 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdb88d-7989-40aa-a0db-bc88416f572c None admin] RBAC: Adding query filter params (role.id=678724a2168946df8b6b36e91bf83b1a, scope.project.id=ff90b874f5b84d28a2752bc95419ad95, user.id=dbf2c12174e94e2db9be178973183ced) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:42.551937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdb88d-7989-40aa-a0db-bc88416f572c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:42.553350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdb88d-7989-40aa-a0db-bc88416f572c None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:42.554316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-5bb7288e-2e58-42cb-b8f2-c08c8dc0c772 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 15:38:42.554316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:42.554316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:38:42.554316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:38:42.554316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:38:42.554316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:38:42.554316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:38:42.554316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:42.554316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 15:38:42.554316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:42.554316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:38:42.554316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:42.554316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:42.554316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:42.554316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:42.554316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:42.555250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:42.555250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:42.555250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:42.555250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:42.555250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:42.555250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:42.555250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:42.555250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:38:42.555250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:38:42.555250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:38:42.555250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:38:42.555250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:42.555250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:42.555250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:42.555250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:42.555250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:42.556118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:42.556118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:42.556118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:42.556118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:42.556118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:42.556118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:42.556118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:42.556118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:42.556118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:42.556118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:42.556118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:42.556118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:38:42.556118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:42.556118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 15:38:42.556118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:42.556118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 467/906] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Jun 23 15:38:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:42.556948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7288e-2e58-42cb-b8f2-c08c8dc0c772 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:42.570234 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 440/907] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:38:42 2022] GET /identity/v3/role_assignments?user.id=dbf2c12174e94e2db9be178973183ced&scope.project.id=ff90b874f5b84d28a2752bc95419ad95&role.id=678724a2168946df8b6b36e91bf83b1a => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:42.571076 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdb88d-7989-40aa-a0db-bc88416f572c None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:42.657390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:42.661569 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:42.691787 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7288e-2e58-42cb-b8f2-c08c8dc0c772 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:42.702010 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdb88d-7989-40aa-a0db-bc88416f572c None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:42.733347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306126d-aa49-42dc-ac27-717a590ab06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:42.734184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306126d-aa49-42dc-ac27-717a590ab06e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:42.735144 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306126d-aa49-42dc-ac27-717a590ab06e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:42.735144 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306126d-aa49-42dc-ac27-717a590ab06e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:42.735391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306126d-aa49-42dc-ac27-717a590ab06e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:42.736738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306126d-aa49-42dc-ac27-717a590ab06e None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:42.741772 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbf93c-dc09-4a24-98d8-0f01a841ad3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:42.742467 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbf93c-dc09-4a24-98d8-0f01a841ad3d None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:42.742750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbf93c-dc09-4a24-98d8-0f01a841ad3d None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:42.743035 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbf93c-dc09-4a24-98d8-0f01a841ad3d None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:42.743727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbf93c-dc09-4a24-98d8-0f01a841ad3d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:42.744031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbf93c-dc09-4a24-98d8-0f01a841ad3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:42.745370 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbf93c-dc09-4a24-98d8-0f01a841ad3d None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:42.749512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-d306126d-aa49-42dc-ac27-717a590ab06e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 15:38:42.749512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:42.749512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:38:42.749512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:38:42.749512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:38:42.749512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:38:42.749512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:38:42.749512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:42.749512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 15:38:42.749512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:42.749512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:38:42.749512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:42.749512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:42.749512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:42.749512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:42.749512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:42.749512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:42.750867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:42.750867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:42.750867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:42.750867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:42.750867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:42.750867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:42.750867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:38:42.750867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:38:42.750867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:38:42.750867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:38:42.750867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:42.750867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:42.750867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:42.750867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:42.750867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:42.750867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:42.752002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:42.752002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:42.752002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:42.752002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:42.752002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:42.752002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:42.752002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:42.752002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:42.752002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:42.752002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:42.752002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:38:42.752002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:42.752002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 15:38:42.752002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:42.752729 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 441/908] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jun 23 15:38:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:42.752729 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8344e-b36d-4a36-bb5f-3811d9edeae6 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:42.752729 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8344e-b36d-4a36-bb5f-3811d9edeae6 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:42.752729 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e8344e-b36d-4a36-bb5f-3811d9edeae6 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:42.753627 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 442/909] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:42.754946 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 468/910] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 23 15:38:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:42.758155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8344e-b36d-4a36-bb5f-3811d9edeae6 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:42.758752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24312acf-4a5e-42e7-afc7-5487eefd507b None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:42.759337 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24312acf-4a5e-42e7-afc7-5487eefd507b None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:42.759446 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24312acf-4a5e-42e7-afc7-5487eefd507b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:42.775873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-24312acf-4a5e-42e7-afc7-5487eefd507b None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:42.777577 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-24312acf-4a5e-42e7-afc7-5487eefd507b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:42.850601 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 469/911] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 15:38:42.851343 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24312acf-4a5e-42e7-afc7-5487eefd507b None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:42.880580 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e8344e-b36d-4a36-bb5f-3811d9edeae6 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:42.910457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:42.916108 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28428b-0c5d-442a-ad58-24bac3df6fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:42.916772 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28428b-0c5d-442a-ad58-24bac3df6fc1 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:42.917053 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28428b-0c5d-442a-ad58-24bac3df6fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:42.917324 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28428b-0c5d-442a-ad58-24bac3df6fc1 None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:42.918616 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28428b-0c5d-442a-ad58-24bac3df6fc1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:42.918919 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28428b-0c5d-442a-ad58-24bac3df6fc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:42.920285 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28428b-0c5d-442a-ad58-24bac3df6fc1 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:42.926052 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:42.931060 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 443/912] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jun 23 15:38:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:42.931060 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28428b-0c5d-442a-ad58-24bac3df6fc1 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:42.969219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24312acf-4a5e-42e7-afc7-5487eefd507b None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:43.006129 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191620d-a16c-4930-84b5-3eb9c4c381f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:43.006863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191620d-a16c-4930-84b5-3eb9c4c381f6 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:43.007289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191620d-a16c-4930-84b5-3eb9c4c381f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:43.007574 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191620d-a16c-4930-84b5-3eb9c4c381f6 None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:43.008382 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191620d-a16c-4930-84b5-3eb9c4c381f6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:43.008697 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191620d-a16c-4930-84b5-3eb9c4c381f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:43.010207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191620d-a16c-4930-84b5-3eb9c4c381f6 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:43.020909 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 470/913] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 23 15:38:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:43.021661 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191620d-a16c-4930-84b5-3eb9c4c381f6 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:43.028223 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28428b-0c5d-442a-ad58-24bac3df6fc1 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:43.065652 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e05354-a77d-484d-9bc0-93f077257e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:43.066355 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e05354-a77d-484d-9bc0-93f077257e94 None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:43.066636 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e05354-a77d-484d-9bc0-93f077257e94 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:43.066911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e05354-a77d-484d-9bc0-93f077257e94 None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:43.067630 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e05354-a77d-484d-9bc0-93f077257e94 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:43.068982 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e05354-a77d-484d-9bc0-93f077257e94 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:43.082870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 444/914] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 23 15:38:42 2022] POST /identity/v3/services => generated 241 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:38:43.083726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e05354-a77d-484d-9bc0-93f077257e94 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:43.160430 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:43.176146 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191620d-a16c-4930-84b5-3eb9c4c381f6 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:43.212255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:43.232427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6152e-8fa5-43dc-abe2-90a53e122cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:43.233288 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6152e-8fa5-43dc-abe2-90a53e122cf5 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:43.233668 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6152e-8fa5-43dc-abe2-90a53e122cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:43.234129 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6152e-8fa5-43dc-abe2-90a53e122cf5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:43.235137 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6152e-8fa5-43dc-abe2-90a53e122cf5 None admin] RBAC: Adding query filter params (interface=public, service_id=99bcab4a4a7f4aafa99c712fd25e5e5e, region_id=RegionOne) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:43.235963 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6152e-8fa5-43dc-abe2-90a53e122cf5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:43.237256 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6152e-8fa5-43dc-abe2-90a53e122cf5 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:43.239969 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e05354-a77d-484d-9bc0-93f077257e94 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:43.248331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 471/915] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Jun 23 15:38:43 2022] GET /identity/v3/endpoints?service_id=99bcab4a4a7f4aafa99c712fd25e5e5e&interface=public®ion_id=RegionOne => generated 194 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:43.249386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6152e-8fa5-43dc-abe2-90a53e122cf5 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:43.283150 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fd49b-a3fa-4845-bb98-4c1c03e09d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:43.284085 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fd49b-a3fa-4845-bb98-4c1c03e09d3f None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:43.284375 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fd49b-a3fa-4845-bb98-4c1c03e09d3f None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:43.284654 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7fd49b-a3fa-4845-bb98-4c1c03e09d3f None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:43.285367 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fd49b-a3fa-4845-bb98-4c1c03e09d3f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:43.285679 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fd49b-a3fa-4845-bb98-4c1c03e09d3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:43.287820 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7fd49b-a3fa-4845-bb98-4c1c03e09d3f None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:43.293905 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 445/916] 10.222.0.15 () {56 vars in 1114 bytes} [Thu Jun 23 15:38:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:43.300302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fd49b-a3fa-4845-bb98-4c1c03e09d3f None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:43.383860 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6152e-8fa5-43dc-abe2-90a53e122cf5 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:43.413698 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7fd49b-a3fa-4845-bb98-4c1c03e09d3f None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:43.422393 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d699b2-e821-41f4-bb40-b546225ac9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:43.423296 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d699b2-e821-41f4-bb40-b546225ac9cf None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:43.423764 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d699b2-e821-41f4-bb40-b546225ac9cf None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:43.424224 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d699b2-e821-41f4-bb40-b546225ac9cf None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:43.425112 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d699b2-e821-41f4-bb40-b546225ac9cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:43.426753 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d699b2-e821-41f4-bb40-b546225ac9cf None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:43.434063 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 472/917] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jun 23 15:38:43 2022] GET /identity/v3/services => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:38:43.441880 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:43.457399 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473b6ab-eda5-40c5-b34f-d5072acb848f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:43.458124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473b6ab-eda5-40c5-b34f-d5072acb848f None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:43.458430 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473b6ab-eda5-40c5-b34f-d5072acb848f None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:43.458757 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473b6ab-eda5-40c5-b34f-d5072acb848f None admin] PATH_INFO: `/v3/endpoints` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:43.459562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473b6ab-eda5-40c5-b34f-d5072acb848f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:43.461125 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473b6ab-eda5-40c5-b34f-d5072acb848f None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:43.490067 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 446/918] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jun 23 15:38:43 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:38:44.653178 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a451f-f78c-4890-9a86-bebc94a55309 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:44.653749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a451f-f78c-4890-9a86-bebc94a55309 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:44.653749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a451f-f78c-4890-9a86-bebc94a55309 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:44.655546 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 473/919] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:44.662019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b5b69-a258-4b38-b372-702a6e746815 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:44.662538 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b5b69-a258-4b38-b372-702a6e746815 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:44.662643 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b5b69-a258-4b38-b372-702a6e746815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:44.681599 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-173b5b69-a258-4b38-b372-702a6e746815 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:44.682843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-173b5b69-a258-4b38-b372-702a6e746815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:44.764074 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 447/920] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:38:44.787108 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a451f-f78c-4890-9a86-bebc94a55309 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:44.851638 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:44.900129 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a451f-f78c-4890-9a86-bebc94a55309 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:44.937260 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc7b27-0cf5-4774-80b7-aeacb80aa9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:44.938129 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc7b27-0cf5-4774-80b7-aeacb80aa9ad None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:44.938392 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc7b27-0cf5-4774-80b7-aeacb80aa9ad None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:44.938672 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc7b27-0cf5-4774-80b7-aeacb80aa9ad None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:44.950631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc7b27-0cf5-4774-80b7-aeacb80aa9ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:38:44.958876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-cfbc7b27-0cf5-4774-80b7-aeacb80aa9ad None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 15:38:44.958876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:44.958876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:44.958876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:44.958876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:44.958876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:44.958876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:44.958876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:44.958876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:44.958876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:44.958876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:44.958876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:44.958876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:38:44.958876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:38:44.958876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:38:44.958876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:38:44.959824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:38:44.959824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:38:44.959824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:38:44.959824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:38:44.959824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:44.959824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:44.959824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:44.959824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:44.959824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:44.959824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:44.959824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:44.959824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:44.959824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:44.959824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:44.959824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:44.959824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:44.960650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:44.960650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:44.960650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:44.960650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:44.960650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:38:44.960650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:38:44.960650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:38:44.960650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:38:44.960650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:38:44.960650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:38:44.960650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 15:38:44.960650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:44.960650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 474/921] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Jun 23 15:38:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:44.966917 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b5b69-a258-4b38-b372-702a6e746815 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:45.070130 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b5b69-a258-4b38-b372-702a6e746815 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:45.071816 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:45.114176 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0c445-da1d-4a55-994d-5b5c5dca9ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:45.114767 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0c445-da1d-4a55-994d-5b5c5dca9ff0 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:45.115048 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0c445-da1d-4a55-994d-5b5c5dca9ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:45.115322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0c445-da1d-4a55-994d-5b5c5dca9ff0 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:45.116076 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0c445-da1d-4a55-994d-5b5c5dca9ff0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:45.116381 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0c445-da1d-4a55-994d-5b5c5dca9ff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:45.117741 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0c445-da1d-4a55-994d-5b5c5dca9ff0 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:45.126783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 448/922] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Jun 23 15:38:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:45.131953 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc7b27-0cf5-4774-80b7-aeacb80aa9ad None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:45.238396 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc7b27-0cf5-4774-80b7-aeacb80aa9ad None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:45.254145 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:45.272644 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6498ed-7107-49ff-aef0-5914020f7b28 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:45.273000 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6498ed-7107-49ff-aef0-5914020f7b28 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:45.273309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6498ed-7107-49ff-aef0-5914020f7b28 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:45.275683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 449/923] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:45.276997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed0249-3e85-446a-ad85-8b5d37fc7f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:45.278382 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed0249-3e85-446a-ad85-8b5d37fc7f1a None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:45.278663 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed0249-3e85-446a-ad85-8b5d37fc7f1a None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:45.278939 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed0249-3e85-446a-ad85-8b5d37fc7f1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:45.282118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c931c4-fc30-450c-8474-c12b33099cfc None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:45.282405 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c931c4-fc30-450c-8474-c12b33099cfc None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:45.282682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c931c4-fc30-450c-8474-c12b33099cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:45.293166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed0249-3e85-446a-ad85-8b5d37fc7f1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:45.295169 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed0249-3e85-446a-ad85-8b5d37fc7f1a None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:45.300292 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-74c931c4-fc30-450c-8474-c12b33099cfc None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:45.301489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-74c931c4-fc30-450c-8474-c12b33099cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:45.316583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-34ed0249-3e85-446a-ad85-8b5d37fc7f1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:45.316583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:45.316583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:45.316583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:45.316583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:45.316583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:45.316583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:45.316583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:45.316583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:45.316583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:45.316583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:45.316583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:45.316583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:45.316583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:45.316583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:45.318020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:45.318020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:45.318020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:45.318020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:45.318020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:45.318020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:45.318020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:45.318020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:45.318020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:45.318020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:45.318020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:45.318020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:45.318020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:45.318020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:45.318020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:45.318020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:45.318020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:45.319505 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:45.319505 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:45.319505 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:45.319505 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:45.319505 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 475/924] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:38:45.327362 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed0249-3e85-446a-ad85-8b5d37fc7f1a None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:45.390237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 450/925] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 15:38:45.409717 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c931c4-fc30-450c-8474-c12b33099cfc None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:45.453995 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed0249-3e85-446a-ad85-8b5d37fc7f1a None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:45.492886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a54d1-b3ce-42e0-8ea5-0655514a8f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:45.493827 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a54d1-b3ce-42e0-8ea5-0655514a8f72 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:45.494248 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a54d1-b3ce-42e0-8ea5-0655514a8f72 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:45.494621 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a54d1-b3ce-42e0-8ea5-0655514a8f72 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:45.495472 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a54d1-b3ce-42e0-8ea5-0655514a8f72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:45.496489 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a54d1-b3ce-42e0-8ea5-0655514a8f72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:45.498164 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a54d1-b3ce-42e0-8ea5-0655514a8f72 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:45.512901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 476/926] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:45.518049 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a54d1-b3ce-42e0-8ea5-0655514a8f72 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:45.541254 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:45.549332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c931c4-fc30-450c-8474-c12b33099cfc None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:45.554571 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:45.590188 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbf294-be19-41f6-ac2f-75381efca05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:45.591408 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbf294-be19-41f6-ac2f-75381efca05b None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:45.591895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbf294-be19-41f6-ac2f-75381efca05b None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:45.592356 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbf294-be19-41f6-ac2f-75381efca05b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:45.593255 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbf294-be19-41f6-ac2f-75381efca05b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:45.594900 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbf294-be19-41f6-ac2f-75381efca05b None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:45.608607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-d3fbf294-be19-41f6-ac2f-75381efca05b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 15:38:45.608607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:45.608607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:38:45.608607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:38:45.608607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:38:45.608607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:38:45.608607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:38:45.608607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:45.608607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 15:38:45.608607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:45.608607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:38:45.608607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:45.608607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:45.608607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:45.608607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:45.608607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:45.608607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:45.609653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:45.609653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:45.609653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:45.609653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:45.609653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:45.609653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:45.609653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:38:45.609653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:38:45.609653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:38:45.609653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:38:45.609653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:45.609653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:45.609653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:45.609653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:45.609653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:45.609653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:45.610863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:45.610863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:45.610863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:45.610863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:45.610863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:45.610863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:45.610863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:45.610863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:45.610863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:45.610863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:45.610863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:38:45.610863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:45.610863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 15:38:45.610863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:45.613599 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 451/927] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jun 23 15:38:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:38:45.619240 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbf294-be19-41f6-ac2f-75381efca05b None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:45.646334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a54d1-b3ce-42e0-8ea5-0655514a8f72 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:45.681408 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6c171-3c82-4f03-bf2b-9b4aad18d83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:45.682248 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6c171-3c82-4f03-bf2b-9b4aad18d83d None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:45.682535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6c171-3c82-4f03-bf2b-9b4aad18d83d None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:45.682811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6c171-3c82-4f03-bf2b-9b4aad18d83d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:45.690014 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6c171-3c82-4f03-bf2b-9b4aad18d83d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:45.691448 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6c171-3c82-4f03-bf2b-9b4aad18d83d None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:45.706152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-b8b6c171-3c82-4f03-bf2b-9b4aad18d83d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 15:38:45.706152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:45.706152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:45.706152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:45.706152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:45.706152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:45.706152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:45.706152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:45.706152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:45.706152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:45.706152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:45.706152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:45.706152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:38:45.706152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:38:45.706152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:38:45.706152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:38:45.707118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:45.707118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:45.707118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:45.707118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:45.707118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:45.707118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:45.707118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:45.707118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:45.707118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:45.707118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:45.707118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:45.707118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:45.707118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:45.707118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:45.707118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:45.707118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:45.707118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:45.707118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:45.708025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:45.708025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:45.708025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:38:45.708025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:38:45.708025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:38:45.708025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:38:45.708025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:38:45.708025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:38:45.708025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 15:38:45.708025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:45.708025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 477/928] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jun 23 15:38:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:45.708737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1261fa2-707e-41b1-b72c-cc43e98c7f46 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:45.709078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1261fa2-707e-41b1-b72c-cc43e98c7f46 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:45.709260 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1261fa2-707e-41b1-b72c-cc43e98c7f46 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:45.710556 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 478/929] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:45.711690 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615dc02e-3bc7-40a0-9e24-921f677d85d7 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:45.712064 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615dc02e-3bc7-40a0-9e24-921f677d85d7 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:45.712440 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615dc02e-3bc7-40a0-9e24-921f677d85d7 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:45.713667 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 479/930] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:45.718017 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615dc02e-3bc7-40a0-9e24-921f677d85d7 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:45.729275 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbf294-be19-41f6-ac2f-75381efca05b None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:45.764591 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7739e-46b0-483c-bec4-5c299cc2c8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:45.765271 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7739e-46b0-483c-bec4-5c299cc2c8b9 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:45.765552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7739e-46b0-483c-bec4-5c299cc2c8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:45.765826 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7739e-46b0-483c-bec4-5c299cc2c8b9 None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:45.766575 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7739e-46b0-483c-bec4-5c299cc2c8b9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:45.766885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7739e-46b0-483c-bec4-5c299cc2c8b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:45.768262 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7739e-46b0-483c-bec4-5c299cc2c8b9 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:45.773331 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 452/931] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jun 23 15:38:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:45.774649 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d838f-fe39-4b86-8c2f-c4ce33583daa None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:45.774943 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d838f-fe39-4b86-8c2f-c4ce33583daa None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:45.775220 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d838f-fe39-4b86-8c2f-c4ce33583daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:45.791746 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-0a9d838f-fe39-4b86-8c2f-c4ce33583daa None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:45.793034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-0a9d838f-fe39-4b86-8c2f-c4ce33583daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:45.806327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:45.810801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:45.825580 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615dc02e-3bc7-40a0-9e24-921f677d85d7 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:45.860783 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43530513-8521-41fc-acff-2a4bcc45d68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:45.861470 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43530513-8521-41fc-acff-2a4bcc45d68a None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:45.861756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43530513-8521-41fc-acff-2a4bcc45d68a None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:45.862070 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43530513-8521-41fc-acff-2a4bcc45d68a None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:45.862921 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43530513-8521-41fc-acff-2a4bcc45d68a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:45.863236 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43530513-8521-41fc-acff-2a4bcc45d68a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:45.864674 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43530513-8521-41fc-acff-2a4bcc45d68a None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:45.865363 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 453/932] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:38:45.866680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484eb93-37dd-4eaf-9d5c-2ceab3addc6b None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:45.866971 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484eb93-37dd-4eaf-9d5c-2ceab3addc6b None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:45.867249 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484eb93-37dd-4eaf-9d5c-2ceab3addc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:45.883929 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-0484eb93-37dd-4eaf-9d5c-2ceab3addc6b None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:45.885110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-0484eb93-37dd-4eaf-9d5c-2ceab3addc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:45.892545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 480/933] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Jun 23 15:38:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:45.893445 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43530513-8521-41fc-acff-2a4bcc45d68a None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:45.955137 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 454/934] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:38:45.956254 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484eb93-37dd-4eaf-9d5c-2ceab3addc6b None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:45.994073 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43530513-8521-41fc-acff-2a4bcc45d68a None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:46.029166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109d4de-14a5-4ab5-b353-7e01a4c31817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:46.029835 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109d4de-14a5-4ab5-b353-7e01a4c31817 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:46.030154 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109d4de-14a5-4ab5-b353-7e01a4c31817 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:46.030434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109d4de-14a5-4ab5-b353-7e01a4c31817 None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:46.031406 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109d4de-14a5-4ab5-b353-7e01a4c31817 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:46.031717 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109d4de-14a5-4ab5-b353-7e01a4c31817 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:46.033215 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109d4de-14a5-4ab5-b353-7e01a4c31817 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:46.036834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:46.038248 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 481/935] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jun 23 15:38:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:46.039129 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109d4de-14a5-4ab5-b353-7e01a4c31817 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:46.049802 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:46.059106 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484eb93-37dd-4eaf-9d5c-2ceab3addc6b None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:46.095155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac5523-1ed0-4bb8-9974-60c9bf62cd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:46.095814 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac5523-1ed0-4bb8-9974-60c9bf62cd73 None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:46.096095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac5523-1ed0-4bb8-9974-60c9bf62cd73 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:46.096373 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac5523-1ed0-4bb8-9974-60c9bf62cd73 None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:46.097070 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac5523-1ed0-4bb8-9974-60c9bf62cd73 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:46.098514 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac5523-1ed0-4bb8-9974-60c9bf62cd73 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:46.099887 dv-cinder-835384-9-smb devstack@keystone.service[91827]: WARNING keystone.server.flask.common [None req-fdac5523-1ed0-4bb8-9974-60c9bf62cd73 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 23 15:38:46.116702 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.sql.core [None req-fdac5523-1ed0-4bb8-9974-60c9bf62cd73 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 15:38:46.116702 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 15:38:46.116702 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [parameters: {'id': 'e77bbad531a94426af9c0a7a06240c70', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 15:38:46.116702 dv-cinder-835384-9-smb devstack@keystone.service[91827]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91827) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 15:38:46.133457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-fdac5523-1ed0-4bb8-9974-60c9bf62cd73 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e77bbad531a94426af9c0a7a06240c70.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e77bbad531a94426af9c0a7a06240c70. Jun 23 15:38:46.133457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:46.133457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 15:38:46.133457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 15:38:46.133457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 15:38:46.133457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 15:38:46.133457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 15:38:46.133457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 15:38:46.133457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 15:38:46.133457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application conn.query(q) Jun 23 15:38:46.133457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 15:38:46.133457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 15:38:46.133457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 15:38:46.134540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application result.read() Jun 23 15:38:46.134540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 15:38:46.134540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 15:38:46.134540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 15:38:46.134540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 15:38:46.134540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 15:38:46.134540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 15:38:46.134540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 15:38:46.134540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 15:38:46.134540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 15:38:46.134540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:46.134540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 15:38:46.134540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:46.134540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:46.134540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 15:38:46.134540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 15:38:46.134540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 23 15:38:46.134540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 23 15:38:46.135696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 15:38:46.135696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application next(self.gen) Jun 23 15:38:46.135696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 15:38:46.135696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application yield resource Jun 23 15:38:46.135696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 15:38:46.135696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application next(self.gen) Jun 23 15:38:46.135696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 15:38:46.135696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 15:38:46.135696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 15:38:46.135696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 15:38:46.135696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 15:38:46.135696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise self.value Jun 23 15:38:46.135696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 15:38:46.135696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 15:38:46.135696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 15:38:46.135696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application session.commit() Jun 23 15:38:46.135696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 15:38:46.137570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 15:38:46.137570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 15:38:46.137570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 15:38:46.137570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 15:38:46.137570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self.session.flush() Jun 23 15:38:46.137570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 15:38:46.137570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 15:38:46.137570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 15:38:46.137570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 15:38:46.137570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 15:38:46.137570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application compat.raise_( Jun 23 15:38:46.137570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 15:38:46.137570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception Jun 23 15:38:46.137570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 15:38:46.137570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 15:38:46.137570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 15:38:46.137570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 15:38:46.138716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 15:38:46.138716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 15:38:46.138716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 15:38:46.138716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 15:38:46.138716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 15:38:46.138716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 15:38:46.138716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 15:38:46.138716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 15:38:46.138716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 15:38:46.138716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 15:38:46.138716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 15:38:46.138716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 15:38:46.138716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 15:38:46.138716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 15:38:46.138716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 15:38:46.139755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 15:38:46.139755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 15:38:46.139755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception Jun 23 15:38:46.139755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 15:38:46.139755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 15:38:46.139755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 15:38:46.139755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 15:38:46.139755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 15:38:46.139755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 15:38:46.139755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 15:38:46.139755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application conn.query(q) Jun 23 15:38:46.139755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 15:38:46.139755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 15:38:46.139755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 15:38:46.139755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application result.read() Jun 23 15:38:46.139755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 15:38:46.139755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 15:38:46.140922 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 15:38:46.140922 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 15:38:46.140922 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 15:38:46.140922 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 15:38:46.140922 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 15:38:46.140922 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 15:38:46.140922 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 15:38:46.140922 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 15:38:46.140922 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [parameters: {'id': 'e77bbad531a94426af9c0a7a06240c70', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 15:38:46.140922 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 15:38:46.140922 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:46.140922 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:38:46.140922 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:46.140922 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:46.140922 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 23 15:38:46.141978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 23 15:38:46.141978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 15:38:46.141978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 15:38:46.141978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 23 15:38:46.141978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:46.141978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:38:46.141978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:46.141978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:46.141978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:46.141978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:46.141978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:46.141978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:46.141978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:46.141978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:46.141978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:46.141978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:46.141978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:46.143077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:46.143077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 23 15:38:46.143077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 23 15:38:46.143077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:46.143077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:46.143077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 23 15:38:46.143077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 23 15:38:46.143077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e77bbad531a94426af9c0a7a06240c70. Jun 23 15:38:46.143077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:46.143077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 455/936] 10.222.0.15 () {60 vars in 1140 bytes} [Thu Jun 23 15:38:45 2022] POST /identity/v3/projects => generated 262 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:46.143077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac5523-1ed0-4bb8-9974-60c9bf62cd73 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:46.150774 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109d4de-14a5-4ab5-b353-7e01a4c31817 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:46.187725 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb5dfc-2fc9-4839-a6c4-7228c195981e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:46.188519 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb5dfc-2fc9-4839-a6c4-7228c195981e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:46.188805 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb5dfc-2fc9-4839-a6c4-7228c195981e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:46.189083 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb5dfc-2fc9-4839-a6c4-7228c195981e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:46.199693 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb5dfc-2fc9-4839-a6c4-7228c195981e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:46.201135 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb5dfc-2fc9-4839-a6c4-7228c195981e None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:46.219013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-a1eb5dfc-2fc9-4839-a6c4-7228c195981e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:46.219013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:46.219013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:46.219013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:46.219013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:46.219013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:46.219013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:46.219013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:46.219013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:46.219013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:46.219013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:46.219013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:46.219013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:46.219013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:46.219013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:46.220116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:46.220116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:46.220116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:46.220116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:46.220116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:46.220116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:46.220116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:46.220116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:46.220116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:46.220116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:46.220116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:46.220116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:46.220116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:46.220116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:46.220116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:46.220116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:46.220116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:46.221007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:46.221007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:46.221007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:46.221007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:46.221007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 482/937] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:46.221275 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb5dfc-2fc9-4839-a6c4-7228c195981e None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:46.241416 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac5523-1ed0-4bb8-9974-60c9bf62cd73 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:46.275475 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112c41c-ad33-4d27-af68-2f0f311e114b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:46.276302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112c41c-ad33-4d27-af68-2f0f311e114b None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:46.276588 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112c41c-ad33-4d27-af68-2f0f311e114b None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:46.276955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112c41c-ad33-4d27-af68-2f0f311e114b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:46.277626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112c41c-ad33-4d27-af68-2f0f311e114b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:46.279233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112c41c-ad33-4d27-af68-2f0f311e114b None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:46.283797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:46.291976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-d112c41c-ad33-4d27-af68-2f0f311e114b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 15:38:46.291976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:46.291976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:38:46.291976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:38:46.291976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:38:46.291976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:38:46.291976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:38:46.291976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:46.291976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 15:38:46.291976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:46.291976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:38:46.291976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:46.291976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:46.291976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:46.291976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:46.291976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:46.293640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:46.293640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:46.293640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:46.293640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:46.293640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:46.293640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:46.293640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:46.293640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:38:46.293640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:38:46.293640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:38:46.293640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:38:46.293640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:46.293640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:46.293640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:46.293640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:46.293640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:46.299788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:46.299788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:46.299788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:46.299788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:46.299788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:46.299788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:46.299788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:46.299788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:46.299788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:46.299788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:46.299788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:46.299788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:38:46.299788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:46.299788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 15:38:46.299788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:46.299788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 456/938] 10.222.0.15 () {56 vars in 1132 bytes} [Thu Jun 23 15:38:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:46.300647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112c41c-ad33-4d27-af68-2f0f311e114b None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:46.300647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:46.331532 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb5dfc-2fc9-4839-a6c4-7228c195981e None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:46.366301 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c417c-9e5f-48eb-8b20-996ae1df31c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:46.366965 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c417c-9e5f-48eb-8b20-996ae1df31c7 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:46.367254 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c417c-9e5f-48eb-8b20-996ae1df31c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:46.367537 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c417c-9e5f-48eb-8b20-996ae1df31c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:46.368335 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c417c-9e5f-48eb-8b20-996ae1df31c7 None admin] RBAC: Adding query filter params (interface=public, service_id=ae21ce996de7445c93813b24440c0627, region_id=RegionOne) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:46.368655 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c417c-9e5f-48eb-8b20-996ae1df31c7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:46.370052 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131c417c-9e5f-48eb-8b20-996ae1df31c7 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:46.375821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 483/939] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Jun 23 15:38:46 2022] GET /identity/v3/endpoints?service_id=ae21ce996de7445c93813b24440c0627&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:46.376619 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c417c-9e5f-48eb-8b20-996ae1df31c7 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:46.401809 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112c41c-ad33-4d27-af68-2f0f311e114b None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:46.435738 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39094ccf-0e92-419e-8587-a54d73590826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:46.436534 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39094ccf-0e92-419e-8587-a54d73590826 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:46.436861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39094ccf-0e92-419e-8587-a54d73590826 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:46.437131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39094ccf-0e92-419e-8587-a54d73590826 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:46.443804 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39094ccf-0e92-419e-8587-a54d73590826 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:46.445235 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39094ccf-0e92-419e-8587-a54d73590826 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:46.459976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-39094ccf-0e92-419e-8587-a54d73590826 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:46.459976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:46.459976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:46.459976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:46.459976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:46.459976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:46.459976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:46.459976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:46.459976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:46.459976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:46.459976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:46.459976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:46.459976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:46.459976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:46.459976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:46.460928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:46.460928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:46.460928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:46.460928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:46.460928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:46.460928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:46.460928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:46.460928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:46.460928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:46.460928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:46.460928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:46.460928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:46.460928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:46.460928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:46.460928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:46.460928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:46.460928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:46.461784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:46.461784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:46.461784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:46.461784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:46.461784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:46.461784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:46.461784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:46.461784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:46.461784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 457/940] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:46.462670 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39094ccf-0e92-419e-8587-a54d73590826 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:46.478262 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131c417c-9e5f-48eb-8b20-996ae1df31c7 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:46.501695 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:46.512765 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2009c8-6197-4adf-a77e-545568189ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:46.513424 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2009c8-6197-4adf-a77e-545568189ad2 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:46.513707 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2009c8-6197-4adf-a77e-545568189ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:46.514024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2009c8-6197-4adf-a77e-545568189ad2 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:46.514756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2009c8-6197-4adf-a77e-545568189ad2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:46.515065 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2009c8-6197-4adf-a77e-545568189ad2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:46.516447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2009c8-6197-4adf-a77e-545568189ad2 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:46.523630 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:46.528764 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 484/941] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:46.529495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2009c8-6197-4adf-a77e-545568189ad2 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:46.569572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39094ccf-0e92-419e-8587-a54d73590826 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:46.604359 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f4cce-9508-4502-8540-c16e1080b587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:46.605053 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f4cce-9508-4502-8540-c16e1080b587 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:46.605359 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f4cce-9508-4502-8540-c16e1080b587 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:46.605624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f4cce-9508-4502-8540-c16e1080b587 None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:46.606363 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f4cce-9508-4502-8540-c16e1080b587 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:46.606676 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f4cce-9508-4502-8540-c16e1080b587 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:46.608049 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f4cce-9508-4502-8540-c16e1080b587 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:46.616031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 458/942] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jun 23 15:38:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:46.617039 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f4cce-9508-4502-8540-c16e1080b587 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:46.632850 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2009c8-6197-4adf-a77e-545568189ad2 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:46.667678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efe67a-3afb-4735-92c8-e9b4a9d6dcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:46.668357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efe67a-3afb-4735-92c8-e9b4a9d6dcd1 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:46.668644 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efe67a-3afb-4735-92c8-e9b4a9d6dcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:46.668921 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efe67a-3afb-4735-92c8-e9b4a9d6dcd1 None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:46.669609 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0efe67a-3afb-4735-92c8-e9b4a9d6dcd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:46.671043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0efe67a-3afb-4735-92c8-e9b4a9d6dcd1 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:46.677457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 485/943] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jun 23 15:38:46 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:38:46.678088 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efe67a-3afb-4735-92c8-e9b4a9d6dcd1 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:46.725480 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f4cce-9508-4502-8540-c16e1080b587 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:46.738030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:46.758717 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:46.772673 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f3a48-4c20-467d-b23a-2c96a42f2075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:46.773370 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f3a48-4c20-467d-b23a-2c96a42f2075 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:46.773654 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f3a48-4c20-467d-b23a-2c96a42f2075 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:46.774370 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f3a48-4c20-467d-b23a-2c96a42f2075 None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:46.775159 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f3a48-4c20-467d-b23a-2c96a42f2075 None admin] RBAC: Adding query filter params (name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:46.775818 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f3a48-4c20-467d-b23a-2c96a42f2075 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:46.779062 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f3a48-4c20-467d-b23a-2c96a42f2075 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:46.798818 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 459/944] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 23 15:38:46 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:46.800096 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f3a48-4c20-467d-b23a-2c96a42f2075 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:46.800751 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efe67a-3afb-4735-92c8-e9b4a9d6dcd1 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:46.861899 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e5bba-c0c7-4cc7-84c5-773ea1e31148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:46.862732 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e5bba-c0c7-4cc7-84c5-773ea1e31148 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:46.863016 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e5bba-c0c7-4cc7-84c5-773ea1e31148 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:46.863301 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e5bba-c0c7-4cc7-84c5-773ea1e31148 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:46.872655 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e5bba-c0c7-4cc7-84c5-773ea1e31148 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:46.875660 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e5bba-c0c7-4cc7-84c5-773ea1e31148 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:46.892334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-da8e5bba-c0c7-4cc7-84c5-773ea1e31148 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:46.892334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:46.892334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:46.892334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:46.892334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:46.892334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:46.892334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:46.892334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:46.892334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:46.892334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:46.892334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:46.892334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:46.892334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:46.892334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:46.892334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:46.893297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:46.893297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:46.893297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:46.893297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:46.893297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:46.893297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:46.893297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:46.893297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:46.893297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:46.893297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:46.893297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:46.893297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:46.893297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:46.893297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:46.893297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:46.893297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:46.893297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:46.894229 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:46.894229 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:46.894229 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:46.894229 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:46.894229 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:46.894229 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:46.894229 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:46.894229 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:46.896775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 486/945] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:46.902884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e5bba-c0c7-4cc7-84c5-773ea1e31148 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:46.942351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f3a48-4c20-467d-b23a-2c96a42f2075 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:46.984317 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f296d82-c932-4589-aae0-8b41a07ff780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:46.988298 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f296d82-c932-4589-aae0-8b41a07ff780 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:46.988298 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f296d82-c932-4589-aae0-8b41a07ff780 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:46.988298 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f296d82-c932-4589-aae0-8b41a07ff780 None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:46.988298 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f296d82-c932-4589-aae0-8b41a07ff780 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:46.988298 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f296d82-c932-4589-aae0-8b41a07ff780 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:46.988726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f296d82-c932-4589-aae0-8b41a07ff780 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:46.997531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 460/946] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jun 23 15:38:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:47.003143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f296d82-c932-4589-aae0-8b41a07ff780 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:47.023355 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e5bba-c0c7-4cc7-84c5-773ea1e31148 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:47.035037 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:47.070552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:47.075156 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c10ada-1fb3-4eea-9446-c80f448ae0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:47.075156 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c10ada-1fb3-4eea-9446-c80f448ae0fa None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:47.075156 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c10ada-1fb3-4eea-9446-c80f448ae0fa None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:47.075156 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c10ada-1fb3-4eea-9446-c80f448ae0fa None admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:47.075539 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c10ada-1fb3-4eea-9446-c80f448ae0fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:47.075539 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c10ada-1fb3-4eea-9446-c80f448ae0fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:47.076638 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c10ada-1fb3-4eea-9446-c80f448ae0fa None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:47.096465 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 487/947] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:47.102968 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c10ada-1fb3-4eea-9446-c80f448ae0fa None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:47.131952 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f296d82-c932-4589-aae0-8b41a07ff780 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:47.173694 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562862fe-5416-48c9-b867-6fd19cfa1ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:47.174807 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562862fe-5416-48c9-b867-6fd19cfa1ad7 None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:47.175100 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562862fe-5416-48c9-b867-6fd19cfa1ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:47.175476 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562862fe-5416-48c9-b867-6fd19cfa1ad7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:47.176235 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562862fe-5416-48c9-b867-6fd19cfa1ad7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:47.177609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562862fe-5416-48c9-b867-6fd19cfa1ad7 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:47.210231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 461/948] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jun 23 15:38:47 2022] POST /identity/v3/endpoints => generated 347 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:38:47.229033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c10ada-1fb3-4eea-9446-c80f448ae0fa None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:47.282763 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95be43d-98b7-4e92-9d8b-d866e716df33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:47.283770 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95be43d-98b7-4e92-9d8b-d866e716df33 None admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:47.284066 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95be43d-98b7-4e92-9d8b-d866e716df33 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:47.284349 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95be43d-98b7-4e92-9d8b-d866e716df33 None admin] PATH_INFO: `/v3/projects/ff90b874f5b84d28a2752bc95419ad95/users/dbf2c12174e94e2db9be178973183ced/roles/678724a2168946df8b6b36e91bf83b1a` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:47.286867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95be43d-98b7-4e92-9d8b-d866e716df33 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff90b874f5b84d28a2752bc95419ad95, user_id=dbf2c12174e94e2db9be178973183ced, role_id=678724a2168946df8b6b36e91bf83b1a)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:47.288353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95be43d-98b7-4e92-9d8b-d866e716df33 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:47.305540 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 488/949] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 23 15:38:47 2022] PUT /identity/v3/projects/ff90b874f5b84d28a2752bc95419ad95/users/dbf2c12174e94e2db9be178973183ced/roles/678724a2168946df8b6b36e91bf83b1a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:38:48.773383 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d663db-809c-42e8-b639-79085f08ffdd None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:48.774413 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d663db-809c-42e8-b639-79085f08ffdd None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:48.774897 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d663db-809c-42e8-b639-79085f08ffdd None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:48.776703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 462/950] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:48.782895 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ddde4-e074-41f9-807d-aef220aeb4b8 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:48.783820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ddde4-e074-41f9-807d-aef220aeb4b8 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:48.784297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ddde4-e074-41f9-807d-aef220aeb4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:48.801639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-612ddde4-e074-41f9-807d-aef220aeb4b8 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:48.803178 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-612ddde4-e074-41f9-807d-aef220aeb4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:48.824547 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:48.882446 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 489/951] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:38:48.906580 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d663db-809c-42e8-b639-79085f08ffdd None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:49.017095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d663db-809c-42e8-b639-79085f08ffdd None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:49.018757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a9d70-1f1c-4507-85eb-a047cea549b1 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:49.019291 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a9d70-1f1c-4507-85eb-a047cea549b1 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:49.019798 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03a9d70-1f1c-4507-85eb-a047cea549b1 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:49.021717 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 490/952] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:38:49.025736 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:49.028360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30e5ae-8d7d-4362-8807-4535461648e8 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:49.028642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30e5ae-8d7d-4362-8807-4535461648e8 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:49.028918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30e5ae-8d7d-4362-8807-4535461648e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:49.051101 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-4f30e5ae-8d7d-4362-8807-4535461648e8 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:49.052671 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-4f30e5ae-8d7d-4362-8807-4535461648e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:49.063459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598f6c7-a0d3-46f9-95d9-251f9acffca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:49.064449 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598f6c7-a0d3-46f9-95d9-251f9acffca3 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:49.064564 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598f6c7-a0d3-46f9-95d9-251f9acffca3 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:49.064788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598f6c7-a0d3-46f9-95d9-251f9acffca3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:49.065441 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598f6c7-a0d3-46f9-95d9-251f9acffca3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:49.066841 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598f6c7-a0d3-46f9-95d9-251f9acffca3 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:49.079788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-b598f6c7-a0d3-46f9-95d9-251f9acffca3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 15:38:49.079788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:49.079788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:38:49.079788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:38:49.079788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:38:49.079788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:38:49.079788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:38:49.079788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:49.079788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 15:38:49.079788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:49.079788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:38:49.079788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:49.079788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:49.079788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:49.079788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:49.079788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:49.079788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:49.080790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:49.080790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:49.080790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:49.080790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:49.080790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:49.080790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:49.080790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:38:49.080790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:38:49.080790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:38:49.080790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:38:49.080790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:49.080790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:49.080790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:49.080790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:49.080790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:49.080790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:49.081992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:49.081992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:49.081992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:49.081992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:49.081992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:49.081992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:49.081992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:49.081992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:49.081992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:49.081992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:49.081992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:38:49.081992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:49.081992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 15:38:49.081992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:49.081992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 463/953] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jun 23 15:38:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:49.087323 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598f6c7-a0d3-46f9-95d9-251f9acffca3 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:49.141942 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 491/954] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:38:49.162988 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30e5ae-8d7d-4362-8807-4535461648e8 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:49.196912 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598f6c7-a0d3-46f9-95d9-251f9acffca3 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:49.233408 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456b415-a5df-4998-aec3-60e1daf09caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:49.234109 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456b415-a5df-4998-aec3-60e1daf09caa None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:49.234391 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456b415-a5df-4998-aec3-60e1daf09caa None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:49.234666 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456b415-a5df-4998-aec3-60e1daf09caa None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:49.235375 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456b415-a5df-4998-aec3-60e1daf09caa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:49.235685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456b415-a5df-4998-aec3-60e1daf09caa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:49.237106 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456b415-a5df-4998-aec3-60e1daf09caa None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:49.242511 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 464/955] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jun 23 15:38:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:49.248204 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456b415-a5df-4998-aec3-60e1daf09caa None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:49.257034 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:49.276907 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30e5ae-8d7d-4362-8807-4535461648e8 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:49.285954 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:49.319323 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1679d-0ce8-45fc-9f99-dba461cf6cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:49.320398 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1679d-0ce8-45fc-9f99-dba461cf6cc2 None admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:49.320888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1679d-0ce8-45fc-9f99-dba461cf6cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:49.321367 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1679d-0ce8-45fc-9f99-dba461cf6cc2 None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:49.322344 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1679d-0ce8-45fc-9f99-dba461cf6cc2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:49.324604 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a1679d-0ce8-45fc-9f99-dba461cf6cc2 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:49.326202 dv-cinder-835384-9-smb devstack@keystone.service[91828]: WARNING keystone.server.flask.common [None req-57a1679d-0ce8-45fc-9f99-dba461cf6cc2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 23 15:38:49.340931 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.sql.core [None req-57a1679d-0ce8-45fc-9f99-dba461cf6cc2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 15:38:49.340931 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 15:38:49.340931 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [parameters: {'user_id': 'cbf7706478d94a0995ec4d1fd3494aaf', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 15:38:49.340931 dv-cinder-835384-9-smb devstack@keystone.service[91828]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91828) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 15:38:49.350004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-57a1679d-0ce8-45fc-9f99-dba461cf6cc2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 15:38:49.350004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:49.350004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 15:38:49.350004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 15:38:49.350004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 15:38:49.350004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 15:38:49.350004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 15:38:49.350004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 15:38:49.350004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 15:38:49.350004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application conn.query(q) Jun 23 15:38:49.350004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 15:38:49.350004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 15:38:49.350004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 15:38:49.350004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application result.read() Jun 23 15:38:49.350004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 15:38:49.351045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 15:38:49.351045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 15:38:49.351045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 15:38:49.351045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 15:38:49.351045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 15:38:49.351045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 15:38:49.351045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 15:38:49.351045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 15:38:49.351045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:49.351045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 15:38:49.351045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:49.351045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:49.351045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 15:38:49.351045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 15:38:49.351045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 23 15:38:49.351045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 23 15:38:49.351045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 15:38:49.351045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application next(self.gen) Jun 23 15:38:49.352024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 15:38:49.352024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application yield resource Jun 23 15:38:49.352024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 15:38:49.352024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application next(self.gen) Jun 23 15:38:49.352024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 15:38:49.352024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 15:38:49.352024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 15:38:49.352024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 15:38:49.352024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 15:38:49.352024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise self.value Jun 23 15:38:49.352024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 15:38:49.352024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 15:38:49.352024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 15:38:49.352024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application session.commit() Jun 23 15:38:49.352024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 15:38:49.352024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 15:38:49.352024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 15:38:49.352971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 15:38:49.352971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 15:38:49.352971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self.session.flush() Jun 23 15:38:49.352971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 15:38:49.352971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 15:38:49.352971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 15:38:49.352971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 15:38:49.352971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 15:38:49.352971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application compat.raise_( Jun 23 15:38:49.352971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 15:38:49.352971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception Jun 23 15:38:49.352971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 15:38:49.352971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 15:38:49.352971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 15:38:49.352971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 15:38:49.352971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 15:38:49.352971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 15:38:49.353906 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 15:38:49.353906 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 15:38:49.353906 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 23 15:38:49.353906 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 23 15:38:49.353906 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 15:38:49.353906 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 15:38:49.353906 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 15:38:49.353906 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 15:38:49.353906 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 15:38:49.353906 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 15:38:49.353906 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 15:38:49.353906 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 15:38:49.353906 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 15:38:49.353906 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 15:38:49.353906 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 15:38:49.353906 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception Jun 23 15:38:49.354853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 15:38:49.354853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 15:38:49.354853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 15:38:49.354853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 15:38:49.354853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 15:38:49.354853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 15:38:49.354853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 15:38:49.354853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application conn.query(q) Jun 23 15:38:49.354853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 15:38:49.354853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 15:38:49.354853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 15:38:49.354853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application result.read() Jun 23 15:38:49.354853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 15:38:49.354853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 15:38:49.354853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 15:38:49.354853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 15:38:49.355756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 15:38:49.355756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 15:38:49.355756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 15:38:49.355756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 15:38:49.355756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 15:38:49.355756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 15:38:49.355756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [parameters: {'user_id': 'cbf7706478d94a0995ec4d1fd3494aaf', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 15:38:49.355756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 15:38:49.355756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:49.355756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:38:49.355756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:49.355756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:49.355756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:49.355756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:49.355756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:49.356585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:49.356585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:49.356585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:49.356585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:49.356585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:49.356585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:49.356585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:49.356585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 23 15:38:49.356585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 23 15:38:49.356585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:49.356585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:49.356585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:49.356585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:49.356585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:49.356585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:49.356585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 23 15:38:49.356585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 23 15:38:49.357501 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 23 15:38:49.357501 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 23 15:38:49.357501 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 15:38:49.357501 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 15:38:49.357501 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 15:38:49.357501 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:49.357845 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456b415-a5df-4998-aec3-60e1daf09caa None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:49.365777 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 492/956] 10.222.0.15 () {60 vars in 1131 bytes} [Thu Jun 23 15:38:49 2022] POST /identity/v3/users => generated 160 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:38:49.367756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189a047-9628-414b-bb09-5f2c2552e6ce None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:49.368045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189a047-9628-414b-bb09-5f2c2552e6ce None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:49.368325 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189a047-9628-414b-bb09-5f2c2552e6ce None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:49.373245 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 493/957] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:49.378007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189a047-9628-414b-bb09-5f2c2552e6ce None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:49.394664 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf9cb1-0c78-4d6e-9e00-a62ef767a139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:49.395332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf9cb1-0c78-4d6e-9e00-a62ef767a139 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:49.395614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf9cb1-0c78-4d6e-9e00-a62ef767a139 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:49.395896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf9cb1-0c78-4d6e-9e00-a62ef767a139 None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:49.396590 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf9cb1-0c78-4d6e-9e00-a62ef767a139 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:49.396898 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf9cb1-0c78-4d6e-9e00-a62ef767a139 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:49.398302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf9cb1-0c78-4d6e-9e00-a62ef767a139 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:49.403511 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 465/958] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jun 23 15:38:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:49.404482 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaa626-4ad2-481c-924e-386b48a9bc56 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:49.404769 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaa626-4ad2-481c-924e-386b48a9bc56 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:49.405048 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdaa626-4ad2-481c-924e-386b48a9bc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:49.423480 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-8fdaa626-4ad2-481c-924e-386b48a9bc56 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:49.424979 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-8fdaa626-4ad2-481c-924e-386b48a9bc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:49.493523 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189a047-9628-414b-bb09-5f2c2552e6ce None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:49.494328 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 466/959] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:38:49.495146 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdaa626-4ad2-481c-924e-386b48a9bc56 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:49.522816 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:49.536415 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50342c10-f4bf-4b49-8881-1d7fa8bd94f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:49.537216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50342c10-f4bf-4b49-8881-1d7fa8bd94f0 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:49.537502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50342c10-f4bf-4b49-8881-1d7fa8bd94f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:49.537775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50342c10-f4bf-4b49-8881-1d7fa8bd94f0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:49.547494 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50342c10-f4bf-4b49-8881-1d7fa8bd94f0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:49.549060 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50342c10-f4bf-4b49-8881-1d7fa8bd94f0 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:49.563573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-50342c10-f4bf-4b49-8881-1d7fa8bd94f0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 15:38:49.563573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:49.563573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:49.563573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:49.563573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:49.563573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:49.563573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:49.563573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:49.563573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:49.563573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:49.563573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:49.563573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:49.563573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:38:49.563573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:38:49.563573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:38:49.563573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:38:49.564603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:49.564603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:49.564603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:49.564603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:49.564603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:49.564603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:49.564603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:49.564603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:49.564603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:49.564603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:49.564603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:49.564603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:49.564603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:49.564603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:49.564603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:49.564603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:49.564603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:49.564603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:49.565726 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:49.565726 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:49.565726 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:38:49.565726 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:38:49.565726 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:38:49.565726 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:38:49.565726 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:38:49.565726 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:38:49.565726 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 15:38:49.565726 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:49.573184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 494/960] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:38:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:49.574692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67f2dc-7b90-4cb2-a583-3a8785e9446d None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:49.574984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67f2dc-7b90-4cb2-a583-3a8785e9446d None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:49.575272 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67f2dc-7b90-4cb2-a583-3a8785e9446d None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:49.576641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 495/961] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:49.577653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67f2dc-7b90-4cb2-a583-3a8785e9446d None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:49.586953 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:49.602288 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdaa626-4ad2-481c-924e-386b48a9bc56 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:49.636608 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8213928-4da9-4408-afb3-0d22bea3d632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:49.637269 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8213928-4da9-4408-afb3-0d22bea3d632 None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:49.637550 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8213928-4da9-4408-afb3-0d22bea3d632 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:49.637826 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8213928-4da9-4408-afb3-0d22bea3d632 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:49.638587 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8213928-4da9-4408-afb3-0d22bea3d632 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:49.639946 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8213928-4da9-4408-afb3-0d22bea3d632 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:49.659128 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 467/962] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jun 23 15:38:49 2022] POST /identity/v3/endpoints => generated 349 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:38:49.670125 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8213928-4da9-4408-afb3-0d22bea3d632 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:49.691029 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67f2dc-7b90-4cb2-a583-3a8785e9446d None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:49.738823 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156d637-35e4-4386-a56d-2c51901c20e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:49.740141 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156d637-35e4-4386-a56d-2c51901c20e6 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:49.740440 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156d637-35e4-4386-a56d-2c51901c20e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:49.740730 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156d637-35e4-4386-a56d-2c51901c20e6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:49.741771 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156d637-35e4-4386-a56d-2c51901c20e6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:49.743303 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156d637-35e4-4386-a56d-2c51901c20e6 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:49.757299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-c156d637-35e4-4386-a56d-2c51901c20e6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 15:38:49.757299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:49.757299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:38:49.757299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:38:49.757299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:38:49.757299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:38:49.757299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:38:49.757299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:49.757299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 15:38:49.757299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:49.757299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:38:49.757299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:49.757299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:49.757299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:49.757299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:49.757299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:49.757299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:49.758677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:49.758677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:49.758677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:49.758677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:49.758677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:49.758677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:49.758677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:38:49.758677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:38:49.758677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:38:49.758677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:38:49.758677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:49.758677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:49.758677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:49.758677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:49.758677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:49.758677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:49.759535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:49.759535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:49.759535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:49.759535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:49.759535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:49.759535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:49.759535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:49.759535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:49.759535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:49.759535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:49.759535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:38:49.759535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:49.759535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 15:38:49.759535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:49.759535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 496/963] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:49.761063 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123c357-a544-4b6f-acce-975314cf1c6b None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:49.761063 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123c357-a544-4b6f-acce-975314cf1c6b None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:49.761063 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123c357-a544-4b6f-acce-975314cf1c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:49.779388 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-7123c357-a544-4b6f-acce-975314cf1c6b None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:49.781227 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-7123c357-a544-4b6f-acce-975314cf1c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:49.798676 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:49.823447 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8213928-4da9-4408-afb3-0d22bea3d632 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:49.861398 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:49.870747 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 497/964] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:38:49.871703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123c357-a544-4b6f-acce-975314cf1c6b None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:49.880447 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd9c7a-0d80-4712-b465-91f46c07a9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:49.881350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd9c7a-0d80-4712-b465-91f46c07a9ea None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:49.881777 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd9c7a-0d80-4712-b465-91f46c07a9ea None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:49.882222 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd9c7a-0d80-4712-b465-91f46c07a9ea None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:49.883206 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd9c7a-0d80-4712-b465-91f46c07a9ea None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:49.883714 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd9c7a-0d80-4712-b465-91f46c07a9ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:49.885611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd9c7a-0d80-4712-b465-91f46c07a9ea None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:49.924494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 468/965] 10.222.0.15 () {56 vars in 1101 bytes} [Thu Jun 23 15:38:49 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:49.925706 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd9c7a-0d80-4712-b465-91f46c07a9ea None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:50.016617 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123c357-a544-4b6f-acce-975314cf1c6b None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:50.051007 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd9c7a-0d80-4712-b465-91f46c07a9ea None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:50.059209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508f758-0fa2-4294-a6ec-5921a21de21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:50.059899 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508f758-0fa2-4294-a6ec-5921a21de21d None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:50.060194 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508f758-0fa2-4294-a6ec-5921a21de21d None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:50.060961 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508f758-0fa2-4294-a6ec-5921a21de21d None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:50.061211 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508f758-0fa2-4294-a6ec-5921a21de21d None admin] RBAC: Adding query filter params (name=compute) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:50.061529 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508f758-0fa2-4294-a6ec-5921a21de21d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:50.063067 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508f758-0fa2-4294-a6ec-5921a21de21d None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:50.069129 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 498/966] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 23 15:38:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:50.078019 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508f758-0fa2-4294-a6ec-5921a21de21d None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:50.098596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e8f45-c6ca-422f-b6b4-e21f3f468238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:50.100595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e8f45-c6ca-422f-b6b4-e21f3f468238 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:50.100595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e8f45-c6ca-422f-b6b4-e21f3f468238 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:50.100595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e8f45-c6ca-422f-b6b4-e21f3f468238 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:50.117289 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e8f45-c6ca-422f-b6b4-e21f3f468238 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:38:50.132448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-ec4e8f45-c6ca-422f-b6b4-e21f3f468238 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 15:38:50.132448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:50.132448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:50.132448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:50.132448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:50.132448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:50.132448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:50.132448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:50.132448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:50.132448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:50.132448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:50.132448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:50.132448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:38:50.132448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:38:50.132448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:38:50.132448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:38:50.133459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:38:50.133459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:38:50.133459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:38:50.133459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:38:50.133459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:50.133459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:50.133459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:50.133459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:50.133459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:50.133459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:50.133459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:50.133459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:50.133459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:50.133459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:50.133459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:50.133459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:50.134419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:50.134419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:50.134419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:50.134419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:50.134419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:38:50.134419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:38:50.134419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:38:50.134419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:38:50.134419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:38:50.134419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:38:50.134419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 15:38:50.134419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:50.135562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 469/967] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Jun 23 15:38:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:50.141529 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e8f45-c6ca-422f-b6b4-e21f3f468238 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:50.145996 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:50.176271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:50.228791 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508f758-0fa2-4294-a6ec-5921a21de21d None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:50.264751 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451da3e5-910b-430d-9ad6-653245145b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:50.265114 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e8f45-c6ca-422f-b6b4-e21f3f468238 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:50.265421 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451da3e5-910b-430d-9ad6-653245145b0e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:50.265709 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451da3e5-910b-430d-9ad6-653245145b0e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:50.266021 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451da3e5-910b-430d-9ad6-653245145b0e None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:50.266861 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451da3e5-910b-430d-9ad6-653245145b0e None admin] RBAC: Adding query filter params (type=compute) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:50.267192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451da3e5-910b-430d-9ad6-653245145b0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:50.268647 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451da3e5-910b-430d-9ad6-653245145b0e None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:50.278202 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 499/968] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 23 15:38:50 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:50.302904 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563860f-f78c-4de5-a4d4-bb612fcf364e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:50.303593 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563860f-f78c-4de5-a4d4-bb612fcf364e None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:50.303876 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563860f-f78c-4de5-a4d4-bb612fcf364e None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:50.304149 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f563860f-f78c-4de5-a4d4-bb612fcf364e None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:50.304937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563860f-f78c-4de5-a4d4-bb612fcf364e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:50.305221 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563860f-f78c-4de5-a4d4-bb612fcf364e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:50.306657 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f563860f-f78c-4de5-a4d4-bb612fcf364e None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:50.316467 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 470/969] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Jun 23 15:38:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:50.322239 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451da3e5-910b-430d-9ad6-653245145b0e None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:50.432250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451da3e5-910b-430d-9ad6-653245145b0e None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:50.458077 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:50.470125 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816af27c-6233-4ebd-8a34-6487c1c6f33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:50.470980 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816af27c-6233-4ebd-8a34-6487c1c6f33e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:50.471267 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816af27c-6233-4ebd-8a34-6487c1c6f33e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:50.471543 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816af27c-6233-4ebd-8a34-6487c1c6f33e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:50.482543 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816af27c-6233-4ebd-8a34-6487c1c6f33e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:50.483986 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816af27c-6233-4ebd-8a34-6487c1c6f33e None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:50.501251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-816af27c-6233-4ebd-8a34-6487c1c6f33e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:50.501251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:50.501251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:50.501251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:50.501251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:50.501251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:50.501251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:50.501251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:50.501251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:50.501251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:50.501251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:50.501251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:50.501251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:50.501251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:50.501251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:50.502363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:50.502363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:50.502363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:50.502363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:50.502363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:50.502363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:50.502363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:50.502363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:50.502363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:50.502363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:50.502363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:50.502363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:50.502363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:50.502363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:50.502363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:50.502363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:50.502363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:50.507861 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:50.507861 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:50.507861 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:50.507861 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:50.507861 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 500/970] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:50.509696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563860f-f78c-4de5-a4d4-bb612fcf364e None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:50.579313 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:50.619253 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f563860f-f78c-4de5-a4d4-bb612fcf364e None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:50.654511 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b13b4b-8a3e-4a92-833f-c3f9fdb8489e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:50.655174 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b13b4b-8a3e-4a92-833f-c3f9fdb8489e None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:50.655462 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b13b4b-8a3e-4a92-833f-c3f9fdb8489e None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:50.655737 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b13b4b-8a3e-4a92-833f-c3f9fdb8489e None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:50.656755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b13b4b-8a3e-4a92-833f-c3f9fdb8489e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:50.657066 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b13b4b-8a3e-4a92-833f-c3f9fdb8489e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:50.658439 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b13b4b-8a3e-4a92-833f-c3f9fdb8489e None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:50.673927 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 471/971] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:50.676221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816af27c-6233-4ebd-8a34-6487c1c6f33e None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:50.779761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816af27c-6233-4ebd-8a34-6487c1c6f33e None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:50.814496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447ee1c-5590-492a-97c9-b54a3882511e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:50.815320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447ee1c-5590-492a-97c9-b54a3882511e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:50.815609 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447ee1c-5590-492a-97c9-b54a3882511e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:50.815892 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447ee1c-5590-492a-97c9-b54a3882511e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:50.823614 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447ee1c-5590-492a-97c9-b54a3882511e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:50.825661 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447ee1c-5590-492a-97c9-b54a3882511e None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:50.842867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-0447ee1c-5590-492a-97c9-b54a3882511e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 15:38:50.842867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:50.842867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:50.842867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:50.842867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:50.842867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:50.842867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:50.842867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:50.842867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:50.842867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:50.842867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:50.842867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:50.842867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:38:50.842867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:38:50.842867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:38:50.842867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:38:50.843863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:50.843863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:50.843863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:38:50.843863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:50.843863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:38:50.843863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:38:50.843863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:50.843863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:50.843863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:50.843863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:50.843863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:50.843863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:50.843863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:50.843863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:50.843863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:50.843863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:50.843863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:50.843863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:50.844803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:50.844803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:50.844803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:38:50.844803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:38:50.844803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:38:50.844803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:38:50.844803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:38:50.844803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:38:50.844803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 15:38:50.844803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:50.844803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 501/972] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jun 23 15:38:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:50.849892 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b13b4b-8a3e-4a92-833f-c3f9fdb8489e None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:50.953791 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b13b4b-8a3e-4a92-833f-c3f9fdb8489e None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:50.978526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:50.990978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e34f3-f00f-4798-a4c6-52007c9643da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:50.991648 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e34f3-f00f-4798-a4c6-52007c9643da None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:50.991929 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e34f3-f00f-4798-a4c6-52007c9643da None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:50.992201 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e34f3-f00f-4798-a4c6-52007c9643da None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:50.993036 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e34f3-f00f-4798-a4c6-52007c9643da None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:50.993341 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e34f3-f00f-4798-a4c6-52007c9643da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:50.994778 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e34f3-f00f-4798-a4c6-52007c9643da None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:51.012430 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 472/973] 10.222.0.15 () {56 vars in 1149 bytes} [Thu Jun 23 15:38:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:51.017949 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447ee1c-5590-492a-97c9-b54a3882511e None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:51.054157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:51.119376 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447ee1c-5590-492a-97c9-b54a3882511e None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:51.153609 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261d515-16b6-45a6-bcf0-5d9573fc579d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:51.154303 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261d515-16b6-45a6-bcf0-5d9573fc579d None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:51.154586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261d515-16b6-45a6-bcf0-5d9573fc579d None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:51.154863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261d515-16b6-45a6-bcf0-5d9573fc579d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:51.229519 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261d515-16b6-45a6-bcf0-5d9573fc579d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:51.231568 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261d515-16b6-45a6-bcf0-5d9573fc579d None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:51.269975 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:51.356166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 502/974] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:38:51 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 15:38:51.361764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e34f3-f00f-4798-a4c6-52007c9643da None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:51.478366 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e34f3-f00f-4798-a4c6-52007c9643da None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:51.515441 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f34e63-449b-4706-b2bd-7151da91aa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:51.516253 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f34e63-449b-4706-b2bd-7151da91aa37 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:51.516540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f34e63-449b-4706-b2bd-7151da91aa37 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:51.516817 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f34e63-449b-4706-b2bd-7151da91aa37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:51.528785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f34e63-449b-4706-b2bd-7151da91aa37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:51.530274 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f34e63-449b-4706-b2bd-7151da91aa37 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:51.550789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-25f34e63-449b-4706-b2bd-7151da91aa37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:51.550789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:51.550789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:51.550789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:51.550789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:51.550789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:51.550789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:51.550789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:51.550789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:51.550789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:51.550789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:51.550789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:51.550789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:38:51.550789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:38:51.550789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:38:51.552012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:38:51.552012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:51.552012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:51.552012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:51.552012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:51.552012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:51.552012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:51.552012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:51.552012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:51.552012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:51.552012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:51.552012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:51.552012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:51.552012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:51.552012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:51.552012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:51.552012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:51.553175 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:38:51.553175 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:38:51.553175 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:38:51.553175 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:51.554560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 473/975] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:51.560595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261d515-16b6-45a6-bcf0-5d9573fc579d None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:51.665712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261d515-16b6-45a6-bcf0-5d9573fc579d None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:51.700162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa53f7a-7712-4681-ae4b-db8c960d7f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:51.700829 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa53f7a-7712-4681-ae4b-db8c960d7f83 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:51.701113 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa53f7a-7712-4681-ae4b-db8c960d7f83 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:51.701388 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa53f7a-7712-4681-ae4b-db8c960d7f83 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:51.702142 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa53f7a-7712-4681-ae4b-db8c960d7f83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:51.702460 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa53f7a-7712-4681-ae4b-db8c960d7f83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:51.703819 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa53f7a-7712-4681-ae4b-db8c960d7f83 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:51.706245 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:51.716949 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 503/976] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:51.722693 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f34e63-449b-4706-b2bd-7151da91aa37 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:51.757477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:51.784323 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e523e4-2572-44cc-8dc2-cb702aa48cd0 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:51.784825 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e523e4-2572-44cc-8dc2-cb702aa48cd0 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:51.785248 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e523e4-2572-44cc-8dc2-cb702aa48cd0 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:51.787667 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 504/977] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:51.794647 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689afe98-0a11-4755-8b5f-7d66b7ae12a9 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:51.794935 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689afe98-0a11-4755-8b5f-7d66b7ae12a9 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:51.795218 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689afe98-0a11-4755-8b5f-7d66b7ae12a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:51.814809 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-689afe98-0a11-4755-8b5f-7d66b7ae12a9 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:51.816008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-689afe98-0a11-4755-8b5f-7d66b7ae12a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:51.835624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f34e63-449b-4706-b2bd-7151da91aa37 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:51.878380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc98dc-700c-4053-9233-34e7eeecb470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:51.879198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc98dc-700c-4053-9233-34e7eeecb470 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:51.879484 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc98dc-700c-4053-9233-34e7eeecb470 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:51.879752 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc98dc-700c-4053-9233-34e7eeecb470 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:51.888487 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc98dc-700c-4053-9233-34e7eeecb470 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:51.889983 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 505/978] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:38:51.890101 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc98dc-700c-4053-9233-34e7eeecb470 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:51.909180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-9abc98dc-700c-4053-9233-34e7eeecb470 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:51.909180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:51.909180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:51.909180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:51.909180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:51.909180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:51.909180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:51.909180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:51.909180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:51.909180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:51.909180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:51.909180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:51.909180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:38:51.909180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:38:51.909180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:38:51.910155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:38:51.910155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:51.910155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:51.910155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:51.910155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:51.910155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:51.910155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:51.910155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:51.910155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:51.910155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:51.910155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:51.910155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:51.910155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:51.910155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:51.910155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:51.910155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:51.910155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:51.911066 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:38:51.911066 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:38:51.911066 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:38:51.911066 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:38:51.911066 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:38:51.911066 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:38:51.911066 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:38:51.911066 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:51.911066 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 474/979] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:51.914807 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689afe98-0a11-4755-8b5f-7d66b7ae12a9 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:51.916157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc98dc-700c-4053-9233-34e7eeecb470 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:52.020163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:52.028718 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc98dc-700c-4053-9233-34e7eeecb470 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:52.030010 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689afe98-0a11-4755-8b5f-7d66b7ae12a9 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:52.059753 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:52.067813 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbd1e6-763c-4da0-baa5-1ed1aa769ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:52.068479 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbd1e6-763c-4da0-baa5-1ed1aa769ff1 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:52.068763 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbd1e6-763c-4da0-baa5-1ed1aa769ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:52.069039 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbd1e6-763c-4da0-baa5-1ed1aa769ff1 None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:52.069341 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81bc08-27d3-4283-9758-98cfed21a779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:52.069829 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbd1e6-763c-4da0-baa5-1ed1aa769ff1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:52.070168 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbd1e6-763c-4da0-baa5-1ed1aa769ff1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:52.070279 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81bc08-27d3-4283-9758-98cfed21a779 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:52.070519 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81bc08-27d3-4283-9758-98cfed21a779 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:52.070804 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81bc08-27d3-4283-9758-98cfed21a779 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:52.071466 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81bc08-27d3-4283-9758-98cfed21a779 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:52.071570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbd1e6-763c-4da0-baa5-1ed1aa769ff1 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:52.072818 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d81bc08-27d3-4283-9758-98cfed21a779 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:52.085196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 475/980] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:38:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:52.086775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-6d81bc08-27d3-4283-9758-98cfed21a779 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 15:38:52.086775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:52.086775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:38:52.086775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:38:52.086775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:38:52.086775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:38:52.086775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:38:52.086775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:52.086775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 15:38:52.086775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:52.086775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:38:52.086775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:52.086775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:52.086775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:52.086775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:52.086775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:52.086775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:52.087735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:52.087735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:52.087735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:52.087735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:52.087735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:52.087735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:52.087735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:38:52.087735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:38:52.087735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:38:52.087735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:38:52.087735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:52.087735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:52.087735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:52.087735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:52.087735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:52.087735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:52.088573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:52.088573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:52.088573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:52.088573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:52.088573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:52.088573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:52.088573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:52.088573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:52.088573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:52.088573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:52.088573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:38:52.088573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:52.088573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 15:38:52.088573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:52.090000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 506/981] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jun 23 15:38:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:52.093757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81bc08-27d3-4283-9758-98cfed21a779 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:52.093929 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbd1e6-763c-4da0-baa5-1ed1aa769ff1 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:52.203179 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbd1e6-763c-4da0-baa5-1ed1aa769ff1 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:52.204495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81bc08-27d3-4283-9758-98cfed21a779 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:52.239247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e886a8b-b4a7-4cea-990c-6e90b714166f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:52.239916 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e886a8b-b4a7-4cea-990c-6e90b714166f None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:52.240204 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e886a8b-b4a7-4cea-990c-6e90b714166f None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:52.240480 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e886a8b-b4a7-4cea-990c-6e90b714166f None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:52.241188 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e886a8b-b4a7-4cea-990c-6e90b714166f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:52.241499 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e886a8b-b4a7-4cea-990c-6e90b714166f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:52.241752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67b33c-7c02-45f5-8b25-638697a00d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:52.242445 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67b33c-7c02-45f5-8b25-638697a00d35 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:52.242729 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67b33c-7c02-45f5-8b25-638697a00d35 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:52.243036 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e886a8b-b4a7-4cea-990c-6e90b714166f None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:52.243133 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67b33c-7c02-45f5-8b25-638697a00d35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:52.243891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67b33c-7c02-45f5-8b25-638697a00d35 None admin] RBAC: Adding query filter params (role.id=678724a2168946df8b6b36e91bf83b1a, scope.project.id=ff90b874f5b84d28a2752bc95419ad95, user.id=dbf2c12174e94e2db9be178973183ced) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:52.244226 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67b33c-7c02-45f5-8b25-638697a00d35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:52.245900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67b33c-7c02-45f5-8b25-638697a00d35 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:52.248763 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 476/982] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jun 23 15:38:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:52.254215 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e886a8b-b4a7-4cea-990c-6e90b714166f None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:52.262239 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 507/983] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:38:52 2022] GET /identity/v3/role_assignments?user.id=dbf2c12174e94e2db9be178973183ced&scope.project.id=ff90b874f5b84d28a2752bc95419ad95&role.id=678724a2168946df8b6b36e91bf83b1a => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:52.275681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:52.354970 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491da86e-16c8-411c-9e5b-d06d516232fd None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:52.355268 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491da86e-16c8-411c-9e5b-d06d516232fd None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:52.355554 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491da86e-16c8-411c-9e5b-d06d516232fd None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:52.357132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 508/984] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:38:52.362741 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c4f09-69f9-4b23-86f5-a79ff28d70ae None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:52.363049 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c4f09-69f9-4b23-86f5-a79ff28d70ae None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:52.363308 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c4f09-69f9-4b23-86f5-a79ff28d70ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:52.373659 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e886a8b-b4a7-4cea-990c-6e90b714166f None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:52.381868 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-147c4f09-69f9-4b23-86f5-a79ff28d70ae None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:52.383174 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-147c4f09-69f9-4b23-86f5-a79ff28d70ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:52.414286 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4aefd-14d4-4437-afcc-42da3339334c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:52.414999 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4aefd-14d4-4437-afcc-42da3339334c None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:52.415286 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4aefd-14d4-4437-afcc-42da3339334c None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:52.415568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4aefd-14d4-4437-afcc-42da3339334c None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:52.416285 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4aefd-14d4-4437-afcc-42da3339334c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:52.416601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4aefd-14d4-4437-afcc-42da3339334c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:52.418080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4aefd-14d4-4437-afcc-42da3339334c None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:52.424281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 477/985] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jun 23 15:38:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:52.430486 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4aefd-14d4-4437-afcc-42da3339334c None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:52.446206 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:52.471378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 509/986] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 15:38:52.495271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c4f09-69f9-4b23-86f5-a79ff28d70ae None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:52.529883 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:52.553976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4aefd-14d4-4437-afcc-42da3339334c None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:52.594511 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b526ad8-4912-4b97-b3bc-79c23a7039b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:52.595197 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b526ad8-4912-4b97-b3bc-79c23a7039b8 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:52.595491 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b526ad8-4912-4b97-b3bc-79c23a7039b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:52.595773 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b526ad8-4912-4b97-b3bc-79c23a7039b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:52.596605 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b526ad8-4912-4b97-b3bc-79c23a7039b8 None admin] RBAC: Adding query filter params (interface=admin, service_id=ae21ce996de7445c93813b24440c0627, region_id=RegionOne) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:52.596928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b526ad8-4912-4b97-b3bc-79c23a7039b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:52.598384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b526ad8-4912-4b97-b3bc-79c23a7039b8 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:52.604471 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 478/987] 10.222.0.15 () {56 vars in 1249 bytes} [Thu Jun 23 15:38:52 2022] GET /identity/v3/endpoints?service_id=ae21ce996de7445c93813b24440c0627&interface=admin®ion_id=RegionOne => generated 193 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:52.610765 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b526ad8-4912-4b97-b3bc-79c23a7039b8 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:52.629303 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c4f09-69f9-4b23-86f5-a79ff28d70ae None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:52.669560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c650ae-f62a-424f-a9aa-592c4739c269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:52.670298 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c650ae-f62a-424f-a9aa-592c4739c269 None admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:52.670587 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c650ae-f62a-424f-a9aa-592c4739c269 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:52.670867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c650ae-f62a-424f-a9aa-592c4739c269 None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:52.671631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c650ae-f62a-424f-a9aa-592c4739c269 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:52.673008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c650ae-f62a-424f-a9aa-592c4739c269 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:52.689418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 510/988] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 23 15:38:52 2022] POST /identity/v3/services => generated 242 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:38:52.750785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b526ad8-4912-4b97-b3bc-79c23a7039b8 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:52.796253 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff665b0-278c-446b-8a29-7584711a6681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:52.796932 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff665b0-278c-446b-8a29-7584711a6681 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:52.797218 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff665b0-278c-446b-8a29-7584711a6681 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:52.797494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff665b0-278c-446b-8a29-7584711a6681 None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:52.798210 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff665b0-278c-446b-8a29-7584711a6681 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:52.799588 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff665b0-278c-446b-8a29-7584711a6681 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:52.813919 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 479/989] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jun 23 15:38:52 2022] GET /identity/v3/services => generated 1727 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 15:38:54.358989 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acf32b-e23b-4988-b547-ee800aef1b9b None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:54.359530 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acf32b-e23b-4988-b547-ee800aef1b9b None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:54.359530 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acf32b-e23b-4988-b547-ee800aef1b9b None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:54.361071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 511/990] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:54.366111 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efd7ab-b161-41ed-8dc8-7c17f83d2220 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:54.366543 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efd7ab-b161-41ed-8dc8-7c17f83d2220 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:54.366708 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efd7ab-b161-41ed-8dc8-7c17f83d2220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:54.378202 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:54.384264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-48efd7ab-b161-41ed-8dc8-7c17f83d2220 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:54.385447 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-48efd7ab-b161-41ed-8dc8-7c17f83d2220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:54.455338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 480/991] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:38:54.477241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acf32b-e23b-4988-b547-ee800aef1b9b None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:54.525743 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:54.590540 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acf32b-e23b-4988-b547-ee800aef1b9b None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:54.628272 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5f419-4957-4556-9b88-66426744521e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:54.628977 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5f419-4957-4556-9b88-66426744521e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:54.629263 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5f419-4957-4556-9b88-66426744521e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:54.629541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5f419-4957-4556-9b88-66426744521e None admin] PATH_INFO: `/v3/services/image` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:54.630229 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5f419-4957-4556-9b88-66426744521e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:54.631602 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d5f419-4957-4556-9b88-66426744521e None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:54.643159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-68d5f419-4957-4556-9b88-66426744521e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 15:38:54.643159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:54.643159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:38:54.643159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:38:54.643159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:38:54.643159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:38:54.643159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:38:54.643159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:54.643159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 15:38:54.643159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:54.643159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:38:54.643159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:54.643159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:54.643159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:54.643159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:54.643159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:54.643159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:54.644158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:54.644158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:54.644158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:54.644158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:54.644158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:54.644158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:54.644158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:38:54.644158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:38:54.644158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:38:54.644158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:38:54.644158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:54.644158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:54.644158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:54.644158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:54.644158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:54.644158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:54.644988 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:54.644988 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:54.644988 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:54.644988 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:54.644988 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:54.644988 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:54.644988 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:54.644988 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:54.644988 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:54.644988 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:54.644988 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:38:54.644988 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:54.644988 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 15:38:54.644988 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:54.649243 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 512/992] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Jun 23 15:38:54 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:54.650490 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efd7ab-b161-41ed-8dc8-7c17f83d2220 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:54.755212 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bec30f-dd08-4d6c-9263-e8ad30b01da6 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:54.755407 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efd7ab-b161-41ed-8dc8-7c17f83d2220 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:54.755522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bec30f-dd08-4d6c-9263-e8ad30b01da6 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:54.755761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bec30f-dd08-4d6c-9263-e8ad30b01da6 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:54.757245 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 513/993] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:38:54.762032 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4057c5f-cf49-4aa6-8096-d9346bb7d1ac None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:54.762322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4057c5f-cf49-4aa6-8096-d9346bb7d1ac None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:54.762598 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4057c5f-cf49-4aa6-8096-d9346bb7d1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:54.779929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-d4057c5f-cf49-4aa6-8096-d9346bb7d1ac None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:54.783608 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-d4057c5f-cf49-4aa6-8096-d9346bb7d1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:54.799831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab1015-e360-42f9-b3ee-5572bdfe6c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:54.800500 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab1015-e360-42f9-b3ee-5572bdfe6c51 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:54.800780 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab1015-e360-42f9-b3ee-5572bdfe6c51 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:54.801053 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab1015-e360-42f9-b3ee-5572bdfe6c51 None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:54.801764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab1015-e360-42f9-b3ee-5572bdfe6c51 None admin] RBAC: Adding query filter params (name=image) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:54.802100 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab1015-e360-42f9-b3ee-5572bdfe6c51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:54.803477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab1015-e360-42f9-b3ee-5572bdfe6c51 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:54.816056 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 481/994] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:54.816056 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:54.817531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab1015-e360-42f9-b3ee-5572bdfe6c51 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:54.863241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 514/995] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 15:38:54.882854 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd148d68-c2de-4baf-ae1b-a181caaf3b57 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:54.883068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd148d68-c2de-4baf-ae1b-a181caaf3b57 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:54.883357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd148d68-c2de-4baf-ae1b-a181caaf3b57 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:54.884805 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 515/996] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:38:54.885515 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd148d68-c2de-4baf-ae1b-a181caaf3b57 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:54.927157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:54.935862 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab1015-e360-42f9-b3ee-5572bdfe6c51 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:54.972813 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a1f44-960e-487c-99be-32c9424e8fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:54.973774 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a1f44-960e-487c-99be-32c9424e8fe5 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:54.974196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a1f44-960e-487c-99be-32c9424e8fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:54.974568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a1f44-960e-487c-99be-32c9424e8fe5 None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:54.975588 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a1f44-960e-487c-99be-32c9424e8fe5 None admin] RBAC: Adding query filter params (type=image) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:54.976052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a1f44-960e-487c-99be-32c9424e8fe5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:54.977906 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a1f44-960e-487c-99be-32c9424e8fe5 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:54.984428 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 482/997] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:54 2022] GET /identity/v3/services?type=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:54.986048 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b7c0f-946f-40ec-9427-3dd3a89d9915 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:54.986485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b7c0f-946f-40ec-9427-3dd3a89d9915 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:54.986863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298b7c0f-946f-40ec-9427-3dd3a89d9915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:54.987969 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd148d68-c2de-4baf-ae1b-a181caaf3b57 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:55.010138 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-298b7c0f-946f-40ec-9427-3dd3a89d9915 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:55.012533 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-298b7c0f-946f-40ec-9427-3dd3a89d9915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:55.029196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168fa76-87c1-493e-a39e-226255577901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:55.030168 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168fa76-87c1-493e-a39e-226255577901 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:55.030461 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168fa76-87c1-493e-a39e-226255577901 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:55.031113 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168fa76-87c1-493e-a39e-226255577901 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:55.031802 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168fa76-87c1-493e-a39e-226255577901 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:55.033228 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c168fa76-87c1-493e-a39e-226255577901 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:55.046947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-c168fa76-87c1-493e-a39e-226255577901 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 15:38:55.046947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:55.046947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:38:55.046947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:38:55.046947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:38:55.046947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:38:55.046947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:38:55.046947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:55.046947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 15:38:55.046947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:55.046947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:38:55.046947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:55.046947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:55.046947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:55.046947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:55.046947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:55.046947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:55.048011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:55.048011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:55.048011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:55.048011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:55.048011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:55.048011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:55.048011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:38:55.048011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:38:55.048011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:38:55.048011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:38:55.048011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:55.048011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:55.048011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:55.048011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:55.048011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:55.048011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:55.048838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:55.048838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:55.048838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:55.048838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:55.048838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:55.048838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:55.048838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:55.048838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:55.048838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:55.048838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:55.048838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:38:55.048838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:55.048838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 15:38:55.048838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:55.048838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 516/998] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:55.054520 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168fa76-87c1-493e-a39e-226255577901 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:55.084522 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:55.095500 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 483/999] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:38:55.119990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b7c0f-946f-40ec-9427-3dd3a89d9915 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:55.177832 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168fa76-87c1-493e-a39e-226255577901 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:55.179642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:55.216613 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be0bd5-1de4-41b2-a12b-b5e9453d8e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:55.217283 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be0bd5-1de4-41b2-a12b-b5e9453d8e19 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:55.217572 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be0bd5-1de4-41b2-a12b-b5e9453d8e19 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:55.217877 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be0bd5-1de4-41b2-a12b-b5e9453d8e19 None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:55.218593 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be0bd5-1de4-41b2-a12b-b5e9453d8e19 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:55.218913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be0bd5-1de4-41b2-a12b-b5e9453d8e19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:55.220307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be0bd5-1de4-41b2-a12b-b5e9453d8e19 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:55.225336 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 517/1000] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 23 15:38:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:55.231070 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be0bd5-1de4-41b2-a12b-b5e9453d8e19 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:55.242721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298b7c0f-946f-40ec-9427-3dd3a89d9915 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:55.284766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98904dd-1459-419b-a3c8-e53a51fdf87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:55.285581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98904dd-1459-419b-a3c8-e53a51fdf87c None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:55.285894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98904dd-1459-419b-a3c8-e53a51fdf87c None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:55.286177 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98904dd-1459-419b-a3c8-e53a51fdf87c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:55.286901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98904dd-1459-419b-a3c8-e53a51fdf87c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:55.288315 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98904dd-1459-419b-a3c8-e53a51fdf87c None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:55.300558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-e98904dd-1459-419b-a3c8-e53a51fdf87c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 15:38:55.300558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:55.300558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:38:55.300558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:38:55.300558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:38:55.300558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:38:55.300558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:38:55.300558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:55.300558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 15:38:55.300558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:55.300558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:38:55.300558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:55.300558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:55.300558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:55.300558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:55.300558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:55.300558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:55.301557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:55.301557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:55.301557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:55.301557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:55.301557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:55.301557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:55.301557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:38:55.301557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:38:55.301557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:38:55.301557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:38:55.301557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:55.301557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:55.301557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:55.301557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:55.301557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:55.301557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:55.302411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:55.302411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:55.302411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:55.302411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:55.302411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:55.302411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:55.302411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:55.302411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:55.302411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:55.302411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:55.302411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:38:55.302411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:55.302411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 15:38:55.302411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:38:55.302411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 484/1001] 10.222.0.15 () {56 vars in 1126 bytes} [Thu Jun 23 15:38:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:38:55.307476 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98904dd-1459-419b-a3c8-e53a51fdf87c None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:55.348074 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be0bd5-1de4-41b2-a12b-b5e9453d8e19 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:55.369244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:55.391559 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1f21c-0f3c-4c49-b3fe-d794b1c269a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:55.392330 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1f21c-0f3c-4c49-b3fe-d794b1c269a8 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:55.392674 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1f21c-0f3c-4c49-b3fe-d794b1c269a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:55.393042 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1f21c-0f3c-4c49-b3fe-d794b1c269a8 None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:55.394056 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1f21c-0f3c-4c49-b3fe-d794b1c269a8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:55.394416 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1f21c-0f3c-4c49-b3fe-d794b1c269a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:55.396199 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df1f21c-0f3c-4c49-b3fe-d794b1c269a8 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:55.407781 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 518/1002] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 23 15:38:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:55.410984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1f21c-0f3c-4c49-b3fe-d794b1c269a8 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:55.420562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98904dd-1459-419b-a3c8-e53a51fdf87c None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:55.445614 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:55.460718 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df42e23-2e32-43f6-af53-154ecfafa61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:55.461451 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df42e23-2e32-43f6-af53-154ecfafa61e None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:55.461765 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df42e23-2e32-43f6-af53-154ecfafa61e None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:55.462102 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df42e23-2e32-43f6-af53-154ecfafa61e None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:55.462911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df42e23-2e32-43f6-af53-154ecfafa61e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:55.463250 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df42e23-2e32-43f6-af53-154ecfafa61e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:55.464752 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df42e23-2e32-43f6-af53-154ecfafa61e None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:55.470653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 485/1003] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jun 23 15:38:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:55.477156 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df42e23-2e32-43f6-af53-154ecfafa61e None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:55.529183 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1f21c-0f3c-4c49-b3fe-d794b1c269a8 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:55.574546 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1698e12-13ab-4e1a-9e14-527289d99481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:55.575759 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1698e12-13ab-4e1a-9e14-527289d99481 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:55.576092 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1698e12-13ab-4e1a-9e14-527289d99481 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:55.576421 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1698e12-13ab-4e1a-9e14-527289d99481 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:55.577790 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1698e12-13ab-4e1a-9e14-527289d99481 None admin] RBAC: Adding query filter params (interface=public, service_id=4592788a83474e9b9b9cd681e117f26b, region_id=RegionOne) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:55.578516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1698e12-13ab-4e1a-9e14-527289d99481 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:55.580111 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1698e12-13ab-4e1a-9e14-527289d99481 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:55.586425 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 519/1004] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Jun 23 15:38:55 2022] GET /identity/v3/endpoints?service_id=4592788a83474e9b9b9cd681e117f26b&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:55.591841 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1698e12-13ab-4e1a-9e14-527289d99481 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:55.600123 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df42e23-2e32-43f6-af53-154ecfafa61e None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:55.630604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:55.643919 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6675a1a-7ea4-4498-ac0d-c7e53529e706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:55.644593 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6675a1a-7ea4-4498-ac0d-c7e53529e706 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:55.644881 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6675a1a-7ea4-4498-ac0d-c7e53529e706 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:55.645160 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6675a1a-7ea4-4498-ac0d-c7e53529e706 None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:55.645899 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6675a1a-7ea4-4498-ac0d-c7e53529e706 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:55.646235 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6675a1a-7ea4-4498-ac0d-c7e53529e706 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:55.647608 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6675a1a-7ea4-4498-ac0d-c7e53529e706 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:55.657891 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 486/1005] 10.222.0.15 () {56 vars in 1122 bytes} [Thu Jun 23 15:38:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:55.659587 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6675a1a-7ea4-4498-ac0d-c7e53529e706 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:55.714564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:55.722866 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1698e12-13ab-4e1a-9e14-527289d99481 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:55.765325 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81535bf-c4e5-4bb3-998e-cfd92695f1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:55.766116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81535bf-c4e5-4bb3-998e-cfd92695f1a5 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:55.766406 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81535bf-c4e5-4bb3-998e-cfd92695f1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:55.766714 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81535bf-c4e5-4bb3-998e-cfd92695f1a5 None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:55.767434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81535bf-c4e5-4bb3-998e-cfd92695f1a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:55.769061 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81535bf-c4e5-4bb3-998e-cfd92695f1a5 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:55.771559 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6675a1a-7ea4-4498-ac0d-c7e53529e706 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:55.776156 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 520/1006] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jun 23 15:38:55 2022] GET /identity/v3/services => generated 1727 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 15:38:55.808733 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5e3f58-aaf4-4391-b7dd-c19f7cd81e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:55.809418 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e3f58-aaf4-4391-b7dd-c19f7cd81e47 None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:55.809709 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e3f58-aaf4-4391-b7dd-c19f7cd81e47 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:55.810031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5e3f58-aaf4-4391-b7dd-c19f7cd81e47 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:55.810780 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e3f58-aaf4-4391-b7dd-c19f7cd81e47 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:55.819585 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5e3f58-aaf4-4391-b7dd-c19f7cd81e47 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:55.845888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 487/1007] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jun 23 15:38:55 2022] POST /identity/v3/endpoints => generated 325 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:38:57.028675 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fe578-1461-4885-9155-149fb573d6de None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:57.029202 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fe578-1461-4885-9155-149fb573d6de None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:57.029202 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fe578-1461-4885-9155-149fb573d6de None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:57.030751 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 521/1008] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:57.035877 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e48e4-1f97-4c85-96fb-f021288b6692 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:57.036255 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e48e4-1f97-4c85-96fb-f021288b6692 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:57.036439 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e48e4-1f97-4c85-96fb-f021288b6692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:57.053501 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-b95e48e4-1f97-4c85-96fb-f021288b6692 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:57.054780 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-b95e48e4-1f97-4c85-96fb-f021288b6692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:57.100478 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:57.133061 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 488/1009] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:57 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:38:57.156291 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fe578-1461-4885-9155-149fb573d6de None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:57.283479 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fe578-1461-4885-9155-149fb573d6de None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:57.319946 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a8d71-57b9-47d6-b477-695984ee9c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:57.320616 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a8d71-57b9-47d6-b477-695984ee9c4d None admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:57.320899 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a8d71-57b9-47d6-b477-695984ee9c4d None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:57.321175 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a8d71-57b9-47d6-b477-695984ee9c4d None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:57.321935 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a8d71-57b9-47d6-b477-695984ee9c4d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:57.323301 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a8d71-57b9-47d6-b477-695984ee9c4d None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:57.344355 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 522/1010] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 23 15:38:57 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:38:57.895791 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6447a-65c5-4671-a41f-7af4a3ea449c None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:57.896143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6447a-65c5-4671-a41f-7af4a3ea449c None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:57.896324 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6447a-65c5-4671-a41f-7af4a3ea449c None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:57.896508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0061f3-21d2-4280-aff2-6f42a40050f3 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:57.896778 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0061f3-21d2-4280-aff2-6f42a40050f3 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:57.897060 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0061f3-21d2-4280-aff2-6f42a40050f3 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:57.897891 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 489/1011] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:38:57.898550 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 523/1012] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:57.903129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a12627-2b66-49d7-b240-2d8f5e243f63 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:57.904846 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a12627-2b66-49d7-b240-2d8f5e243f63 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:57.905471 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab7283-1bc7-4b9c-860f-3f88c2ed5ad3 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:57.907221 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a12627-2b66-49d7-b240-2d8f5e243f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:57.907375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab7283-1bc7-4b9c-860f-3f88c2ed5ad3 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:57.907375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab7283-1bc7-4b9c-860f-3f88c2ed5ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:57.921535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-25ab7283-1bc7-4b9c-860f-3f88c2ed5ad3 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:57.922050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-34a12627-2b66-49d7-b240-2d8f5e243f63 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:57.922746 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-25ab7283-1bc7-4b9c-860f-3f88c2ed5ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:57.923267 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-34a12627-2b66-49d7-b240-2d8f5e243f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:57.938618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:58.005743 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 524/1013] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:57 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 15:38:58.007004 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 490/1014] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:57 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 15:38:58.025578 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab7283-1bc7-4b9c-860f-3f88c2ed5ad3 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:58.029014 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a12627-2b66-49d7-b240-2d8f5e243f63 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:58.126498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:58.130622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab7283-1bc7-4b9c-860f-3f88c2ed5ad3 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:58.131782 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a12627-2b66-49d7-b240-2d8f5e243f63 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:58.168090 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d87251-eedc-4035-9567-919fddd749db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:58.168809 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d87251-eedc-4035-9567-919fddd749db None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:58.169080 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a8885-57be-4d93-a97c-2b35f28f2395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:58.169281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d87251-eedc-4035-9567-919fddd749db None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:58.169360 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d87251-eedc-4035-9567-919fddd749db None admin] PATH_INFO: `/v3/domains/default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:58.169900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a8885-57be-4d93-a97c-2b35f28f2395 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:58.170179 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a8885-57be-4d93-a97c-2b35f28f2395 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:58.170457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a8885-57be-4d93-a97c-2b35f28f2395 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:58.170566 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d87251-eedc-4035-9567-919fddd749db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:58.171111 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a8885-57be-4d93-a97c-2b35f28f2395 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:58.171931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d87251-eedc-4035-9567-919fddd749db None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:58.172455 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a8885-57be-4d93-a97c-2b35f28f2395 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:58.178007 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 491/1015] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:58.179444 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d87251-eedc-4035-9567-919fddd749db None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:58.188555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-3b2a8885-57be-4d93-a97c-2b35f28f2395 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 15:38:58.188555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:58.188555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:38:58.188555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:38:58.188555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:38:58.188555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:38:58.188555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:38:58.188555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:58.188555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 15:38:58.188555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:58.188555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:38:58.188555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:58.188555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:58.188555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:58.188555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:58.188555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:58.188555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:58.189560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:58.189560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:58.189560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:58.189560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:58.189560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:58.189560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:58.189560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:38:58.189560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:38:58.189560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:38:58.189560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:38:58.189560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:58.189560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:58.189560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:58.189560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:58.189560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:58.189560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:58.190463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:58.190463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:58.190463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:58.190463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:58.190463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:58.190463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:58.190463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:58.190463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:58.190463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:58.190463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:58.190463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:38:58.190463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:58.190463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 15:38:58.190463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:58.194628 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 525/1016] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:38:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:58.195650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a8885-57be-4d93-a97c-2b35f28f2395 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:58.207767 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:58.287179 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d87251-eedc-4035-9567-919fddd749db None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:58.301000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a8885-57be-4d93-a97c-2b35f28f2395 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:58.324057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4dffeb-4b0c-4a78-9e70-68f2b5850292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:58.324731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dffeb-4b0c-4a78-9e70-68f2b5850292 None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:58.325018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dffeb-4b0c-4a78-9e70-68f2b5850292 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:58.325303 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dffeb-4b0c-4a78-9e70-68f2b5850292 None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:58.326155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4dffeb-4b0c-4a78-9e70-68f2b5850292 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:58.327707 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4dffeb-4b0c-4a78-9e70-68f2b5850292 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:58.334147 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d95aa-9d5e-452c-8665-53ca2cca32c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:58.334813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d95aa-9d5e-452c-8665-53ca2cca32c1 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:58.335101 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d95aa-9d5e-452c-8665-53ca2cca32c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:58.335380 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d95aa-9d5e-452c-8665-53ca2cca32c1 None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:58.336089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d95aa-9d5e-452c-8665-53ca2cca32c1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:58.336401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d95aa-9d5e-452c-8665-53ca2cca32c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:58.337770 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d95aa-9d5e-452c-8665-53ca2cca32c1 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:58.343267 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 526/1017] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 23 15:38:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:58.348934 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d95aa-9d5e-452c-8665-53ca2cca32c1 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:58.362256 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 492/1018] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 23 15:38:58 2022] POST /identity/v3/projects => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:38:58.425657 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:58.463387 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d95aa-9d5e-452c-8665-53ca2cca32c1 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:58.502920 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b42094-4dd4-4f98-9901-61fea946a1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:58.503602 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b42094-4dd4-4f98-9901-61fea946a1d2 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:58.503892 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b42094-4dd4-4f98-9901-61fea946a1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:58.504176 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b42094-4dd4-4f98-9901-61fea946a1d2 None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:58.504905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b42094-4dd4-4f98-9901-61fea946a1d2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:58.505221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b42094-4dd4-4f98-9901-61fea946a1d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:58.506714 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b42094-4dd4-4f98-9901-61fea946a1d2 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:58.518065 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 527/1019] 10.222.0.15 () {56 vars in 1112 bytes} [Thu Jun 23 15:38:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:38:58.518758 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4dffeb-4b0c-4a78-9e70-68f2b5850292 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:58.541279 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:58.630449 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4dffeb-4b0c-4a78-9e70-68f2b5850292 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:58.665250 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54314b-0778-40fb-8f59-8851cb7bafb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:58.665934 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54314b-0778-40fb-8f59-8851cb7bafb3 None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:58.666224 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54314b-0778-40fb-8f59-8851cb7bafb3 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:58.666503 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54314b-0778-40fb-8f59-8851cb7bafb3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:58.667262 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54314b-0778-40fb-8f59-8851cb7bafb3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:58.668613 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54314b-0778-40fb-8f59-8851cb7bafb3 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:58.689403 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 493/1020] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jun 23 15:38:58 2022] POST /identity/v3/endpoints => generated 334 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:38:59.442995 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3dafc4-7f28-4138-82a2-46434d0a13e7 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:59.443555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3dafc4-7f28-4138-82a2-46434d0a13e7 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:59.443555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3dafc4-7f28-4138-82a2-46434d0a13e7 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:59.444962 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 528/1021] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:38:59.450022 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0317747-7c20-4a54-8cc1-17091e8b273c None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:59.450435 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0317747-7c20-4a54-8cc1-17091e8b273c None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:59.450676 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0317747-7c20-4a54-8cc1-17091e8b273c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:59.471672 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-a0317747-7c20-4a54-8cc1-17091e8b273c None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:38:59.472969 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-a0317747-7c20-4a54-8cc1-17091e8b273c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:38:59.549968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:59.562176 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 494/1022] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:38:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:38:59.580804 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3dafc4-7f28-4138-82a2-46434d0a13e7 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:59.687395 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3dafc4-7f28-4138-82a2-46434d0a13e7 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:59.722168 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688947f2-d6bd-4500-a3b7-7b097aed6789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:59.722965 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688947f2-d6bd-4500-a3b7-7b097aed6789 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:59.723249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688947f2-d6bd-4500-a3b7-7b097aed6789 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:59.723526 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688947f2-d6bd-4500-a3b7-7b097aed6789 None admin] PATH_INFO: `/v3/services/image` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:59.724180 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688947f2-d6bd-4500-a3b7-7b097aed6789 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:59.725539 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688947f2-d6bd-4500-a3b7-7b097aed6789 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:59.728181 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:38:59.738756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-688947f2-d6bd-4500-a3b7-7b097aed6789 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 15:38:59.738756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:59.738756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:38:59.738756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:38:59.738756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:38:59.738756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:38:59.738756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:38:59.738756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:59.738756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 15:38:59.738756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:59.738756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:38:59.738756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:59.738756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:38:59.738756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:38:59.738756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:38:59.738756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:38:59.738756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:38:59.739749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:38:59.739749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:38:59.739749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:38:59.739749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:38:59.739749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:38:59.739749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:38:59.739749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:38:59.739749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:38:59.739749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:38:59.739749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:38:59.739749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:38:59.739749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:38:59.739749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:38:59.739749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:38:59.739749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:38:59.739749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:38:59.740595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:38:59.740595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:38:59.740595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:38:59.740595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:38:59.740595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:38:59.740595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:38:59.740595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:38:59.740595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:38:59.740595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:38:59.740595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:38:59.740595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:38:59.740595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:38:59.740595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 15:38:59.740595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:38:59.744905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 529/1023] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Jun 23 15:38:59 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:38:59.746177 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0317747-7c20-4a54-8cc1-17091e8b273c None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:38:59.846415 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0317747-7c20-4a54-8cc1-17091e8b273c None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:38:59.881683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f27c4-feae-491e-9198-cc81fc20c7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:38:59.882405 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f27c4-feae-491e-9198-cc81fc20c7e2 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:38:59.882690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f27c4-feae-491e-9198-cc81fc20c7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:38:59.882967 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f27c4-feae-491e-9198-cc81fc20c7e2 None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:38:59.883703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f27c4-feae-491e-9198-cc81fc20c7e2 None admin] RBAC: Adding query filter params (name=image) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:38:59.884013 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f27c4-feae-491e-9198-cc81fc20c7e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:38:59.885438 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f27c4-feae-491e-9198-cc81fc20c7e2 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:38:59.896473 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 495/1024] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:38:59.897842 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688947f2-d6bd-4500-a3b7-7b097aed6789 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:00.005182 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688947f2-d6bd-4500-a3b7-7b097aed6789 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:00.041173 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea03869-00b4-4d40-8991-c0375aa8053d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:00.041837 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea03869-00b4-4d40-8991-c0375aa8053d None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:00.042180 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea03869-00b4-4d40-8991-c0375aa8053d None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:00.043049 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea03869-00b4-4d40-8991-c0375aa8053d None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:00.043758 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea03869-00b4-4d40-8991-c0375aa8053d None admin] RBAC: Adding query filter params (type=image) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:00.044063 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea03869-00b4-4d40-8991-c0375aa8053d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:00.045423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea03869-00b4-4d40-8991-c0375aa8053d None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:00.050738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 530/1025] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:38:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:00.056370 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f27c4-feae-491e-9198-cc81fc20c7e2 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:00.120713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:00.159490 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f27c4-feae-491e-9198-cc81fc20c7e2 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:00.194276 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d7862-b1c3-416b-9660-e36aa8524b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:00.194926 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d7862-b1c3-416b-9660-e36aa8524b6d None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:00.195208 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d7862-b1c3-416b-9660-e36aa8524b6d None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:00.195475 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d7862-b1c3-416b-9660-e36aa8524b6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:00.196259 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d7862-b1c3-416b-9660-e36aa8524b6d None admin] RBAC: Adding query filter params (interface=public, service_id=4a2807c8e2b14dd5a926958729bece77, region_id=RegionOne) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:00.196566 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d7862-b1c3-416b-9660-e36aa8524b6d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:00.197926 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d7862-b1c3-416b-9660-e36aa8524b6d None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:00.203049 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 496/1026] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Jun 23 15:39:00 2022] GET /identity/v3/endpoints?service_id=4a2807c8e2b14dd5a926958729bece77&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:00.208309 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea03869-00b4-4d40-8991-c0375aa8053d None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:00.270609 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:00.311150 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea03869-00b4-4d40-8991-c0375aa8053d None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:00.345652 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08637e-2e86-41a2-9b92-4f0b86ff7139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:00.346352 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08637e-2e86-41a2-9b92-4f0b86ff7139 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:00.346631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08637e-2e86-41a2-9b92-4f0b86ff7139 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:00.346909 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08637e-2e86-41a2-9b92-4f0b86ff7139 None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:00.347591 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08637e-2e86-41a2-9b92-4f0b86ff7139 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:00.348955 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08637e-2e86-41a2-9b92-4f0b86ff7139 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:00.355872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 531/1027] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jun 23 15:39:00 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:39:00.480769 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007f3f8-4c9b-4ab1-8283-1a66ce0dce58 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:00.481405 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007f3f8-4c9b-4ab1-8283-1a66ce0dce58 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:00.481405 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007f3f8-4c9b-4ab1-8283-1a66ce0dce58 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:00.482925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 497/1028] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:39:00.488646 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9d8aa-f161-49f9-bece-d2ed85124867 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:00.489172 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9d8aa-f161-49f9-bece-d2ed85124867 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:00.489277 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9d8aa-f161-49f9-bece-d2ed85124867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:00.507562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-17a9d8aa-f161-49f9-bece-d2ed85124867 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:39:00.508772 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-17a9d8aa-f161-49f9-bece-d2ed85124867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:39:00.589897 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 532/1029] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:39:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:39:00.613905 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007f3f8-4c9b-4ab1-8283-1a66ce0dce58 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:00.722064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007f3f8-4c9b-4ab1-8283-1a66ce0dce58 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:00.749538 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:00.759815 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614c097-f25e-465b-a215-07f04d2a5f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:00.760800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614c097-f25e-465b-a215-07f04d2a5f50 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:00.761271 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614c097-f25e-465b-a215-07f04d2a5f50 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:00.762232 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614c097-f25e-465b-a215-07f04d2a5f50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:00.763553 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0614c097-f25e-465b-a215-07f04d2a5f50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:00.765120 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0614c097-f25e-465b-a215-07f04d2a5f50 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:00.766990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 498/1030] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:39:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:00.773369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9d8aa-f161-49f9-bece-d2ed85124867 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:00.834136 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ce180-a46b-4e06-835e-fc8050508b56 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:00.834316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:00.834412 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ce180-a46b-4e06-835e-fc8050508b56 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:00.834412 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ce180-a46b-4e06-835e-fc8050508b56 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:00.836122 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 499/1031] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:39:00.841048 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500dec8-d19f-40d7-bda5-db6ef48b14cc None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:00.841427 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500dec8-d19f-40d7-bda5-db6ef48b14cc None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:00.841592 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500dec8-d19f-40d7-bda5-db6ef48b14cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:00.860049 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-1500dec8-d19f-40d7-bda5-db6ef48b14cc None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:39:00.861233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-1500dec8-d19f-40d7-bda5-db6ef48b14cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:39:00.886874 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9d8aa-f161-49f9-bece-d2ed85124867 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:00.924925 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14639c11-e8d8-440c-b630-3628f9be281b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:00.925834 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14639c11-e8d8-440c-b630-3628f9be281b None admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:00.926295 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14639c11-e8d8-440c-b630-3628f9be281b None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:00.926744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14639c11-e8d8-440c-b630-3628f9be281b None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:00.927627 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14639c11-e8d8-440c-b630-3628f9be281b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:00.929055 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14639c11-e8d8-440c-b630-3628f9be281b None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:00.934201 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 500/1032] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:39:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 15:39:00.954361 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 533/1033] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 23 15:39:00 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:39:00.963320 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500dec8-d19f-40d7-bda5-db6ef48b14cc None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:01.087730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500dec8-d19f-40d7-bda5-db6ef48b14cc None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:01.120957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:01.132620 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd9098-5d4c-4939-8c3f-6fb946a85121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:01.133476 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd9098-5d4c-4939-8c3f-6fb946a85121 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:01.134032 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd9098-5d4c-4939-8c3f-6fb946a85121 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:01.134143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd9098-5d4c-4939-8c3f-6fb946a85121 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:01.146916 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd9098-5d4c-4939-8c3f-6fb946a85121 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:39:01.155568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-5bfd9098-5d4c-4939-8c3f-6fb946a85121 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 15:39:01.155568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:01.155568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:01.155568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:01.155568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:01.155568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:01.155568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:01.155568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:01.155568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:01.155568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:01.155568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:01.155568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:01.155568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:39:01.155568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:39:01.155568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:39:01.155568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:39:01.157302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:39:01.157302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:39:01.157302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:39:01.157302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:39:01.157302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:01.157302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:01.157302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:01.157302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:01.157302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:01.157302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:01.157302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:01.157302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:01.157302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:01.157302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:01.157302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:01.157302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:01.158681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:01.158681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:01.158681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:01.158681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:01.158681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:39:01.158681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:39:01.158681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:39:01.158681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:39:01.158681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:39:01.158681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:39:01.158681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 15:39:01.158681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:39:01.158681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 501/1034] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Jun 23 15:39:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:39:01.165227 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14639c11-e8d8-440c-b630-3628f9be281b None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:01.283636 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14639c11-e8d8-440c-b630-3628f9be281b None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:01.298966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:01.322331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfe042-84f0-4379-a2b2-1e392eea37e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:01.323010 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfe042-84f0-4379-a2b2-1e392eea37e0 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:01.323297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfe042-84f0-4379-a2b2-1e392eea37e0 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:01.324109 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfe042-84f0-4379-a2b2-1e392eea37e0 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:01.324889 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfe042-84f0-4379-a2b2-1e392eea37e0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:01.325236 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfe042-84f0-4379-a2b2-1e392eea37e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:01.326592 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfe042-84f0-4379-a2b2-1e392eea37e0 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:01.335258 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 534/1035] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Jun 23 15:39:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:01.341440 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd9098-5d4c-4939-8c3f-6fb946a85121 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:01.454010 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd9098-5d4c-4939-8c3f-6fb946a85121 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:01.491693 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603a64e-6e60-48f7-a136-caad54236543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:01.492611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603a64e-6e60-48f7-a136-caad54236543 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:01.492939 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603a64e-6e60-48f7-a136-caad54236543 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:01.493217 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603a64e-6e60-48f7-a136-caad54236543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:01.509316 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603a64e-6e60-48f7-a136-caad54236543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:01.510788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603a64e-6e60-48f7-a136-caad54236543 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:01.529515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-4603a64e-6e60-48f7-a136-caad54236543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:39:01.529515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:01.529515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:01.529515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:01.529515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:01.529515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:01.529515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:01.529515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:01.529515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:01.529515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:01.529515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:01.529515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:01.529515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:39:01.529515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:39:01.529515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:39:01.530726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:39:01.530726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:01.530726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:01.530726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:01.530726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:01.530726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:01.530726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:01.530726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:01.530726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:01.530726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:01.530726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:01.530726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:01.530726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:01.530726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:01.530726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:01.530726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:01.530726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:01.531866 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:39:01.531866 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:39:01.531866 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:39:01.531866 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:39:01.531866 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 502/1036] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:39:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:39:01.536939 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfe042-84f0-4379-a2b2-1e392eea37e0 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:01.648619 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfe042-84f0-4379-a2b2-1e392eea37e0 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:01.685251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6e2db-f3f4-4ce2-a0eb-299ac93fa788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:01.686080 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6e2db-f3f4-4ce2-a0eb-299ac93fa788 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:01.686377 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6e2db-f3f4-4ce2-a0eb-299ac93fa788 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:01.686659 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6e2db-f3f4-4ce2-a0eb-299ac93fa788 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:01.687387 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6e2db-f3f4-4ce2-a0eb-299ac93fa788 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:01.687698 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6e2db-f3f4-4ce2-a0eb-299ac93fa788 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:01.689062 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6e2db-f3f4-4ce2-a0eb-299ac93fa788 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:01.701789 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 535/1037] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:01.709088 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603a64e-6e60-48f7-a136-caad54236543 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:01.762771 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:01.847708 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603a64e-6e60-48f7-a136-caad54236543 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:01.894396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c88d2f-e9b9-4720-8e35-7cef677cdfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:01.895548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c88d2f-e9b9-4720-8e35-7cef677cdfea None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:01.895968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c88d2f-e9b9-4720-8e35-7cef677cdfea None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:01.896379 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c88d2f-e9b9-4720-8e35-7cef677cdfea None admin] PATH_INFO: `/v3/users/nova` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:01.908159 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c88d2f-e9b9-4720-8e35-7cef677cdfea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:01.910380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c88d2f-e9b9-4720-8e35-7cef677cdfea None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:01.932006 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-85c88d2f-e9b9-4720-8e35-7cef677cdfea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 15:39:01.932006 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:01.932006 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:01.932006 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:01.932006 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:01.932006 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:01.932006 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:01.932006 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:01.932006 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:01.932006 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:01.932006 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:01.932006 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:01.932006 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:39:01.932006 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:39:01.932006 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:39:01.932006 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:39:01.933281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:01.933281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:01.933281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:39:01.933281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:39:01.933281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:39:01.933281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:39:01.933281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:01.933281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:01.933281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:01.933281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:01.933281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:01.933281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:01.933281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:01.933281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:01.933281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:01.933281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:01.933281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:01.933281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:01.935777 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:01.935777 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:01.935777 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:39:01.935777 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:39:01.935777 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:39:01.935777 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:39:01.935777 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:39:01.935777 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:39:01.935777 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 15:39:01.935777 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:39:01.937975 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 503/1038] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jun 23 15:39:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:39:01.940181 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6e2db-f3f4-4ce2-a0eb-299ac93fa788 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:01.989907 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:02.062347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6e2db-f3f4-4ce2-a0eb-299ac93fa788 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:02.099512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d283256-6861-4f08-9314-4ec70ba7a23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:02.100190 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d283256-6861-4f08-9314-4ec70ba7a23e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:02.100476 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d283256-6861-4f08-9314-4ec70ba7a23e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:02.100751 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d283256-6861-4f08-9314-4ec70ba7a23e None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:02.101662 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d283256-6861-4f08-9314-4ec70ba7a23e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:02.102138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d283256-6861-4f08-9314-4ec70ba7a23e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:02.103761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d283256-6861-4f08-9314-4ec70ba7a23e None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:02.131914 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 536/1039] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jun 23 15:39:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:02.138178 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c88d2f-e9b9-4720-8e35-7cef677cdfea None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:02.246518 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:02.252362 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c88d2f-e9b9-4720-8e35-7cef677cdfea None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:02.294141 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3f5de-719f-4e1a-83e4-c6674cf655cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:02.294853 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3f5de-719f-4e1a-83e4-c6674cf655cb None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:02.295140 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3f5de-719f-4e1a-83e4-c6674cf655cb None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:02.295472 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3f5de-719f-4e1a-83e4-c6674cf655cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:02.364411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3f5de-719f-4e1a-83e4-c6674cf655cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:02.365839 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3f5de-719f-4e1a-83e4-c6674cf655cb None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:02.441292 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81488ab-ac34-4998-91a9-e03e71414bc3 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:02.441694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81488ab-ac34-4998-91a9-e03e71414bc3 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:02.441912 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81488ab-ac34-4998-91a9-e03e71414bc3 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:02.443575 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 537/1040] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:39:02.448480 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4cf71-3308-46dd-bb01-0831b1061b27 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:02.449281 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4cf71-3308-46dd-bb01-0831b1061b27 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:02.449560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4cf71-3308-46dd-bb01-0831b1061b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:02.466501 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:02.467527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-79b4cf71-3308-46dd-bb01-0831b1061b27 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:39:02.468723 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-79b4cf71-3308-46dd-bb01-0831b1061b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:39:02.476176 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 504/1041] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:39:02 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 15:39:02.482621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3f5de-719f-4e1a-83e4-c6674cf655cb None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:02.570503 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 538/1042] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:39:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 15:39:02.584500 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4cf71-3308-46dd-bb01-0831b1061b27 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:02.602703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3f5de-719f-4e1a-83e4-c6674cf655cb None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:02.614351 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:02.644158 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeac36-f491-4426-bb11-8f68bb201aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:02.644954 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeac36-f491-4426-bb11-8f68bb201aed None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:02.645239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeac36-f491-4426-bb11-8f68bb201aed None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:02.645520 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeac36-f491-4426-bb11-8f68bb201aed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:02.658125 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eeac36-f491-4426-bb11-8f68bb201aed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:02.659589 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eeac36-f491-4426-bb11-8f68bb201aed None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:02.678990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-e3eeac36-f491-4426-bb11-8f68bb201aed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:39:02.678990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:02.678990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:02.678990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:02.678990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:02.678990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:02.678990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:02.678990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:02.678990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:02.678990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:02.678990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:02.678990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:02.678990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:39:02.678990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:39:02.678990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:39:02.679955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:39:02.679955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:02.679955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:02.679955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:02.679955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:02.679955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:02.679955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:02.679955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:02.679955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:02.679955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:02.679955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:02.679955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:02.679955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:02.679955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:02.679955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:02.679955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:02.679955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:02.680926 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:39:02.680926 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:39:02.680926 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:39:02.680926 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:39:02.680926 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 505/1043] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:39:02.686527 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeac36-f491-4426-bb11-8f68bb201aed None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:02.712898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4cf71-3308-46dd-bb01-0831b1061b27 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:02.739859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:02.754447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab670fc6-437a-42fd-a987-d122b140c807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:02.755278 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab670fc6-437a-42fd-a987-d122b140c807 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:02.755604 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab670fc6-437a-42fd-a987-d122b140c807 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:02.755922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab670fc6-437a-42fd-a987-d122b140c807 None admin] PATH_INFO: `/v3/services/image` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:02.756623 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab670fc6-437a-42fd-a987-d122b140c807 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:02.758163 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab670fc6-437a-42fd-a987-d122b140c807 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:02.770482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-ab670fc6-437a-42fd-a987-d122b140c807 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 15:39:02.770482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:02.770482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:39:02.770482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:39:02.770482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:39:02.770482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:39:02.770482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:39:02.770482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:39:02.770482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 15:39:02.770482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:39:02.770482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:39:02.770482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:39:02.770482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:02.770482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:02.770482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:02.770482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:02.770482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:02.771749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:02.771749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:02.771749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:02.771749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:02.771749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:02.771749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:02.771749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:39:02.771749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:39:02.771749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:39:02.771749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:39:02.771749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:02.771749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:02.771749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:02.771749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:02.771749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:02.771749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:02.772622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:02.772622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:02.772622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:02.772622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:02.772622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:02.772622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:02.772622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:02.772622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:02.772622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:02.772622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:02.772622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:39:02.772622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:39:02.772622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 15:39:02.772622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:39:02.772622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 539/1044] 10.222.0.15 () {56 vars in 1105 bytes} [Thu Jun 23 15:39:02 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:39:02.778629 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab670fc6-437a-42fd-a987-d122b140c807 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:02.802099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeac36-f491-4426-bb11-8f68bb201aed None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:02.841233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d422658-0c39-461f-a284-e7f0dfabe8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:02.841944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d422658-0c39-461f-a284-e7f0dfabe8b3 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:02.842295 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d422658-0c39-461f-a284-e7f0dfabe8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:02.842581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d422658-0c39-461f-a284-e7f0dfabe8b3 None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:02.843303 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d422658-0c39-461f-a284-e7f0dfabe8b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:02.843607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d422658-0c39-461f-a284-e7f0dfabe8b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:02.844969 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d422658-0c39-461f-a284-e7f0dfabe8b3 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:02.856708 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 506/1045] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:39:02.862253 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d422658-0c39-461f-a284-e7f0dfabe8b3 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:02.890212 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:02.906700 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab670fc6-437a-42fd-a987-d122b140c807 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:02.946119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc670c-0102-4d23-8701-abf521578015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:02.946917 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc670c-0102-4d23-8701-abf521578015 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:02.947207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc670c-0102-4d23-8701-abf521578015 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:02.947631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc670c-0102-4d23-8701-abf521578015 None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:02.948510 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc670c-0102-4d23-8701-abf521578015 None admin] RBAC: Adding query filter params (name=image) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:02.948856 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc670c-0102-4d23-8701-abf521578015 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:02.950452 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc670c-0102-4d23-8701-abf521578015 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:02.960568 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 540/1046] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:39:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:39:02.961663 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc670c-0102-4d23-8701-abf521578015 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:02.971833 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d422658-0c39-461f-a284-e7f0dfabe8b3 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:02.984100 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:03.019508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b53ac6-8093-4346-a1a7-4626075daa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:03.020303 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b53ac6-8093-4346-a1a7-4626075daa05 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:03.020600 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b53ac6-8093-4346-a1a7-4626075daa05 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:03.020873 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b53ac6-8093-4346-a1a7-4626075daa05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:03.029211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b53ac6-8093-4346-a1a7-4626075daa05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:03.030693 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b53ac6-8093-4346-a1a7-4626075daa05 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:03.047653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-13b53ac6-8093-4346-a1a7-4626075daa05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:39:03.047653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:03.047653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:03.047653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:03.047653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:03.047653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:03.047653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:03.047653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:03.047653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:03.047653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:03.047653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:03.047653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:03.047653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:39:03.047653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:39:03.047653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:39:03.048615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:39:03.048615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:03.048615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:03.048615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:03.048615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:03.048615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:03.048615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:03.048615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:03.048615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:03.048615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:03.048615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:03.048615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:03.048615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:03.048615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:03.048615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:03.048615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:03.048615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:03.049526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:39:03.049526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:39:03.049526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:39:03.049526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:39:03.049526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:39:03.049526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:39:03.049526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:39:03.049526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:39:03.049526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 507/1047] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:39:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:39:03.054630 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b53ac6-8093-4346-a1a7-4626075daa05 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:03.086735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc670c-0102-4d23-8701-abf521578015 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:03.127768 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6b4da-30e1-47fe-91f6-0c6530d02a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:03.128361 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6b4da-30e1-47fe-91f6-0c6530d02a8a None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:03.128643 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6b4da-30e1-47fe-91f6-0c6530d02a8a None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:03.129002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6b4da-30e1-47fe-91f6-0c6530d02a8a None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:03.129687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6b4da-30e1-47fe-91f6-0c6530d02a8a None admin] RBAC: Adding query filter params (type=image) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:03.130099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6b4da-30e1-47fe-91f6-0c6530d02a8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:03.131504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6b4da-30e1-47fe-91f6-0c6530d02a8a None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:03.137168 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 541/1048] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:39:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:03.138457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6012ee-a52a-4403-99f6-65737ddbbec5 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:03.138742 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6012ee-a52a-4403-99f6-65737ddbbec5 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:03.139019 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6012ee-a52a-4403-99f6-65737ddbbec5 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:03.140244 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 542/1049] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:39:03.142974 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6012ee-a52a-4403-99f6-65737ddbbec5 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:03.161366 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b53ac6-8093-4346-a1a7-4626075daa05 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:03.162221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:03.197280 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884eecf-6f2e-4066-9ed2-5fe8c132afc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:03.197960 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884eecf-6f2e-4066-9ed2-5fe8c132afc4 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:03.198377 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884eecf-6f2e-4066-9ed2-5fe8c132afc4 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:03.199203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884eecf-6f2e-4066-9ed2-5fe8c132afc4 None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:03.200088 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884eecf-6f2e-4066-9ed2-5fe8c132afc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:03.200403 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884eecf-6f2e-4066-9ed2-5fe8c132afc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:03.201915 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884eecf-6f2e-4066-9ed2-5fe8c132afc4 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:03.213648 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 508/1050] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:39:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:39:03.214972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fd162-67f3-41e8-9246-bb08f19e87b5 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:03.215269 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fd162-67f3-41e8-9246-bb08f19e87b5 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:03.215546 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fd162-67f3-41e8-9246-bb08f19e87b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:03.233937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-a02fd162-67f3-41e8-9246-bb08f19e87b5 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:39:03.235140 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-a02fd162-67f3-41e8-9246-bb08f19e87b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:39:03.256191 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6012ee-a52a-4403-99f6-65737ddbbec5 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:03.258918 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:03.291036 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95a405-77d0-4d2a-853a-2f8727aac6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:03.291701 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95a405-77d0-4d2a-853a-2f8727aac6c1 None admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:03.291982 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95a405-77d0-4d2a-853a-2f8727aac6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:03.292775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95a405-77d0-4d2a-853a-2f8727aac6c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:03.293511 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95a405-77d0-4d2a-853a-2f8727aac6c1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:03.294913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95a405-77d0-4d2a-853a-2f8727aac6c1 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:03.302644 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 509/1051] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:39:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:39:03.303488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02fd162-67f3-41e8-9246-bb08f19e87b5 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:03.326846 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 543/1052] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jun 23 15:39:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:39:03.327967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95a405-77d0-4d2a-853a-2f8727aac6c1 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:03.420284 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:03.434137 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02fd162-67f3-41e8-9246-bb08f19e87b5 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:03.471421 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95a405-77d0-4d2a-853a-2f8727aac6c1 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:03.477450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b100a-c217-4a25-9862-05319f32cbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:03.478232 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b100a-c217-4a25-9862-05319f32cbca None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:03.478513 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b100a-c217-4a25-9862-05319f32cbca None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:03.478790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b100a-c217-4a25-9862-05319f32cbca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:03.479663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b100a-c217-4a25-9862-05319f32cbca None admin] RBAC: Adding query filter params (role.id=678724a2168946df8b6b36e91bf83b1a, scope.project.id=ff90b874f5b84d28a2752bc95419ad95, user.id=d54521ea1dca44c98d6723d0b9fd6468) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:03.479980 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b100a-c217-4a25-9862-05319f32cbca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:03.481421 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b100a-c217-4a25-9862-05319f32cbca None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:03.487691 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 510/1053] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:39:03 2022] GET /identity/v3/role_assignments?user.id=d54521ea1dca44c98d6723d0b9fd6468&scope.project.id=ff90b874f5b84d28a2752bc95419ad95&role.id=678724a2168946df8b6b36e91bf83b1a => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:03.514559 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca50ca3-2b49-4e44-920b-6b4d2afdad8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:03.515367 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca50ca3-2b49-4e44-920b-6b4d2afdad8e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:03.515945 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca50ca3-2b49-4e44-920b-6b4d2afdad8e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:03.515945 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca50ca3-2b49-4e44-920b-6b4d2afdad8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:03.530123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca50ca3-2b49-4e44-920b-6b4d2afdad8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:39:03.538241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-dca50ca3-2b49-4e44-920b-6b4d2afdad8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:39:03.538241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:03.538241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:03.538241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:03.538241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:03.538241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:03.538241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:03.538241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:03.538241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:03.538241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:03.538241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:03.538241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:03.538241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:39:03.538241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:39:03.538241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:39:03.538241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:39:03.539307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:39:03.539307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:39:03.539307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:39:03.539307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:39:03.539307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:03.539307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:03.539307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:03.539307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:03.539307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:03.539307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:03.539307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:03.539307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:03.539307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:03.539307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:03.539307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:03.539307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:03.540309 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:03.540309 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:03.540309 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:03.540309 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:03.540309 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:39:03.540309 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:39:03.540309 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:39:03.540309 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:39:03.540309 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:39:03.540309 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:39:03.540309 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:39:03.540309 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:39:03.540309 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 544/1054] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:39:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:39:03.548198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b100a-c217-4a25-9862-05319f32cbca None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:03.585396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:03.669862 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b100a-c217-4a25-9862-05319f32cbca None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:03.705003 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42a2c1-3ead-4cbe-9815-fc80fe062b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:03.705688 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42a2c1-3ead-4cbe-9815-fc80fe062b03 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:03.706004 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42a2c1-3ead-4cbe-9815-fc80fe062b03 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:03.706285 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a42a2c1-3ead-4cbe-9815-fc80fe062b03 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:03.707034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42a2c1-3ead-4cbe-9815-fc80fe062b03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:03.707344 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42a2c1-3ead-4cbe-9815-fc80fe062b03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:03.708708 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a42a2c1-3ead-4cbe-9815-fc80fe062b03 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:03.718693 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 511/1055] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:39:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:03.724271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca50ca3-2b49-4e44-920b-6b4d2afdad8e None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:03.843049 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca50ca3-2b49-4e44-920b-6b4d2afdad8e None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:03.871793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:03.884190 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73348ca3-19d2-4276-8ebe-da780544fd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:03.885085 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73348ca3-19d2-4276-8ebe-da780544fd59 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:03.885371 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73348ca3-19d2-4276-8ebe-da780544fd59 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:03.885646 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73348ca3-19d2-4276-8ebe-da780544fd59 None admin] PATH_INFO: `/v3/users/bfebe8c2aa4e4185915d6ca7d5f30ddc` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:03.900909 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73348ca3-19d2-4276-8ebe-da780544fd59 None admin] RBAC: Authorizing `identity:get_user(user_id=bfebe8c2aa4e4185915d6ca7d5f30ddc)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:03.902403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73348ca3-19d2-4276-8ebe-da780544fd59 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:03.904305 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 545/1056] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:39:03 2022] GET /identity/v3/users/bfebe8c2aa4e4185915d6ca7d5f30ddc => generated 285 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:03.910277 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42a2c1-3ead-4cbe-9815-fc80fe062b03 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:03.998724 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:04.016404 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a42a2c1-3ead-4cbe-9815-fc80fe062b03 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:04.051125 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ea14e-e320-44fe-979d-2379cf320708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:04.051785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ea14e-e320-44fe-979d-2379cf320708 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:04.052070 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ea14e-e320-44fe-979d-2379cf320708 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:04.052347 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ea14e-e320-44fe-979d-2379cf320708 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:04.121971 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ea14e-e320-44fe-979d-2379cf320708 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:04.123423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ea14e-e320-44fe-979d-2379cf320708 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:04.217449 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:04.235222 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 512/1057] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:39:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 15:39:04.240998 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73348ca3-19d2-4276-8ebe-da780544fd59 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:04.346721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73348ca3-19d2-4276-8ebe-da780544fd59 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:04.382442 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2863d-786e-4aa8-879d-8762a25e6ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:04.383369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2863d-786e-4aa8-879d-8762a25e6ca0 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:04.383701 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2863d-786e-4aa8-879d-8762a25e6ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:04.383986 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2863d-786e-4aa8-879d-8762a25e6ca0 None admin] PATH_INFO: `/v3/projects/6bed94190a4149c8a6f97afe5cc88d87` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:04.385261 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2863d-786e-4aa8-879d-8762a25e6ca0 None admin] RBAC: Authorizing `identity:get_project(project_id=6bed94190a4149c8a6f97afe5cc88d87)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:04.387361 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2863d-786e-4aa8-879d-8762a25e6ca0 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:04.394019 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 546/1058] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:39:04 2022] GET /identity/v3/projects/6bed94190a4149c8a6f97afe5cc88d87 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:04.395756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ea14e-e320-44fe-979d-2379cf320708 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:04.500376 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ea14e-e320-44fe-979d-2379cf320708 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:04.535060 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9e6fb-3f5f-4518-90af-cd7fbf70b4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:04.535732 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9e6fb-3f5f-4518-90af-cd7fbf70b4a5 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:04.536023 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9e6fb-3f5f-4518-90af-cd7fbf70b4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:04.536304 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9e6fb-3f5f-4518-90af-cd7fbf70b4a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:04.537175 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9e6fb-3f5f-4518-90af-cd7fbf70b4a5 None admin] RBAC: Adding query filter params (role.id=abdc0e0957534149b3653eaa33cbd054, scope.project.id=6bed94190a4149c8a6f97afe5cc88d87, user.id=bfebe8c2aa4e4185915d6ca7d5f30ddc) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:04.537494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9e6fb-3f5f-4518-90af-cd7fbf70b4a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:04.541240 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9e6fb-3f5f-4518-90af-cd7fbf70b4a5 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:04.558212 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 513/1059] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:39:04 2022] GET /identity/v3/role_assignments?user.id=bfebe8c2aa4e4185915d6ca7d5f30ddc&scope.project.id=6bed94190a4149c8a6f97afe5cc88d87&role.id=abdc0e0957534149b3653eaa33cbd054 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:05.612899 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1bdb3-4c09-4b91-bdb2-4aae56395e01 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:05.613454 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1bdb3-4c09-4b91-bdb2-4aae56395e01 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:05.613454 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c1bdb3-4c09-4b91-bdb2-4aae56395e01 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:05.614898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 547/1060] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:39:05.620418 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd8e57-33e6-4a82-ba9b-4d280e5c68c5 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:05.620850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd8e57-33e6-4a82-ba9b-4d280e5c68c5 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:05.621018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd8e57-33e6-4a82-ba9b-4d280e5c68c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:05.639398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-65dd8e57-33e6-4a82-ba9b-4d280e5c68c5 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:39:05.640592 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-65dd8e57-33e6-4a82-ba9b-4d280e5c68c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:39:05.698936 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:05.723045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 514/1061] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:39:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:39:05.745877 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd8e57-33e6-4a82-ba9b-4d280e5c68c5 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:05.746330 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462f48b-0ef5-4cf8-860f-3f5bb152d869 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:05.746644 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462f48b-0ef5-4cf8-860f-3f5bb152d869 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:05.746948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462f48b-0ef5-4cf8-860f-3f5bb152d869 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:05.748436 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 548/1062] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:39:05.753509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f055c-34a4-46c2-8770-703a5297b503 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:05.754012 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f055c-34a4-46c2-8770-703a5297b503 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:05.754217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f055c-34a4-46c2-8770-703a5297b503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:05.773971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-172f055c-34a4-46c2-8770-703a5297b503 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:39:05.775735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-172f055c-34a4-46c2-8770-703a5297b503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:39:05.837070 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:05.854147 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd8e57-33e6-4a82-ba9b-4d280e5c68c5 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:05.861040 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 549/1063] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:39:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:39:05.880617 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f055c-34a4-46c2-8770-703a5297b503 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:05.891749 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459cac2-3ee4-41ef-85d0-b46bd7994163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:05.892639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459cac2-3ee4-41ef-85d0-b46bd7994163 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:05.892925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459cac2-3ee4-41ef-85d0-b46bd7994163 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:05.893391 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459cac2-3ee4-41ef-85d0-b46bd7994163 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:05.904592 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459cac2-3ee4-41ef-85d0-b46bd7994163 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:39:05.913806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-2459cac2-3ee4-41ef-85d0-b46bd7994163 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 15:39:05.913806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:05.913806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:05.913806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:05.913806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:05.913806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:05.913806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:05.913806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:05.913806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:05.913806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:05.913806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:05.913806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:05.913806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:39:05.913806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:39:05.913806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:39:05.913806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:39:05.914759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:39:05.914759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:39:05.914759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:39:05.914759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:39:05.914759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:05.914759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:05.914759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:05.914759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:05.914759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:05.914759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:05.914759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:05.914759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:05.914759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:05.914759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:05.914759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:05.914759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:05.915572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:05.915572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:05.915572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:05.915572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:05.915572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:39:05.915572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:39:05.915572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:39:05.915572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:39:05.915572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:39:05.915572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:39:05.915572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 15:39:05.915572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:39:05.915572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 515/1064] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Jun 23 15:39:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:39:05.921720 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459cac2-3ee4-41ef-85d0-b46bd7994163 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:05.969617 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:05.988403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f055c-34a4-46c2-8770-703a5297b503 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:06.026202 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09eed3-72fd-4d8b-ba46-2dff72d8976c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:06.027492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09eed3-72fd-4d8b-ba46-2dff72d8976c None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:06.027777 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09eed3-72fd-4d8b-ba46-2dff72d8976c None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:06.028057 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09eed3-72fd-4d8b-ba46-2dff72d8976c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:06.034870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459cac2-3ee4-41ef-85d0-b46bd7994163 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:06.071151 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314abd02-2437-4eef-9227-df93a329e7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:06.071809 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314abd02-2437-4eef-9227-df93a329e7e8 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:06.072091 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314abd02-2437-4eef-9227-df93a329e7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:06.072363 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314abd02-2437-4eef-9227-df93a329e7e8 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:06.073108 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314abd02-2437-4eef-9227-df93a329e7e8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:06.073438 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314abd02-2437-4eef-9227-df93a329e7e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:06.074899 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314abd02-2437-4eef-9227-df93a329e7e8 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:06.085950 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:06.086165 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 516/1065] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Jun 23 15:39:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:06.091065 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314abd02-2437-4eef-9227-df93a329e7e8 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:06.109346 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09eed3-72fd-4d8b-ba46-2dff72d8976c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:06.110881 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09eed3-72fd-4d8b-ba46-2dff72d8976c None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:06.202189 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314abd02-2437-4eef-9227-df93a329e7e8 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:06.204306 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:06.229412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 550/1066] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:39:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 15:39:06.230943 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09eed3-72fd-4d8b-ba46-2dff72d8976c None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:06.243193 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91a14b-445a-4edc-8e22-eb294eca618a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:06.243713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91a14b-445a-4edc-8e22-eb294eca618a None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:06.243994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91a14b-445a-4edc-8e22-eb294eca618a None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:06.244273 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba91a14b-445a-4edc-8e22-eb294eca618a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:06.254603 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91a14b-445a-4edc-8e22-eb294eca618a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:06.256073 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba91a14b-445a-4edc-8e22-eb294eca618a None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:06.274154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-ba91a14b-445a-4edc-8e22-eb294eca618a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:39:06.274154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:06.274154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:06.274154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:06.274154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:06.274154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:06.274154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:06.274154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:06.274154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:06.274154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:06.274154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:06.274154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:06.274154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:39:06.274154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:39:06.274154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:39:06.275310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:39:06.275310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:06.275310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:06.275310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:06.275310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:06.275310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:06.275310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:06.275310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:06.275310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:06.275310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:06.275310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:06.275310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:06.275310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:06.275310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:06.275310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:06.275310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:06.275310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:06.276361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:39:06.276361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:39:06.276361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:39:06.276361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:39:06.276361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 517/1067] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:39:06.281803 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91a14b-445a-4edc-8e22-eb294eca618a None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:06.332613 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:06.351202 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09eed3-72fd-4d8b-ba46-2dff72d8976c None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:06.387093 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23764a3-92e2-4313-9928-17b52dc0f291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:06.387886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23764a3-92e2-4313-9928-17b52dc0f291 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:06.388172 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23764a3-92e2-4313-9928-17b52dc0f291 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:06.388447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23764a3-92e2-4313-9928-17b52dc0f291 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:06.392127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba91a14b-445a-4edc-8e22-eb294eca618a None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:06.399450 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23764a3-92e2-4313-9928-17b52dc0f291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:06.400911 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23764a3-92e2-4313-9928-17b52dc0f291 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:06.420379 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-f23764a3-92e2-4313-9928-17b52dc0f291 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:39:06.420379 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:06.420379 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:06.420379 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:06.420379 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:06.420379 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:06.420379 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:06.420379 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:06.420379 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:06.420379 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:06.420379 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:06.420379 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:06.420379 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:39:06.420379 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:39:06.420379 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:39:06.421350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:39:06.421350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:06.421350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:06.421350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:06.421350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:06.421350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:06.421350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:06.421350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:06.421350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:06.421350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:06.421350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:06.421350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:06.421350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:06.421350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:06.421350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:06.421350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:06.421350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:06.422274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:39:06.422274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:39:06.422274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:39:06.422274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:39:06.422274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 551/1068] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:39:06.427719 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23764a3-92e2-4313-9928-17b52dc0f291 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:06.432802 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06459ade-9946-49a2-9b40-235048bd84f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:06.433483 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06459ade-9946-49a2-9b40-235048bd84f4 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:06.433771 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06459ade-9946-49a2-9b40-235048bd84f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:06.434084 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06459ade-9946-49a2-9b40-235048bd84f4 None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:06.434816 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06459ade-9946-49a2-9b40-235048bd84f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:06.435127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06459ade-9946-49a2-9b40-235048bd84f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:06.436934 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06459ade-9946-49a2-9b40-235048bd84f4 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:06.450091 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 518/1069] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:06.455399 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06459ade-9946-49a2-9b40-235048bd84f4 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:06.473061 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:06.540401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23764a3-92e2-4313-9928-17b52dc0f291 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:06.577093 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06459ade-9946-49a2-9b40-235048bd84f4 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:06.580747 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bef018-8ad4-493c-8bb0-edfd05a0735d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:06.581423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bef018-8ad4-493c-8bb0-edfd05a0735d None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:06.581704 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bef018-8ad4-493c-8bb0-edfd05a0735d None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:06.582010 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bef018-8ad4-493c-8bb0-edfd05a0735d None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:06.582735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bef018-8ad4-493c-8bb0-edfd05a0735d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:06.583050 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bef018-8ad4-493c-8bb0-edfd05a0735d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:06.584414 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bef018-8ad4-493c-8bb0-edfd05a0735d None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:06.587448 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:06.599026 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 552/1070] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:39:06.616654 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bfe41-ee50-45d3-a833-d6dcfb1e9404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:06.617780 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bfe41-ee50-45d3-a833-d6dcfb1e9404 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:06.618092 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bfe41-ee50-45d3-a833-d6dcfb1e9404 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:06.618371 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bfe41-ee50-45d3-a833-d6dcfb1e9404 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:06.628251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bfe41-ee50-45d3-a833-d6dcfb1e9404 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:06.629961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bfe41-ee50-45d3-a833-d6dcfb1e9404 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:06.646020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-a14bfe41-ee50-45d3-a833-d6dcfb1e9404 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 15:39:06.646020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:06.646020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:06.646020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:06.646020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:06.646020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:06.646020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:06.646020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:06.646020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:06.646020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:06.646020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:06.646020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:06.646020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:39:06.646020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:39:06.646020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:39:06.646020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:39:06.647019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:06.647019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:06.647019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:39:06.647019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:39:06.647019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:39:06.647019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:39:06.647019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:06.647019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:06.647019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:06.647019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:06.647019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:06.647019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:06.647019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:06.647019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:06.647019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:06.647019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:06.647019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:06.647019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:06.647959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:06.647959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:06.647959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:39:06.647959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:39:06.647959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:39:06.647959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:39:06.647959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:39:06.647959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:39:06.647959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 15:39:06.647959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:39:06.650219 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 519/1071] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jun 23 15:39:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:39:06.653200 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bef018-8ad4-493c-8bb0-edfd05a0735d None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:06.660395 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703cc9e-2c15-4b0a-ace7-e484c993148b None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:06.660717 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703cc9e-2c15-4b0a-ace7-e484c993148b None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:06.660959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703cc9e-2c15-4b0a-ace7-e484c993148b None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:06.662396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 520/1072] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:39:06.668246 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579943bb-1ae0-41c6-a3a5-3e4b9a29171c None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:06.668526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579943bb-1ae0-41c6-a3a5-3e4b9a29171c None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:06.668808 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579943bb-1ae0-41c6-a3a5-3e4b9a29171c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:06.691928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-579943bb-1ae0-41c6-a3a5-3e4b9a29171c None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:39:06.693146 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-579943bb-1ae0-41c6-a3a5-3e4b9a29171c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:39:06.770134 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 521/1073] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:39:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 15:39:06.776520 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bef018-8ad4-493c-8bb0-edfd05a0735d None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:06.793388 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579943bb-1ae0-41c6-a3a5-3e4b9a29171c None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:06.799614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:06.814877 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb47f3b-e5f2-4fe6-bc29-2eb5bf1b40cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:06.815559 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb47f3b-e5f2-4fe6-bc29-2eb5bf1b40cc None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:06.815853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb47f3b-e5f2-4fe6-bc29-2eb5bf1b40cc None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:06.816596 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb47f3b-e5f2-4fe6-bc29-2eb5bf1b40cc None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:06.816981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb47f3b-e5f2-4fe6-bc29-2eb5bf1b40cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:06.817298 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb47f3b-e5f2-4fe6-bc29-2eb5bf1b40cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:06.820738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb47f3b-e5f2-4fe6-bc29-2eb5bf1b40cc None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:06.840912 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 553/1074] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jun 23 15:39:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:06.846795 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb47f3b-e5f2-4fe6-bc29-2eb5bf1b40cc None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:06.911701 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:06.921776 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579943bb-1ae0-41c6-a3a5-3e4b9a29171c None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:06.956160 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb47f3b-e5f2-4fe6-bc29-2eb5bf1b40cc None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:06.956357 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648aeb4-c2ae-4231-899d-aaf545218b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:06.956986 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648aeb4-c2ae-4231-899d-aaf545218b9a None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:06.957270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648aeb4-c2ae-4231-899d-aaf545218b9a None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:06.957548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648aeb4-c2ae-4231-899d-aaf545218b9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:06.967762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648aeb4-c2ae-4231-899d-aaf545218b9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:39:06.975308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-0648aeb4-c2ae-4231-899d-aaf545218b9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:39:06.975308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:06.975308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:06.975308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:06.975308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:06.975308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:06.975308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:06.975308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:06.975308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:06.975308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:06.975308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:06.975308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:06.975308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:39:06.975308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:39:06.975308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:39:06.975308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:39:06.976242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:39:06.976242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:39:06.976242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:39:06.976242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:39:06.976242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:06.976242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:06.976242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:06.976242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:06.976242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:06.976242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:06.976242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:06.976242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:06.976242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:06.976242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:06.976242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:06.976242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:06.977107 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:06.977107 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:06.977107 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:06.977107 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:06.977107 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:39:06.977107 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:39:06.977107 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:39:06.977107 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:39:06.977107 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:39:06.977107 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:39:06.977107 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:39:06.977107 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:39:06.977107 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 522/1075] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:39:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:39:06.983030 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648aeb4-c2ae-4231-899d-aaf545218b9a None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:06.992719 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b24eb1-2d7d-4a12-97de-a2ea23d32192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:06.993514 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b24eb1-2d7d-4a12-97de-a2ea23d32192 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:06.993803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b24eb1-2d7d-4a12-97de-a2ea23d32192 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:06.994113 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b24eb1-2d7d-4a12-97de-a2ea23d32192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:07.004838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b24eb1-2d7d-4a12-97de-a2ea23d32192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:07.006321 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b24eb1-2d7d-4a12-97de-a2ea23d32192 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:07.023430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-09b24eb1-2d7d-4a12-97de-a2ea23d32192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:39:07.023430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:07.023430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:07.023430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:07.023430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:07.023430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:07.023430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:07.023430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:07.023430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:07.023430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:07.023430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:07.023430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:07.023430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:39:07.023430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:39:07.023430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:39:07.024366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:39:07.024366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:07.024366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:07.024366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:07.024366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:07.024366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:07.024366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:07.024366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:07.024366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:07.024366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:07.024366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:07.024366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:07.024366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:07.024366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:07.024366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:07.024366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:07.024366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:07.025250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:39:07.025250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:39:07.025250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:39:07.025250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:39:07.025250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 554/1076] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:39:07.030555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b24eb1-2d7d-4a12-97de-a2ea23d32192 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:07.046904 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:07.085395 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648aeb4-c2ae-4231-899d-aaf545218b9a None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:07.123405 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1daa7-9a1d-46b3-8ef8-6a651ad8a7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:07.124079 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1daa7-9a1d-46b3-8ef8-6a651ad8a7f1 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:07.124364 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1daa7-9a1d-46b3-8ef8-6a651ad8a7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:07.124644 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1daa7-9a1d-46b3-8ef8-6a651ad8a7f1 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:07.125391 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1daa7-9a1d-46b3-8ef8-6a651ad8a7f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:07.125700 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1daa7-9a1d-46b3-8ef8-6a651ad8a7f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:07.127239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1daa7-9a1d-46b3-8ef8-6a651ad8a7f1 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:07.131573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b24eb1-2d7d-4a12-97de-a2ea23d32192 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:07.135522 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 523/1077] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:39:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:39:07.139765 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:07.142281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1daa7-9a1d-46b3-8ef8-6a651ad8a7f1 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:07.169704 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bc73d-3cac-4e61-bac0-e7eb03aca909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:07.170332 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bc73d-3cac-4e61-bac0-e7eb03aca909 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:07.170622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bc73d-3cac-4e61-bac0-e7eb03aca909 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:07.170900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bc73d-3cac-4e61-bac0-e7eb03aca909 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:07.171634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479bc73d-3cac-4e61-bac0-e7eb03aca909 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:07.171945 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479bc73d-3cac-4e61-bac0-e7eb03aca909 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:07.173324 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479bc73d-3cac-4e61-bac0-e7eb03aca909 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:07.184507 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 555/1078] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:39:07.190243 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bc73d-3cac-4e61-bac0-e7eb03aca909 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:07.251269 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1daa7-9a1d-46b3-8ef8-6a651ad8a7f1 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:07.284420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:07.302895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c237d11-7edf-4c12-879e-3c0f370ca0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:07.303308 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bc73d-3cac-4e61-bac0-e7eb03aca909 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:07.304347 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c237d11-7edf-4c12-879e-3c0f370ca0d0 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:07.304825 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c237d11-7edf-4c12-879e-3c0f370ca0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:07.305156 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c237d11-7edf-4c12-879e-3c0f370ca0d0 None admin] PATH_INFO: `/v3/users/bfebe8c2aa4e4185915d6ca7d5f30ddc` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:07.306417 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c237d11-7edf-4c12-879e-3c0f370ca0d0 None admin] RBAC: Authorizing `identity:get_user(user_id=bfebe8c2aa4e4185915d6ca7d5f30ddc)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:07.307842 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c237d11-7edf-4c12-879e-3c0f370ca0d0 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:07.309651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 524/1079] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:39:07 2022] GET /identity/v3/users/bfebe8c2aa4e4185915d6ca7d5f30ddc => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:39:07.316638 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c237d11-7edf-4c12-879e-3c0f370ca0d0 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:07.340928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61135606-b5d7-4b07-8336-be743c3cd970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:07.341727 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61135606-b5d7-4b07-8336-be743c3cd970 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:07.342050 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61135606-b5d7-4b07-8336-be743c3cd970 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:07.342334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61135606-b5d7-4b07-8336-be743c3cd970 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:07.348911 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61135606-b5d7-4b07-8336-be743c3cd970 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:07.350374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61135606-b5d7-4b07-8336-be743c3cd970 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:07.364378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-61135606-b5d7-4b07-8336-be743c3cd970 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:39:07.364378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:07.364378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:07.364378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:07.364378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:07.364378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:07.364378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:07.364378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:07.364378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:07.364378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:07.364378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:07.364378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:07.364378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:39:07.364378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:39:07.364378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:39:07.365733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:39:07.365733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:07.365733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:07.365733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:07.365733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:07.365733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:07.365733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:07.365733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:07.365733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:07.365733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:07.365733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:07.365733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:07.365733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:07.365733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:07.365733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:07.365733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:07.365733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:07.367099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:39:07.367099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:39:07.367099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:39:07.367099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:39:07.367099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:39:07.367099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:39:07.367099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:39:07.367099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:39:07.367099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 556/1080] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:39:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:39:07.372003 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61135606-b5d7-4b07-8336-be743c3cd970 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:07.398529 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:07.424155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c237d11-7edf-4c12-879e-3c0f370ca0d0 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:07.467087 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49eb1e4-b8f9-43d7-915a-fc2039a05145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:07.468379 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49eb1e4-b8f9-43d7-915a-fc2039a05145 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:07.468836 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49eb1e4-b8f9-43d7-915a-fc2039a05145 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:07.469308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49eb1e4-b8f9-43d7-915a-fc2039a05145 None admin] PATH_INFO: `/v3/projects/6bed94190a4149c8a6f97afe5cc88d87` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:07.471217 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49eb1e4-b8f9-43d7-915a-fc2039a05145 None admin] RBAC: Authorizing `identity:get_project(project_id=6bed94190a4149c8a6f97afe5cc88d87)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:07.473745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49eb1e4-b8f9-43d7-915a-fc2039a05145 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:07.477103 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 525/1081] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:39:07 2022] GET /identity/v3/projects/6bed94190a4149c8a6f97afe5cc88d87 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:39:07.483410 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49eb1e4-b8f9-43d7-915a-fc2039a05145 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:07.490987 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61135606-b5d7-4b07-8336-be743c3cd970 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:07.527422 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb0a7b-cbac-4331-8b5b-7e4ef78959d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:07.528100 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb0a7b-cbac-4331-8b5b-7e4ef78959d6 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:07.528389 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb0a7b-cbac-4331-8b5b-7e4ef78959d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:07.528668 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb0a7b-cbac-4331-8b5b-7e4ef78959d6 None admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:07.529478 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb0a7b-cbac-4331-8b5b-7e4ef78959d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:07.529793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb0a7b-cbac-4331-8b5b-7e4ef78959d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:07.531551 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb0a7b-cbac-4331-8b5b-7e4ef78959d6 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:07.544371 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 557/1082] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:39:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:39:07.547914 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:07.550460 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb0a7b-cbac-4331-8b5b-7e4ef78959d6 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:07.590848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49eb1e4-b8f9-43d7-915a-fc2039a05145 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:07.625000 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683598d4-c1fa-40bd-ab25-0479aa5c9a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:07.625912 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683598d4-c1fa-40bd-ab25-0479aa5c9a5c None admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:07.626198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683598d4-c1fa-40bd-ab25-0479aa5c9a5c None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:07.626472 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683598d4-c1fa-40bd-ab25-0479aa5c9a5c None admin] PATH_INFO: `/v3/projects/6bed94190a4149c8a6f97afe5cc88d87/users/bfebe8c2aa4e4185915d6ca7d5f30ddc/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:07.628429 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683598d4-c1fa-40bd-ab25-0479aa5c9a5c None admin] RBAC: Authorizing `identity:create_grant(project_id=6bed94190a4149c8a6f97afe5cc88d87, user_id=bfebe8c2aa4e4185915d6ca7d5f30ddc, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:07.629849 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683598d4-c1fa-40bd-ab25-0479aa5c9a5c None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:07.641258 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:07.643227 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 526/1083] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 23 15:39:07 2022] PUT /identity/v3/projects/6bed94190a4149c8a6f97afe5cc88d87/users/bfebe8c2aa4e4185915d6ca7d5f30ddc/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:39:07.660239 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb0a7b-cbac-4331-8b5b-7e4ef78959d6 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:07.698390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef743f2-3896-4761-bb3d-a76fb07420d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:07.699310 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef743f2-3896-4761-bb3d-a76fb07420d6 None admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:07.699600 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef743f2-3896-4761-bb3d-a76fb07420d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:07.699884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef743f2-3896-4761-bb3d-a76fb07420d6 None admin] PATH_INFO: `/v3/projects/ff90b874f5b84d28a2752bc95419ad95/users/d54521ea1dca44c98d6723d0b9fd6468/roles/678724a2168946df8b6b36e91bf83b1a` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:07.702358 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef743f2-3896-4761-bb3d-a76fb07420d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff90b874f5b84d28a2752bc95419ad95, user_id=d54521ea1dca44c98d6723d0b9fd6468, role_id=678724a2168946df8b6b36e91bf83b1a)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:07.703852 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef743f2-3896-4761-bb3d-a76fb07420d6 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:07.718726 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 558/1084] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 23 15:39:07 2022] PUT /identity/v3/projects/ff90b874f5b84d28a2752bc95419ad95/users/d54521ea1dca44c98d6723d0b9fd6468/roles/678724a2168946df8b6b36e91bf83b1a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:39:09.699575 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8c76c-2c8a-4dd5-822b-48299cb6325f None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:09.700098 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8c76c-2c8a-4dd5-822b-48299cb6325f None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:09.700189 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8c76c-2c8a-4dd5-822b-48299cb6325f None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:09.701555 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 527/1085] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:39:09.709547 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf49d17-21a2-4593-971c-b12eafa3802c None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:09.710015 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf49d17-21a2-4593-971c-b12eafa3802c None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:09.710149 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf49d17-21a2-4593-971c-b12eafa3802c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:09.724608 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac047f1-3b48-4211-a189-483499f387c1 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:09.724915 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac047f1-3b48-4211-a189-483499f387c1 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:09.725180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac047f1-3b48-4211-a189-483499f387c1 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:09.726593 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 528/1086] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:39:09.727284 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-fdf49d17-21a2-4593-971c-b12eafa3802c None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:39:09.736118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-fdf49d17-21a2-4593-971c-b12eafa3802c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:39:09.736314 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df727e69-42be-48b1-a90e-dc5c8dc389eb None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:09.736314 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df727e69-42be-48b1-a90e-dc5c8dc389eb None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:09.736314 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df727e69-42be-48b1-a90e-dc5c8dc389eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:09.749633 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-df727e69-42be-48b1-a90e-dc5c8dc389eb None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:39:09.750832 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-df727e69-42be-48b1-a90e-dc5c8dc389eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:39:09.804831 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 559/1087] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:39:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:39:09.829607 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf49d17-21a2-4593-971c-b12eafa3802c None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:09.830920 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 529/1088] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:39:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 15:39:09.854418 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df727e69-42be-48b1-a90e-dc5c8dc389eb None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:09.905644 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:09.905836 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:09.929786 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf49d17-21a2-4593-971c-b12eafa3802c None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:09.954145 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df727e69-42be-48b1-a90e-dc5c8dc389eb None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:09.963196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a04c76-3b76-4cb9-a327-ba8e480e9444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:09.964005 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a04c76-3b76-4cb9-a327-ba8e480e9444 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:09.964288 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a04c76-3b76-4cb9-a327-ba8e480e9444 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:09.964566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a04c76-3b76-4cb9-a327-ba8e480e9444 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:09.974489 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a04c76-3b76-4cb9-a327-ba8e480e9444 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:39:09.982545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-a4a04c76-3b76-4cb9-a327-ba8e480e9444 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:39:09.982545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:09.982545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:09.982545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:09.982545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:09.982545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:09.982545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:09.982545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:09.982545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:09.982545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:09.982545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:09.982545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:09.982545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:39:09.982545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:39:09.982545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:39:09.982545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:39:09.983664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:39:09.983664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:39:09.983664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:39:09.983664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:39:09.983664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:09.983664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:09.983664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:09.983664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:09.983664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:09.983664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:09.983664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:09.983664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:09.983664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:09.983664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:09.983664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:09.983664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:09.984504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:09.984504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:09.984504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:09.984504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:09.984504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:39:09.984504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:39:09.984504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:39:09.984504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:39:09.984504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:39:09.984504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:39:09.984504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:39:09.984504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:39:09.984504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 560/1089] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:39:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:39:09.989609 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a04c76-3b76-4cb9-a327-ba8e480e9444 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:09.991421 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cf2e9-d20d-46ed-8788-08ceeef3c46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:09.992236 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cf2e9-d20d-46ed-8788-08ceeef3c46f None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:09.992514 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cf2e9-d20d-46ed-8788-08ceeef3c46f None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:09.992786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cf2e9-d20d-46ed-8788-08ceeef3c46f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:10.003439 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cf2e9-d20d-46ed-8788-08ceeef3c46f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:39:10.012020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-7c3cf2e9-d20d-46ed-8788-08ceeef3c46f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 15:39:10.012020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:10.012020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:10.012020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:10.012020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:10.012020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:10.012020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:10.012020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:10.012020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:10.012020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:10.012020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:10.012020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:10.012020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:39:10.012020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:39:10.012020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:39:10.012020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:39:10.012941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:39:10.012941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:39:10.012941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:39:10.012941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:39:10.012941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:10.012941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:10.012941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:10.012941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:10.012941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:10.012941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:10.012941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:10.012941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:10.012941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:10.012941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:10.012941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:10.012941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:10.015028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:10.015028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:10.015028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:10.015028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:10.015028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:39:10.015028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:39:10.015028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:39:10.015028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:39:10.015028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:39:10.015028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:39:10.015028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 15:39:10.015028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:39:10.015028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 530/1090] 10.222.0.15 () {56 vars in 1120 bytes} [Thu Jun 23 15:39:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:39:10.018994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cf2e9-d20d-46ed-8788-08ceeef3c46f None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:10.102358 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a04c76-3b76-4cb9-a327-ba8e480e9444 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:10.121339 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cf2e9-d20d-46ed-8788-08ceeef3c46f None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:10.135538 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:10.137049 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3f6f2-431c-42f8-a6e2-0e72d95688b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:10.138113 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3f6f2-431c-42f8-a6e2-0e72d95688b3 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:10.138113 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3f6f2-431c-42f8-a6e2-0e72d95688b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:10.138341 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3f6f2-431c-42f8-a6e2-0e72d95688b3 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:10.139075 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3f6f2-431c-42f8-a6e2-0e72d95688b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:10.139415 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3f6f2-431c-42f8-a6e2-0e72d95688b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:10.140782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3f6f2-431c-42f8-a6e2-0e72d95688b3 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:10.143620 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:10.155143 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 561/1091] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:39:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:39:10.162402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3f6f2-431c-42f8-a6e2-0e72d95688b3 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:10.165993 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e635424-7255-410c-8f69-1e90c69fea91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:10.166822 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e635424-7255-410c-8f69-1e90c69fea91 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:10.167006 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e635424-7255-410c-8f69-1e90c69fea91 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:10.167245 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e635424-7255-410c-8f69-1e90c69fea91 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:10.167993 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e635424-7255-410c-8f69-1e90c69fea91 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:10.168298 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e635424-7255-410c-8f69-1e90c69fea91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:10.169657 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e635424-7255-410c-8f69-1e90c69fea91 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:10.178644 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 531/1092] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Jun 23 15:39:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:39:10.187055 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e635424-7255-410c-8f69-1e90c69fea91 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:10.270355 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3f6f2-431c-42f8-a6e2-0e72d95688b3 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:10.286268 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e635424-7255-410c-8f69-1e90c69fea91 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:10.303448 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0812db-50dd-4210-9a40-ff29938071b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:10.304314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0812db-50dd-4210-9a40-ff29938071b8 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:10.304601 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0812db-50dd-4210-9a40-ff29938071b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:10.304884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0812db-50dd-4210-9a40-ff29938071b8 None admin] PATH_INFO: `/v3/users/bfebe8c2aa4e4185915d6ca7d5f30ddc` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:10.306223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0812db-50dd-4210-9a40-ff29938071b8 None admin] RBAC: Authorizing `identity:get_user(user_id=bfebe8c2aa4e4185915d6ca7d5f30ddc)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:10.307681 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0812db-50dd-4210-9a40-ff29938071b8 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:10.309334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 562/1093] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:39:10 2022] GET /identity/v3/users/bfebe8c2aa4e4185915d6ca7d5f30ddc => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:10.314873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0812db-50dd-4210-9a40-ff29938071b8 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:10.323811 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7667be-dfdc-4107-b6b0-8bae3cfb4e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:10.324602 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7667be-dfdc-4107-b6b0-8bae3cfb4e20 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:10.324885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7667be-dfdc-4107-b6b0-8bae3cfb4e20 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:10.325161 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7667be-dfdc-4107-b6b0-8bae3cfb4e20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:10.335728 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7667be-dfdc-4107-b6b0-8bae3cfb4e20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:10.337163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7667be-dfdc-4107-b6b0-8bae3cfb4e20 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:10.354790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-5d7667be-dfdc-4107-b6b0-8bae3cfb4e20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:39:10.354790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:10.354790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:10.354790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:10.354790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:10.354790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:10.354790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:10.354790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:10.354790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:10.354790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:10.354790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:10.354790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:10.354790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:39:10.354790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:39:10.354790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:39:10.355911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:39:10.355911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:10.355911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:10.355911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:10.355911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:10.355911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:10.355911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:10.355911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:10.355911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:10.355911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:10.355911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:10.355911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:10.355911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:10.355911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:10.355911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:10.355911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:10.355911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:10.357348 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:39:10.357348 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:39:10.357348 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:39:10.357348 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:39:10.357348 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 532/1094] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:39:10.361638 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7667be-dfdc-4107-b6b0-8bae3cfb4e20 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:10.382884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:10.391031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:10.417884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0812db-50dd-4210-9a40-ff29938071b8 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:10.456795 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb73e73-1677-4b8b-ae37-332becebc335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:10.457441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb73e73-1677-4b8b-ae37-332becebc335 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:10.457725 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb73e73-1677-4b8b-ae37-332becebc335 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:10.458033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb73e73-1677-4b8b-ae37-332becebc335 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:10.472138 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7667be-dfdc-4107-b6b0-8bae3cfb4e20 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:10.513433 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70a70c-13d8-45ef-8273-df29f4868f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:10.514128 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70a70c-13d8-45ef-8273-df29f4868f86 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:10.514421 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70a70c-13d8-45ef-8273-df29f4868f86 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:10.514695 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70a70c-13d8-45ef-8273-df29f4868f86 None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:10.515419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70a70c-13d8-45ef-8273-df29f4868f86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:10.515732 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70a70c-13d8-45ef-8273-df29f4868f86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:10.517106 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70a70c-13d8-45ef-8273-df29f4868f86 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:10.529301 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 533/1095] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:39:10.535055 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70a70c-13d8-45ef-8273-df29f4868f86 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:10.545694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb73e73-1677-4b8b-ae37-332becebc335 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:10.547564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb73e73-1677-4b8b-ae37-332becebc335 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:10.609693 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:10.620628 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:10.635581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70a70c-13d8-45ef-8273-df29f4868f86 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:10.644806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 563/1096] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:39:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 15:39:10.650545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb73e73-1677-4b8b-ae37-332becebc335 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:10.674522 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ab511-116d-4c33-8d25-019e58d21085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:10.675305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ab511-116d-4c33-8d25-019e58d21085 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:10.675589 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ab511-116d-4c33-8d25-019e58d21085 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:10.675880 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ab511-116d-4c33-8d25-019e58d21085 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:10.683153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ab511-116d-4c33-8d25-019e58d21085 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:10.684574 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ab511-116d-4c33-8d25-019e58d21085 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:10.698823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-b07ab511-116d-4c33-8d25-019e58d21085 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 15:39:10.698823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:10.698823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:10.698823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:10.698823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:10.698823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:10.698823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:10.698823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:10.698823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:10.698823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:10.698823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:10.698823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:10.698823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:39:10.698823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:39:10.698823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:39:10.698823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:39:10.700374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:10.700374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:10.700374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:39:10.700374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:39:10.700374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:39:10.700374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:39:10.700374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:10.700374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:10.700374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:10.700374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:10.700374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:10.700374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:10.700374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:10.700374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:10.700374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:10.700374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:10.700374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:10.700374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:10.701517 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:10.701517 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:10.701517 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:39:10.701517 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:39:10.701517 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:39:10.701517 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:39:10.701517 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:39:10.701517 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:39:10.701517 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 15:39:10.701517 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:39:10.701517 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 534/1097] 10.222.0.15 () {56 vars in 1093 bytes} [Thu Jun 23 15:39:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:39:10.705494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ab511-116d-4c33-8d25-019e58d21085 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:10.747642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb73e73-1677-4b8b-ae37-332becebc335 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:10.782235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79176059-7de6-4f2a-b0af-1bf1caef2e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:10.783081 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79176059-7de6-4f2a-b0af-1bf1caef2e85 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:10.783364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79176059-7de6-4f2a-b0af-1bf1caef2e85 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:10.783633 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79176059-7de6-4f2a-b0af-1bf1caef2e85 None admin] PATH_INFO: `/v3/projects/6bed94190a4149c8a6f97afe5cc88d87` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:10.784801 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79176059-7de6-4f2a-b0af-1bf1caef2e85 None admin] RBAC: Authorizing `identity:get_project(project_id=6bed94190a4149c8a6f97afe5cc88d87)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:10.786258 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79176059-7de6-4f2a-b0af-1bf1caef2e85 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:10.787961 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 564/1098] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:39:10 2022] GET /identity/v3/projects/6bed94190a4149c8a6f97afe5cc88d87 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:39:10.793938 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79176059-7de6-4f2a-b0af-1bf1caef2e85 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:10.804004 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ab511-116d-4c33-8d25-019e58d21085 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:10.826789 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:10.838164 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d02f3-b180-45e8-953f-745b684a8e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:10.839459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d02f3-b180-45e8-953f-745b684a8e45 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:10.839745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d02f3-b180-45e8-953f-745b684a8e45 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:10.840019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d02f3-b180-45e8-953f-745b684a8e45 None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:10.840848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d02f3-b180-45e8-953f-745b684a8e45 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:10.841154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d02f3-b180-45e8-953f-745b684a8e45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:10.842590 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d02f3-b180-45e8-953f-745b684a8e45 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:10.859110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 535/1099] 10.222.0.15 () {56 vars in 1133 bytes} [Thu Jun 23 15:39:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:39:10.864790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d02f3-b180-45e8-953f-745b684a8e45 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:10.868524 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:10.893884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79176059-7de6-4f2a-b0af-1bf1caef2e85 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:10.930530 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b4002-c449-41fc-96ba-0ee526f0f955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:10.931191 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b4002-c449-41fc-96ba-0ee526f0f955 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:10.931477 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b4002-c449-41fc-96ba-0ee526f0f955 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:10.931762 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b4002-c449-41fc-96ba-0ee526f0f955 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:10.932643 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b4002-c449-41fc-96ba-0ee526f0f955 None admin] RBAC: Adding query filter params (role.id=abdc0e0957534149b3653eaa33cbd054, scope.project.id=6bed94190a4149c8a6f97afe5cc88d87, user.id=bfebe8c2aa4e4185915d6ca7d5f30ddc) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:10.932961 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b4002-c449-41fc-96ba-0ee526f0f955 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:10.934430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b4002-c449-41fc-96ba-0ee526f0f955 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:10.940585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 565/1100] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:39:10 2022] GET /identity/v3/role_assignments?user.id=bfebe8c2aa4e4185915d6ca7d5f30ddc&scope.project.id=6bed94190a4149c8a6f97afe5cc88d87&role.id=abdc0e0957534149b3653eaa33cbd054 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:39:10.966975 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d02f3-b180-45e8-953f-745b684a8e45 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:11.003386 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458f7bd-9544-4970-bdbf-a28466c11eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:11.004051 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458f7bd-9544-4970-bdbf-a28466c11eb4 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:11.004340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458f7bd-9544-4970-bdbf-a28466c11eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:11.004621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9458f7bd-9544-4970-bdbf-a28466c11eb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:11.078316 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458f7bd-9544-4970-bdbf-a28466c11eb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:11.079784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9458f7bd-9544-4970-bdbf-a28466c11eb4 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:11.082656 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:11.180575 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 536/1101] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:39:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 15:39:11.186646 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b4002-c449-41fc-96ba-0ee526f0f955 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:11.280055 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:11.284292 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b4002-c449-41fc-96ba-0ee526f0f955 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:11.320748 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe9b48-ce7b-43e3-9073-0beb0a768d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:11.321607 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe9b48-ce7b-43e3-9073-0beb0a768d6b None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:11.321921 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe9b48-ce7b-43e3-9073-0beb0a768d6b None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:11.322205 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe9b48-ce7b-43e3-9073-0beb0a768d6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:11.333239 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe9b48-ce7b-43e3-9073-0beb0a768d6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:11.334721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe9b48-ce7b-43e3-9073-0beb0a768d6b None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:11.351798 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-6ffe9b48-ce7b-43e3-9073-0beb0a768d6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:39:11.351798 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:11.351798 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:11.351798 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:11.351798 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:11.351798 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:11.351798 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:11.351798 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:11.351798 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:11.351798 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:11.351798 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:11.351798 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:11.351798 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:39:11.351798 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:39:11.351798 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:39:11.352847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:39:11.352847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:11.352847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:11.352847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:11.352847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:11.352847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:11.352847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:11.352847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:11.352847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:11.352847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:11.352847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:11.352847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:11.352847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:11.352847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:11.352847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:11.352847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:11.352847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:11.353767 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:39:11.353767 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:39:11.353767 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:39:11.353767 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:39:11.353767 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 566/1102] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:39:11.358715 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458f7bd-9544-4970-bdbf-a28466c11eb4 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:11.455497 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9458f7bd-9544-4970-bdbf-a28466c11eb4 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:11.457836 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:11.491521 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7ad12-c1ae-4868-b339-ec5f1e6fdb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:11.492194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7ad12-c1ae-4868-b339-ec5f1e6fdb24 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:11.492482 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7ad12-c1ae-4868-b339-ec5f1e6fdb24 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:11.492760 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7ad12-c1ae-4868-b339-ec5f1e6fdb24 None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:11.493479 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7ad12-c1ae-4868-b339-ec5f1e6fdb24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:11.493792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7ad12-c1ae-4868-b339-ec5f1e6fdb24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:11.495211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7ad12-c1ae-4868-b339-ec5f1e6fdb24 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:11.509074 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 537/1103] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:11.514982 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe9b48-ce7b-43e3-9073-0beb0a768d6b None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:11.615252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe9b48-ce7b-43e3-9073-0beb0a768d6b None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:11.648901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422d976-f0f5-4405-8e4d-1c227d1fbd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:11.649690 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422d976-f0f5-4405-8e4d-1c227d1fbd82 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:11.650009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422d976-f0f5-4405-8e4d-1c227d1fbd82 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:11.650293 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422d976-f0f5-4405-8e4d-1c227d1fbd82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:11.657181 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422d976-f0f5-4405-8e4d-1c227d1fbd82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:11.658659 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422d976-f0f5-4405-8e4d-1c227d1fbd82 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:11.672869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-3422d976-f0f5-4405-8e4d-1c227d1fbd82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:39:11.672869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:11.672869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:11.672869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:11.672869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:11.672869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:11.672869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:11.672869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:11.672869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:11.672869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:11.672869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:11.672869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:11.672869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:39:11.672869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:39:11.672869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:39:11.673754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:39:11.673754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:11.673754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:11.673754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:11.673754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:11.673754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:11.673754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:11.673754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:11.673754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:11.673754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:11.673754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:11.673754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:11.673754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:11.673754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:11.673754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:11.673754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:11.673754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:11.674692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:39:11.674692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:39:11.674692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:39:11.674692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:39:11.674692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:39:11.674692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:39:11.674692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:39:11.674692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:39:11.674692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 567/1104] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:39:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:39:11.679997 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7ad12-c1ae-4868-b339-ec5f1e6fdb24 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:11.785973 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7ad12-c1ae-4868-b339-ec5f1e6fdb24 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:11.822373 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9ee11-285e-42b9-9763-83a475cf1021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:11.823543 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9ee11-285e-42b9-9763-83a475cf1021 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:11.823826 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9ee11-285e-42b9-9763-83a475cf1021 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:11.824107 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9ee11-285e-42b9-9763-83a475cf1021 None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:11.824890 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9ee11-285e-42b9-9763-83a475cf1021 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:11.825203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9ee11-285e-42b9-9763-83a475cf1021 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:11.826646 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9ee11-285e-42b9-9763-83a475cf1021 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:11.838451 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 538/1105] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:39:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:11.845076 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422d976-f0f5-4405-8e4d-1c227d1fbd82 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:11.858573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:11.949761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422d976-f0f5-4405-8e4d-1c227d1fbd82 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:11.982211 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c7e53-319f-47df-8b67-93982269a86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:11.982792 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c7e53-319f-47df-8b67-93982269a86c None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:11.983074 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c7e53-319f-47df-8b67-93982269a86c None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:11.983347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c7e53-319f-47df-8b67-93982269a86c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:11.984166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c7e53-319f-47df-8b67-93982269a86c None admin] RBAC: Adding query filter params (role.id=678724a2168946df8b6b36e91bf83b1a, scope.project.id=ff90b874f5b84d28a2752bc95419ad95, user.id=d54521ea1dca44c98d6723d0b9fd6468) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:11.984476 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c7e53-319f-47df-8b67-93982269a86c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:11.985916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c7e53-319f-47df-8b67-93982269a86c None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:11.991846 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 568/1106] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:39:11 2022] GET /identity/v3/role_assignments?user.id=d54521ea1dca44c98d6723d0b9fd6468&scope.project.id=ff90b874f5b84d28a2752bc95419ad95&role.id=678724a2168946df8b6b36e91bf83b1a => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:13.015602 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de3729-9f36-4736-a196-ddd4f86c9fdd None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:13.016171 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de3729-9f36-4736-a196-ddd4f86c9fdd None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:13.016171 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de3729-9f36-4736-a196-ddd4f86c9fdd None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:13.019244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 539/1107] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:39:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:39:13.025033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e89d0-a18c-49a8-9160-fcb4d8ace227 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:13.025491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e89d0-a18c-49a8-9160-fcb4d8ace227 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:13.025593 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e89d0-a18c-49a8-9160-fcb4d8ace227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:13.044105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-b54e89d0-a18c-49a8-9160-fcb4d8ace227 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:39:13.045355 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-b54e89d0-a18c-49a8-9160-fcb4d8ace227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:39:13.110741 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 569/1108] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:39:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:39:13.135090 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de3729-9f36-4736-a196-ddd4f86c9fdd None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:13.161072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:13.236878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de3729-9f36-4736-a196-ddd4f86c9fdd None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:13.270423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1f918-1a47-48c2-9524-cc587b42f969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:13.271128 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1f918-1a47-48c2-9524-cc587b42f969 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:13.271409 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1f918-1a47-48c2-9524-cc587b42f969 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:13.271683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1f918-1a47-48c2-9524-cc587b42f969 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:13.272853 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1f918-1a47-48c2-9524-cc587b42f969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:13.274301 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1f918-1a47-48c2-9524-cc587b42f969 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:13.275937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 540/1109] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:39:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:13.282512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e89d0-a18c-49a8-9160-fcb4d8ace227 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:13.285624 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:13.382205 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e89d0-a18c-49a8-9160-fcb4d8ace227 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:13.415705 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f240fb-0987-4de6-81ab-d679561ca9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:13.416368 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f240fb-0987-4de6-81ab-d679561ca9b9 None admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:13.416646 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f240fb-0987-4de6-81ab-d679561ca9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:13.416990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f240fb-0987-4de6-81ab-d679561ca9b9 None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:13.417649 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f240fb-0987-4de6-81ab-d679561ca9b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:13.419208 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f240fb-0987-4de6-81ab-d679561ca9b9 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:13.439007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 570/1110] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 23 15:39:13 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:39:15.525012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e7276-87fa-45ee-9987-ffb57db51086 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:15.525573 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e7276-87fa-45ee-9987-ffb57db51086 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:15.525573 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e7276-87fa-45ee-9987-ffb57db51086 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:15.527016 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 541/1111] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:39:15.532513 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891582a-2b0e-4c97-8327-80a516b0c1cf None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:15.532925 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891582a-2b0e-4c97-8327-80a516b0c1cf None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:15.533105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891582a-2b0e-4c97-8327-80a516b0c1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:15.550711 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-b891582a-2b0e-4c97-8327-80a516b0c1cf None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:39:15.551955 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-b891582a-2b0e-4c97-8327-80a516b0c1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:39:15.609058 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:15.621084 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 571/1112] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:39:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:39:15.645756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e7276-87fa-45ee-9987-ffb57db51086 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:15.740833 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:15.751104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e7276-87fa-45ee-9987-ffb57db51086 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:15.785783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17498e-4695-4f0b-a8e3-cc60b4be85ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:15.786590 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17498e-4695-4f0b-a8e3-cc60b4be85ca None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:15.786877 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17498e-4695-4f0b-a8e3-cc60b4be85ca None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:15.787150 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17498e-4695-4f0b-a8e3-cc60b4be85ca None admin] PATH_INFO: `/v3/roles/12fa8f67cf514b1e916afc130f0e6008` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:15.788647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17498e-4695-4f0b-a8e3-cc60b4be85ca None admin] RBAC: Authorizing `identity:get_role(role_id=12fa8f67cf514b1e916afc130f0e6008)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:15.790048 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17498e-4695-4f0b-a8e3-cc60b4be85ca None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:15.791439 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 542/1113] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:39:15 2022] GET /identity/v3/roles/12fa8f67cf514b1e916afc130f0e6008 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:15.797905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891582a-2b0e-4c97-8327-80a516b0c1cf None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:15.893669 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891582a-2b0e-4c97-8327-80a516b0c1cf None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:15.926288 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34af29-1a3d-4a93-970e-e99b60375581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:15.927159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34af29-1a3d-4a93-970e-e99b60375581 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:15.927443 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34af29-1a3d-4a93-970e-e99b60375581 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:15.927719 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34af29-1a3d-4a93-970e-e99b60375581 None admin] PATH_INFO: `/v3/users/f75ee5000a8f426fa666c630047ca534` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:15.942048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34af29-1a3d-4a93-970e-e99b60375581 None admin] RBAC: Authorizing `identity:get_user(user_id=f75ee5000a8f426fa666c630047ca534)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:15.943619 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34af29-1a3d-4a93-970e-e99b60375581 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:15.945372 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 572/1114] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:39:15 2022] GET /identity/v3/users/f75ee5000a8f426fa666c630047ca534 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:15.951810 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17498e-4695-4f0b-a8e3-cc60b4be85ca None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:16.050368 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17498e-4695-4f0b-a8e3-cc60b4be85ca None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:16.083153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dac6a0-2603-4e86-b369-c3e1fac453e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:16.083797 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dac6a0-2603-4e86-b369-c3e1fac453e1 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:16.084079 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dac6a0-2603-4e86-b369-c3e1fac453e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:16.084354 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dac6a0-2603-4e86-b369-c3e1fac453e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:16.111155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:16.149876 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dac6a0-2603-4e86-b369-c3e1fac453e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:16.151354 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dac6a0-2603-4e86-b369-c3e1fac453e1 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:16.250722 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 543/1115] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:39:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 15:39:16.256508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34af29-1a3d-4a93-970e-e99b60375581 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:16.305828 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:16.355811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34af29-1a3d-4a93-970e-e99b60375581 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:16.389405 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6d4d1-aeb5-4343-8a80-e777e8719839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:16.390278 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6d4d1-aeb5-4343-8a80-e777e8719839 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:16.390562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6d4d1-aeb5-4343-8a80-e777e8719839 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:16.390835 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6d4d1-aeb5-4343-8a80-e777e8719839 None admin] PATH_INFO: `/v3/projects/6bed94190a4149c8a6f97afe5cc88d87` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:16.391994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6d4d1-aeb5-4343-8a80-e777e8719839 None admin] RBAC: Authorizing `identity:get_project(project_id=6bed94190a4149c8a6f97afe5cc88d87)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:16.393418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6d4d1-aeb5-4343-8a80-e777e8719839 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:16.395162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 573/1116] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:39:16 2022] GET /identity/v3/projects/6bed94190a4149c8a6f97afe5cc88d87 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:16.401833 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dac6a0-2603-4e86-b369-c3e1fac453e1 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:16.460469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:16.502257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dac6a0-2603-4e86-b369-c3e1fac453e1 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:16.535945 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f750e-3a7f-4dba-a066-d54d77398f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:16.536598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f750e-3a7f-4dba-a066-d54d77398f7a None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:16.536873 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f750e-3a7f-4dba-a066-d54d77398f7a None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:16.537160 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f750e-3a7f-4dba-a066-d54d77398f7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:16.538017 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f750e-3a7f-4dba-a066-d54d77398f7a None admin] RBAC: Adding query filter params (role.id=12fa8f67cf514b1e916afc130f0e6008, scope.project.id=6bed94190a4149c8a6f97afe5cc88d87, user.id=f75ee5000a8f426fa666c630047ca534) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:16.538333 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f750e-3a7f-4dba-a066-d54d77398f7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:16.539768 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f750e-3a7f-4dba-a066-d54d77398f7a None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:16.549588 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 544/1117] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:39:16 2022] GET /identity/v3/role_assignments?user.id=f75ee5000a8f426fa666c630047ca534&scope.project.id=6bed94190a4149c8a6f97afe5cc88d87&role.id=12fa8f67cf514b1e916afc130f0e6008 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:39:18.570187 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14dd9f-b7c7-4153-b174-98df6cf7d236 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:18.570705 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14dd9f-b7c7-4153-b174-98df6cf7d236 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:18.570805 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14dd9f-b7c7-4153-b174-98df6cf7d236 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:18.572092 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 574/1118] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:39:18.578141 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b5d09-e504-44bd-904f-c1c43097efab None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:18.578615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b5d09-e504-44bd-904f-c1c43097efab None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:18.578712 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b5d09-e504-44bd-904f-c1c43097efab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:18.595828 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-585b5d09-e504-44bd-904f-c1c43097efab None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:39:18.597026 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-585b5d09-e504-44bd-904f-c1c43097efab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:39:18.663172 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 545/1119] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:39:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:39:18.686535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14dd9f-b7c7-4153-b174-98df6cf7d236 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:18.788001 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14dd9f-b7c7-4153-b174-98df6cf7d236 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:18.804928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:18.822799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6af901-49b4-4e0c-838c-36dd77eb02f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:18.824132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6af901-49b4-4e0c-838c-36dd77eb02f7 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:18.824415 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6af901-49b4-4e0c-838c-36dd77eb02f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:18.824694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6af901-49b4-4e0c-838c-36dd77eb02f7 None admin] PATH_INFO: `/v3/roles/12fa8f67cf514b1e916afc130f0e6008` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:18.826208 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6af901-49b4-4e0c-838c-36dd77eb02f7 None admin] RBAC: Authorizing `identity:get_role(role_id=12fa8f67cf514b1e916afc130f0e6008)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:18.827577 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6af901-49b4-4e0c-838c-36dd77eb02f7 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:18.828955 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 575/1120] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:39:18 2022] GET /identity/v3/roles/12fa8f67cf514b1e916afc130f0e6008 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:18.834978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b5d09-e504-44bd-904f-c1c43097efab None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:18.895181 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:18.938707 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b5d09-e504-44bd-904f-c1c43097efab None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:18.971978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd830bf6-0498-4189-9299-ca4224d4555a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:18.972939 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd830bf6-0498-4189-9299-ca4224d4555a None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:18.973225 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd830bf6-0498-4189-9299-ca4224d4555a None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:18.973495 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd830bf6-0498-4189-9299-ca4224d4555a None admin] PATH_INFO: `/v3/users/f75ee5000a8f426fa666c630047ca534` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:18.974710 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd830bf6-0498-4189-9299-ca4224d4555a None admin] RBAC: Authorizing `identity:get_user(user_id=f75ee5000a8f426fa666c630047ca534)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:18.976127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd830bf6-0498-4189-9299-ca4224d4555a None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:18.977765 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 546/1121] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:39:18 2022] GET /identity/v3/users/f75ee5000a8f426fa666c630047ca534 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:18.984192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6af901-49b4-4e0c-838c-36dd77eb02f7 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:19.082438 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6af901-49b4-4e0c-838c-36dd77eb02f7 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:19.115804 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb7141b-76c9-4289-ab83-57d68cf6a319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:19.116663 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7141b-76c9-4289-ab83-57d68cf6a319 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:19.116947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7141b-76c9-4289-ab83-57d68cf6a319 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:19.117221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb7141b-76c9-4289-ab83-57d68cf6a319 None admin] PATH_INFO: `/v3/projects/6bed94190a4149c8a6f97afe5cc88d87` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:19.118433 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7141b-76c9-4289-ab83-57d68cf6a319 None admin] RBAC: Authorizing `identity:get_project(project_id=6bed94190a4149c8a6f97afe5cc88d87)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:19.120428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb7141b-76c9-4289-ab83-57d68cf6a319 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:19.122173 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 576/1122] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:39:18 2022] GET /identity/v3/projects/6bed94190a4149c8a6f97afe5cc88d87 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:19.128187 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd830bf6-0498-4189-9299-ca4224d4555a None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:19.228112 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd830bf6-0498-4189-9299-ca4224d4555a None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:19.250714 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:19.263549 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb2ad9-e699-401f-8a1d-ba9cd376db63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:19.264451 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb2ad9-e699-401f-8a1d-ba9cd376db63 None admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:19.264738 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb2ad9-e699-401f-8a1d-ba9cd376db63 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:19.265020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb2ad9-e699-401f-8a1d-ba9cd376db63 None admin] PATH_INFO: `/v3/projects/6bed94190a4149c8a6f97afe5cc88d87/users/f75ee5000a8f426fa666c630047ca534/roles/12fa8f67cf514b1e916afc130f0e6008` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:19.267286 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb2ad9-e699-401f-8a1d-ba9cd376db63 None admin] RBAC: Authorizing `identity:create_grant(project_id=6bed94190a4149c8a6f97afe5cc88d87, user_id=f75ee5000a8f426fa666c630047ca534, role_id=12fa8f67cf514b1e916afc130f0e6008)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:19.268726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb2ad9-e699-401f-8a1d-ba9cd376db63 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:19.282950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 547/1123] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 23 15:39:19 2022] PUT /identity/v3/projects/6bed94190a4149c8a6f97afe5cc88d87/users/f75ee5000a8f426fa666c630047ca534/roles/12fa8f67cf514b1e916afc130f0e6008 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:39:21.310819 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18b8e3-9aab-46e2-96be-fa3e1d647810 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:21.311360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18b8e3-9aab-46e2-96be-fa3e1d647810 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:21.311360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18b8e3-9aab-46e2-96be-fa3e1d647810 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:21.312746 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 577/1124] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:39:21.318084 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9238e5-39a6-46b9-b587-315a1b7da5c1 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:21.318519 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9238e5-39a6-46b9-b587-315a1b7da5c1 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:21.318648 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9238e5-39a6-46b9-b587-315a1b7da5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:21.335476 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-0a9238e5-39a6-46b9-b587-315a1b7da5c1 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:39:21.336666 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-0a9238e5-39a6-46b9-b587-315a1b7da5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:39:21.403354 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 548/1125] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:39:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 15:39:21.427075 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18b8e3-9aab-46e2-96be-fa3e1d647810 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:21.482805 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:21.531704 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18b8e3-9aab-46e2-96be-fa3e1d647810 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:21.564778 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cfc58-a7b8-424d-9c16-5516a98a1cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:21.565554 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cfc58-a7b8-424d-9c16-5516a98a1cea None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:21.566247 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cfc58-a7b8-424d-9c16-5516a98a1cea None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:21.566247 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cfc58-a7b8-424d-9c16-5516a98a1cea None admin] PATH_INFO: `/v3/roles/12fa8f67cf514b1e916afc130f0e6008` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:21.567604 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72cfc58-a7b8-424d-9c16-5516a98a1cea None admin] RBAC: Authorizing `identity:get_role(role_id=12fa8f67cf514b1e916afc130f0e6008)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:21.568973 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72cfc58-a7b8-424d-9c16-5516a98a1cea None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:21.570397 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 578/1126] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:39:21 2022] GET /identity/v3/roles/12fa8f67cf514b1e916afc130f0e6008 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:21.576612 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9238e5-39a6-46b9-b587-315a1b7da5c1 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:21.683527 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9238e5-39a6-46b9-b587-315a1b7da5c1 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:21.696532 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:21.718322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba90944-4ae5-4d00-b164-6cd1d1f16967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:21.719194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba90944-4ae5-4d00-b164-6cd1d1f16967 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:21.719480 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba90944-4ae5-4d00-b164-6cd1d1f16967 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:21.719757 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba90944-4ae5-4d00-b164-6cd1d1f16967 None admin] PATH_INFO: `/v3/users/f75ee5000a8f426fa666c630047ca534` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:21.720949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba90944-4ae5-4d00-b164-6cd1d1f16967 None admin] RBAC: Authorizing `identity:get_user(user_id=f75ee5000a8f426fa666c630047ca534)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:21.722411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba90944-4ae5-4d00-b164-6cd1d1f16967 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:21.724059 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 549/1127] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:39:21 2022] GET /identity/v3/users/f75ee5000a8f426fa666c630047ca534 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:21.729840 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cfc58-a7b8-424d-9c16-5516a98a1cea None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:21.829383 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cfc58-a7b8-424d-9c16-5516a98a1cea None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:21.849885 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:21.864272 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d1a50-a7bd-44b4-90cf-cb49b931aa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:21.864928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d1a50-a7bd-44b4-90cf-cb49b931aa9f None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:21.865212 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d1a50-a7bd-44b4-90cf-cb49b931aa9f None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:21.865490 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d1a50-a7bd-44b4-90cf-cb49b931aa9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:21.936990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d1a50-a7bd-44b4-90cf-cb49b931aa9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:21.938466 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d1a50-a7bd-44b4-90cf-cb49b931aa9f None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:22.037281 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 579/1128] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:39:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 15:39:22.043845 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba90944-4ae5-4d00-b164-6cd1d1f16967 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:22.143867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba90944-4ae5-4d00-b164-6cd1d1f16967 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:22.178365 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a9663-3b31-4f6d-9a98-ac1fc54fc426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:22.179226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a9663-3b31-4f6d-9a98-ac1fc54fc426 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:22.179511 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a9663-3b31-4f6d-9a98-ac1fc54fc426 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:22.179790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a9663-3b31-4f6d-9a98-ac1fc54fc426 None admin] PATH_INFO: `/v3/projects/6bed94190a4149c8a6f97afe5cc88d87` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:22.180962 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a9663-3b31-4f6d-9a98-ac1fc54fc426 None admin] RBAC: Authorizing `identity:get_project(project_id=6bed94190a4149c8a6f97afe5cc88d87)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:22.182448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a9663-3b31-4f6d-9a98-ac1fc54fc426 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:22.184162 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 550/1129] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:39:22 2022] GET /identity/v3/projects/6bed94190a4149c8a6f97afe5cc88d87 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:22.190372 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d1a50-a7bd-44b4-90cf-cb49b931aa9f None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:22.211555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:22.288575 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d1a50-a7bd-44b4-90cf-cb49b931aa9f None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:22.321178 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58c25e-1adf-4f01-94bc-99ebe8a4b559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:22.321842 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58c25e-1adf-4f01-94bc-99ebe8a4b559 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:22.322126 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58c25e-1adf-4f01-94bc-99ebe8a4b559 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:22.322402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58c25e-1adf-4f01-94bc-99ebe8a4b559 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:22.323782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58c25e-1adf-4f01-94bc-99ebe8a4b559 None admin] RBAC: Adding query filter params (role.id=12fa8f67cf514b1e916afc130f0e6008, scope.project.id=6bed94190a4149c8a6f97afe5cc88d87, user.id=f75ee5000a8f426fa666c630047ca534) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:22.324130 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58c25e-1adf-4f01-94bc-99ebe8a4b559 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:22.325568 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58c25e-1adf-4f01-94bc-99ebe8a4b559 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:22.331779 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 580/1130] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:39:22 2022] GET /identity/v3/role_assignments?user.id=f75ee5000a8f426fa666c630047ca534&scope.project.id=6bed94190a4149c8a6f97afe5cc88d87&role.id=12fa8f67cf514b1e916afc130f0e6008 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:24.366274 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fa422-90c3-4c5e-98a4-f24cfb004eea None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:24.366807 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fa422-90c3-4c5e-98a4-f24cfb004eea None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:24.366807 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fa422-90c3-4c5e-98a4-f24cfb004eea None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:24.368177 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 551/1131] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:39:24.373916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331f636-893f-4c83-ad56-99a0d1404888 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:24.374345 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331f636-893f-4c83-ad56-99a0d1404888 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:24.374476 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331f636-893f-4c83-ad56-99a0d1404888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:24.390820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-2331f636-893f-4c83-ad56-99a0d1404888 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:39:24.392007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-2331f636-893f-4c83-ad56-99a0d1404888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:39:24.457589 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 581/1132] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:39:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:39:24.481450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fa422-90c3-4c5e-98a4-f24cfb004eea None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:24.530508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:24.582619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fa422-90c3-4c5e-98a4-f24cfb004eea None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:24.615294 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf9c12-4cd3-4c63-b71a-99ddac8ae99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:24.616085 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf9c12-4cd3-4c63-b71a-99ddac8ae99c None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:24.616423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf9c12-4cd3-4c63-b71a-99ddac8ae99c None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:24.616646 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf9c12-4cd3-4c63-b71a-99ddac8ae99c None admin] PATH_INFO: `/v3/domains/default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:24.617817 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf9c12-4cd3-4c63-b71a-99ddac8ae99c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:24.619281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf9c12-4cd3-4c63-b71a-99ddac8ae99c None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:24.621547 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 552/1133] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:39:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:24.627723 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331f636-893f-4c83-ad56-99a0d1404888 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:24.642665 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:24.724386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331f636-893f-4c83-ad56-99a0d1404888 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:24.756993 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a686f6-ea9c-4ec5-ac6c-8285f5e9a317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:24.757644 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a686f6-ea9c-4ec5-ac6c-8285f5e9a317 None admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:24.757953 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a686f6-ea9c-4ec5-ac6c-8285f5e9a317 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:24.758232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a686f6-ea9c-4ec5-ac6c-8285f5e9a317 None admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:24.758950 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a686f6-ea9c-4ec5-ac6c-8285f5e9a317 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:24.760429 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a686f6-ea9c-4ec5-ac6c-8285f5e9a317 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:24.786276 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 582/1134] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 23 15:39:24 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:39:26.832473 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442df8c-2545-4f20-bc79-379cebb5a29a None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:26.832983 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442df8c-2545-4f20-bc79-379cebb5a29a None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:26.832983 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442df8c-2545-4f20-bc79-379cebb5a29a None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:26.834340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 553/1135] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:39:26.840258 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e0e22-29d0-4cfe-9cc1-731105ae7680 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:26.840682 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e0e22-29d0-4cfe-9cc1-731105ae7680 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:26.840819 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e0e22-29d0-4cfe-9cc1-731105ae7680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:26.857149 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-e13e0e22-29d0-4cfe-9cc1-731105ae7680 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:39:26.858361 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e13e0e22-29d0-4cfe-9cc1-731105ae7680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:39:26.916513 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:26.924689 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 583/1136] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:39:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:39:26.950722 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442df8c-2545-4f20-bc79-379cebb5a29a None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:27.048240 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442df8c-2545-4f20-bc79-379cebb5a29a None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:27.064725 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:27.082386 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae09594-dc8c-436b-95c0-74f0329f9cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:27.083219 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae09594-dc8c-436b-95c0-74f0329f9cc3 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:27.083451 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae09594-dc8c-436b-95c0-74f0329f9cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:27.083725 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae09594-dc8c-436b-95c0-74f0329f9cc3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:27.084897 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae09594-dc8c-436b-95c0-74f0329f9cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:27.086870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae09594-dc8c-436b-95c0-74f0329f9cc3 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:27.087974 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 554/1137] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:39:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:27.093750 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e0e22-29d0-4cfe-9cc1-731105ae7680 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:27.191213 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e0e22-29d0-4cfe-9cc1-731105ae7680 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:27.224140 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a2e4e-2ec7-4775-bb98-02927d5b7ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:27.224809 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a2e4e-2ec7-4775-bb98-02927d5b7ddf None admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:27.225094 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a2e4e-2ec7-4775-bb98-02927d5b7ddf None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:27.225373 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a2e4e-2ec7-4775-bb98-02927d5b7ddf None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:27.226121 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a2e4e-2ec7-4775-bb98-02927d5b7ddf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:27.227570 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a2e4e-2ec7-4775-bb98-02927d5b7ddf None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:27.248697 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 584/1138] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 23 15:39:27 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:39:29.357723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91334ece-4174-4b32-9611-2c97d01bc2ff None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:29.358295 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91334ece-4174-4b32-9611-2c97d01bc2ff None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:29.358295 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91334ece-4174-4b32-9611-2c97d01bc2ff None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:29.359678 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 555/1139] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:39:29.365021 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc07f1-899c-4f9e-a397-847107b18f9e None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:29.365439 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc07f1-899c-4f9e-a397-847107b18f9e None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:29.365582 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc07f1-899c-4f9e-a397-847107b18f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:29.383153 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-95dc07f1-899c-4f9e-a397-847107b18f9e None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:39:29.384362 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-95dc07f1-899c-4f9e-a397-847107b18f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:39:29.432598 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:29.455509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 585/1140] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:39:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:39:29.480210 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91334ece-4174-4b32-9611-2c97d01bc2ff None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:29.585102 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91334ece-4174-4b32-9611-2c97d01bc2ff None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:29.618983 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d081a4-9243-46d8-9906-b202d4d31c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:29.619684 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d081a4-9243-46d8-9906-b202d4d31c89 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:29.619967 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d081a4-9243-46d8-9906-b202d4d31c89 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:29.620243 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d081a4-9243-46d8-9906-b202d4d31c89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:29.630159 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d081a4-9243-46d8-9906-b202d4d31c89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:39:29.638678 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-27d081a4-9243-46d8-9906-b202d4d31c89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:39:29.638678 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:29.638678 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:29.638678 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:29.638678 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:29.638678 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:29.638678 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:29.638678 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:29.638678 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:29.638678 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:29.638678 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:29.638678 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:29.638678 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:39:29.638678 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:39:29.638678 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:39:29.638678 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:39:29.639925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:39:29.639925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:39:29.639925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:39:29.639925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:39:29.639925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:29.639925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:29.639925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:29.639925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:29.639925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:29.639925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:29.639925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:29.639925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:29.639925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:29.639925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:29.639925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:29.639925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:29.641022 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:29.641022 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:29.641022 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:29.641022 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:29.641022 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:39:29.641022 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:39:29.641022 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:39:29.641022 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:39:29.641022 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:39:29.641022 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:39:29.641022 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:39:29.641022 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:39:29.641022 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 556/1141] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:39:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:39:29.646084 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc07f1-899c-4f9e-a397-847107b18f9e None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:29.753692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc07f1-899c-4f9e-a397-847107b18f9e None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:29.786683 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7edfc9-c5b5-4e22-bda7-c231e63641a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:29.787352 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7edfc9-c5b5-4e22-bda7-c231e63641a4 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:29.787635 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7edfc9-c5b5-4e22-bda7-c231e63641a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:29.787913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7edfc9-c5b5-4e22-bda7-c231e63641a4 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:29.788665 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7edfc9-c5b5-4e22-bda7-c231e63641a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:29.788971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7edfc9-c5b5-4e22-bda7-c231e63641a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:29.790377 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7edfc9-c5b5-4e22-bda7-c231e63641a4 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:29.798989 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 586/1142] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:39:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:39:29.804775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d081a4-9243-46d8-9906-b202d4d31c89 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:29.854751 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:29.909971 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d081a4-9243-46d8-9906-b202d4d31c89 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:29.942298 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faff646-456e-4401-80c0-a81426b31b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:29.943158 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faff646-456e-4401-80c0-a81426b31b14 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:29.943441 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faff646-456e-4401-80c0-a81426b31b14 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:29.943716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faff646-456e-4401-80c0-a81426b31b14 None admin] PATH_INFO: `/v3/users/e141b201673744c68634fa4553221200` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:29.956941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faff646-456e-4401-80c0-a81426b31b14 None admin] RBAC: Authorizing `identity:get_user(user_id=e141b201673744c68634fa4553221200)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:29.958397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faff646-456e-4401-80c0-a81426b31b14 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:29.960078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 557/1143] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:39:29 2022] GET /identity/v3/users/e141b201673744c68634fa4553221200 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:29.966558 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7edfc9-c5b5-4e22-bda7-c231e63641a4 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:30.018803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:30.065531 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7edfc9-c5b5-4e22-bda7-c231e63641a4 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:30.098121 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418980a-1794-4fc4-8cd3-54fb450885c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:30.098770 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418980a-1794-4fc4-8cd3-54fb450885c7 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:30.099053 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418980a-1794-4fc4-8cd3-54fb450885c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:30.099329 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418980a-1794-4fc4-8cd3-54fb450885c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:30.167431 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418980a-1794-4fc4-8cd3-54fb450885c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:30.168917 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418980a-1794-4fc4-8cd3-54fb450885c7 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:30.212402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:30.267147 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 587/1144] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:39:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 15:39:30.273197 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faff646-456e-4401-80c0-a81426b31b14 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:30.374008 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faff646-456e-4401-80c0-a81426b31b14 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:30.375556 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:30.410378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830fccb-0b21-44e3-a399-6e4e6c32f874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:30.411234 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830fccb-0b21-44e3-a399-6e4e6c32f874 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:30.411514 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830fccb-0b21-44e3-a399-6e4e6c32f874 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:30.411791 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830fccb-0b21-44e3-a399-6e4e6c32f874 None admin] PATH_INFO: `/v3/projects/d551a1f142ad4349804b8a4f1a492a1b` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:30.412950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830fccb-0b21-44e3-a399-6e4e6c32f874 None admin] RBAC: Authorizing `identity:get_project(project_id=d551a1f142ad4349804b8a4f1a492a1b)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:30.414409 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7830fccb-0b21-44e3-a399-6e4e6c32f874 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:30.416108 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 558/1145] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:39:30 2022] GET /identity/v3/projects/d551a1f142ad4349804b8a4f1a492a1b => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:30.422859 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418980a-1794-4fc4-8cd3-54fb450885c7 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:30.521866 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418980a-1794-4fc4-8cd3-54fb450885c7 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:30.556130 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec9cd2-1127-4d23-9602-1e3954554354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:30.556777 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec9cd2-1127-4d23-9602-1e3954554354 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:30.557648 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec9cd2-1127-4d23-9602-1e3954554354 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:30.558104 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec9cd2-1127-4d23-9602-1e3954554354 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:30.558936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec9cd2-1127-4d23-9602-1e3954554354 None admin] RBAC: Adding query filter params (role.id=abdc0e0957534149b3653eaa33cbd054, scope.project.id=d551a1f142ad4349804b8a4f1a492a1b, user.id=e141b201673744c68634fa4553221200) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:30.559248 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec9cd2-1127-4d23-9602-1e3954554354 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:30.560706 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec9cd2-1127-4d23-9602-1e3954554354 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:30.566252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 588/1146] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:39:30 2022] GET /identity/v3/role_assignments?user.id=e141b201673744c68634fa4553221200&scope.project.id=d551a1f142ad4349804b8a4f1a492a1b&role.id=abdc0e0957534149b3653eaa33cbd054 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:32.560926 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2413f-2b88-4e64-b20b-c11c01ac11bd None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:32.561463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2413f-2b88-4e64-b20b-c11c01ac11bd None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:32.561948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2413f-2b88-4e64-b20b-c11c01ac11bd None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:32.564399 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 559/1147] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:39:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:39:32.570240 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbc610-fd37-4b0e-80db-e271e6a31e27 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:32.570628 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbc610-fd37-4b0e-80db-e271e6a31e27 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:32.570800 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dbc610-fd37-4b0e-80db-e271e6a31e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:32.588905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-b3dbc610-fd37-4b0e-80db-e271e6a31e27 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:39:32.590314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-b3dbc610-fd37-4b0e-80db-e271e6a31e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:39:32.592273 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:32.656794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 589/1148] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:39:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:39:32.679566 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2413f-2b88-4e64-b20b-c11c01ac11bd None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:32.778845 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2413f-2b88-4e64-b20b-c11c01ac11bd None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:32.811614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9a8a4-49b9-4ad1-9671-c9b5d28bd523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:32.812326 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9a8a4-49b9-4ad1-9671-c9b5d28bd523 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:32.812602 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9a8a4-49b9-4ad1-9671-c9b5d28bd523 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:32.812872 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9a8a4-49b9-4ad1-9671-c9b5d28bd523 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:32.824225 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9a8a4-49b9-4ad1-9671-c9b5d28bd523 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:39:32.831727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-87b9a8a4-49b9-4ad1-9671-c9b5d28bd523 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:39:32.831727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:32.831727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:32.831727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:32.831727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:32.831727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:32.831727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:32.831727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:32.831727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:32.831727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:32.831727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:32.831727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:32.831727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:39:32.831727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:39:32.831727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:39:32.831727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:39:32.832968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:39:32.832968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:39:32.832968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:39:32.832968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:39:32.832968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:32.832968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:32.832968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:32.832968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:32.832968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:32.832968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:32.832968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:32.832968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:32.832968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:32.832968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:32.832968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:32.832968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:32.834034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:32.834034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:32.834034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:32.834034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:32.834034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:39:32.834034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:39:32.834034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:39:32.834034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:39:32.834034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:39:32.834034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:39:32.834034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:39:32.834034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:39:32.834034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 560/1149] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:39:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:39:32.839664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbc610-fd37-4b0e-80db-e271e6a31e27 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:32.937639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dbc610-fd37-4b0e-80db-e271e6a31e27 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:32.972560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8a57d-2635-45b9-bd67-8969c70ecbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:32.973226 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8a57d-2635-45b9-bd67-8969c70ecbd4 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:32.973507 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8a57d-2635-45b9-bd67-8969c70ecbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:32.973780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8a57d-2635-45b9-bd67-8969c70ecbd4 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:32.974558 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8a57d-2635-45b9-bd67-8969c70ecbd4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:32.974865 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8a57d-2635-45b9-bd67-8969c70ecbd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:32.976234 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8a57d-2635-45b9-bd67-8969c70ecbd4 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:32.981572 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:32.985562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 590/1150] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:39:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:32.990876 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9a8a4-49b9-4ad1-9671-c9b5d28bd523 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:33.022434 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:33.091738 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9a8a4-49b9-4ad1-9671-c9b5d28bd523 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:33.124688 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00870a-ebec-4303-b761-65a57455bdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:33.125559 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00870a-ebec-4303-b761-65a57455bdb1 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:33.125842 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00870a-ebec-4303-b761-65a57455bdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:33.126150 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00870a-ebec-4303-b761-65a57455bdb1 None admin] PATH_INFO: `/v3/users/e141b201673744c68634fa4553221200` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:33.127327 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00870a-ebec-4303-b761-65a57455bdb1 None admin] RBAC: Authorizing `identity:get_user(user_id=e141b201673744c68634fa4553221200)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:33.128765 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00870a-ebec-4303-b761-65a57455bdb1 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:33.130456 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 561/1151] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:39:32 2022] GET /identity/v3/users/e141b201673744c68634fa4553221200 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:33.136788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8a57d-2635-45b9-bd67-8969c70ecbd4 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:33.235277 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8a57d-2635-45b9-bd67-8969c70ecbd4 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:33.269636 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5ec023-80ca-4a5f-b13b-359d06c19a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:33.270529 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ec023-80ca-4a5f-b13b-359d06c19a9d None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:33.270812 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ec023-80ca-4a5f-b13b-359d06c19a9d None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:33.271086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5ec023-80ca-4a5f-b13b-359d06c19a9d None admin] PATH_INFO: `/v3/projects/d551a1f142ad4349804b8a4f1a492a1b` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:33.272313 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ec023-80ca-4a5f-b13b-359d06c19a9d None admin] RBAC: Authorizing `identity:get_project(project_id=d551a1f142ad4349804b8a4f1a492a1b)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:33.273772 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5ec023-80ca-4a5f-b13b-359d06c19a9d None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:33.275546 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 591/1152] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:39:33 2022] GET /identity/v3/projects/d551a1f142ad4349804b8a4f1a492a1b => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:33.281813 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00870a-ebec-4303-b761-65a57455bdb1 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:33.379059 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:33.383440 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00870a-ebec-4303-b761-65a57455bdb1 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:33.418083 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70efe38-7a58-493a-b484-e13ccca65b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:33.418974 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70efe38-7a58-493a-b484-e13ccca65b3f None admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:33.419262 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70efe38-7a58-493a-b484-e13ccca65b3f None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:33.419542 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70efe38-7a58-493a-b484-e13ccca65b3f None admin] PATH_INFO: `/v3/projects/d551a1f142ad4349804b8a4f1a492a1b/users/e141b201673744c68634fa4553221200/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:33.421534 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70efe38-7a58-493a-b484-e13ccca65b3f None admin] RBAC: Authorizing `identity:create_grant(project_id=d551a1f142ad4349804b8a4f1a492a1b, user_id=e141b201673744c68634fa4553221200, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:33.423004 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70efe38-7a58-493a-b484-e13ccca65b3f None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:33.436851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 562/1153] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 23 15:39:33 2022] PUT /identity/v3/projects/d551a1f142ad4349804b8a4f1a492a1b/users/e141b201673744c68634fa4553221200/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:39:35.690759 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2066b06-7887-40ba-ab0d-ec85fb11e03e None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:35.691277 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2066b06-7887-40ba-ab0d-ec85fb11e03e None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:35.691396 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2066b06-7887-40ba-ab0d-ec85fb11e03e None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:35.692692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 592/1154] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:39:35.698273 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c5dbd-c9bd-4b2c-828a-04a1a2acc5c3 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:35.698695 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c5dbd-c9bd-4b2c-828a-04a1a2acc5c3 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:35.698832 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c5dbd-c9bd-4b2c-828a-04a1a2acc5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:35.715219 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-282c5dbd-c9bd-4b2c-828a-04a1a2acc5c3 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:39:35.716401 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-282c5dbd-c9bd-4b2c-828a-04a1a2acc5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:39:35.786802 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 563/1155] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:39:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 15:39:35.811182 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2066b06-7887-40ba-ab0d-ec85fb11e03e None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:35.879758 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:35.915938 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2066b06-7887-40ba-ab0d-ec85fb11e03e None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:35.950712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc81aef-69de-4b0c-9e73-babf3d56d971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:35.951494 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc81aef-69de-4b0c-9e73-babf3d56d971 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:35.951781 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc81aef-69de-4b0c-9e73-babf3d56d971 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:35.952064 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc81aef-69de-4b0c-9e73-babf3d56d971 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:35.962321 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc81aef-69de-4b0c-9e73-babf3d56d971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:39:35.970374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-6cc81aef-69de-4b0c-9e73-babf3d56d971 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:39:35.970374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:35.970374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:35.970374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:35.970374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:35.970374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:35.970374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:35.970374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:35.970374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:35.970374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:35.970374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:35.970374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:35.970374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:39:35.970374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:39:35.970374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:39:35.970374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:39:35.971491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:39:35.971491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:39:35.971491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:39:35.971491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:39:35.971491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:35.971491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:35.971491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:35.971491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:35.971491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:35.971491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:35.971491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:35.971491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:35.971491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:35.971491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:35.971491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:35.971491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:35.972684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:35.972684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:35.972684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:35.972684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:35.972684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:39:35.972684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:39:35.972684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:39:35.972684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:39:35.972684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:39:35.972684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:39:35.972684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:39:35.972684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:39:35.972684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 593/1156] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:39:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:39:35.977564 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c5dbd-c9bd-4b2c-828a-04a1a2acc5c3 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:36.062078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:36.074763 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c5dbd-c9bd-4b2c-828a-04a1a2acc5c3 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:36.107208 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e262b1-d5c3-41fb-b09c-f23761155bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:36.107856 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e262b1-d5c3-41fb-b09c-f23761155bf4 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:36.108136 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e262b1-d5c3-41fb-b09c-f23761155bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:36.108408 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e262b1-d5c3-41fb-b09c-f23761155bf4 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:36.109150 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e262b1-d5c3-41fb-b09c-f23761155bf4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:36.109455 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e262b1-d5c3-41fb-b09c-f23761155bf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:36.110833 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e262b1-d5c3-41fb-b09c-f23761155bf4 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:36.118700 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 564/1157] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:39:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:36.124953 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc81aef-69de-4b0c-9e73-babf3d56d971 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:36.227177 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc81aef-69de-4b0c-9e73-babf3d56d971 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:36.258016 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:36.267181 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52ab7e-c970-40a2-a2bc-6efa08534432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:36.268186 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52ab7e-c970-40a2-a2bc-6efa08534432 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:36.268517 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52ab7e-c970-40a2-a2bc-6efa08534432 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:36.268846 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52ab7e-c970-40a2-a2bc-6efa08534432 None admin] PATH_INFO: `/v3/users/e141b201673744c68634fa4553221200` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:36.270251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52ab7e-c970-40a2-a2bc-6efa08534432 None admin] RBAC: Authorizing `identity:get_user(user_id=e141b201673744c68634fa4553221200)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:36.271934 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d52ab7e-c970-40a2-a2bc-6efa08534432 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:36.273977 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 594/1158] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:39:36 2022] GET /identity/v3/users/e141b201673744c68634fa4553221200 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:36.280791 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e262b1-d5c3-41fb-b09c-f23761155bf4 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:36.394789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e262b1-d5c3-41fb-b09c-f23761155bf4 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:36.431725 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e03efa-9b0d-4fb1-a058-a33f2b0314f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:36.433056 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e03efa-9b0d-4fb1-a058-a33f2b0314f7 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:36.433420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e03efa-9b0d-4fb1-a058-a33f2b0314f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:36.433761 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e03efa-9b0d-4fb1-a058-a33f2b0314f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:36.457099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:36.509448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e03efa-9b0d-4fb1-a058-a33f2b0314f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:36.510858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e03efa-9b0d-4fb1-a058-a33f2b0314f7 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:36.614575 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 565/1159] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:39:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 15:39:36.620980 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52ab7e-c970-40a2-a2bc-6efa08534432 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:36.725514 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52ab7e-c970-40a2-a2bc-6efa08534432 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:36.758343 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8fdea-d45b-476e-8166-fc86f274547f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:36.759183 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8fdea-d45b-476e-8166-fc86f274547f None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:36.759511 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8fdea-d45b-476e-8166-fc86f274547f None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:36.759731 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8fdea-d45b-476e-8166-fc86f274547f None admin] PATH_INFO: `/v3/projects/d551a1f142ad4349804b8a4f1a492a1b` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:36.760920 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8fdea-d45b-476e-8166-fc86f274547f None admin] RBAC: Authorizing `identity:get_project(project_id=d551a1f142ad4349804b8a4f1a492a1b)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:36.762365 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8fdea-d45b-476e-8166-fc86f274547f None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:36.764045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 595/1160] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:39:36 2022] GET /identity/v3/projects/d551a1f142ad4349804b8a4f1a492a1b => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:36.770537 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e03efa-9b0d-4fb1-a058-a33f2b0314f7 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:36.820746 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:36.871004 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e03efa-9b0d-4fb1-a058-a33f2b0314f7 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:36.903731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cbdc1-6781-4698-b124-5117ca690657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:36.904381 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cbdc1-6781-4698-b124-5117ca690657 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:36.904671 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cbdc1-6781-4698-b124-5117ca690657 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:36.904954 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cbdc1-6781-4698-b124-5117ca690657 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:36.905784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cbdc1-6781-4698-b124-5117ca690657 None admin] RBAC: Adding query filter params (role.id=abdc0e0957534149b3653eaa33cbd054, scope.project.id=d551a1f142ad4349804b8a4f1a492a1b, user.id=e141b201673744c68634fa4553221200) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:36.906386 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cbdc1-6781-4698-b124-5117ca690657 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:36.907797 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cbdc1-6781-4698-b124-5117ca690657 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:36.914025 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 566/1161] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:39:36 2022] GET /identity/v3/role_assignments?user.id=e141b201673744c68634fa4553221200&scope.project.id=d551a1f142ad4349804b8a4f1a492a1b&role.id=abdc0e0957534149b3653eaa33cbd054 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:38.975758 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc3ce7-6ff7-4c98-b337-50eaad4cdba6 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:38.976274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc3ce7-6ff7-4c98-b337-50eaad4cdba6 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:38.976368 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc3ce7-6ff7-4c98-b337-50eaad4cdba6 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:38.977680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 596/1162] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:39:38.983487 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b10f62-5a32-48a3-9940-38cc3a154e32 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:38.983892 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b10f62-5a32-48a3-9940-38cc3a154e32 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:38.984039 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b10f62-5a32-48a3-9940-38cc3a154e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:39.000668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-79b10f62-5a32-48a3-9940-38cc3a154e32 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:39:39.001933 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-79b10f62-5a32-48a3-9940-38cc3a154e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:39:39.066518 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 567/1163] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:39:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 15:39:39.089367 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc3ce7-6ff7-4c98-b337-50eaad4cdba6 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:39.150140 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:39.188892 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc3ce7-6ff7-4c98-b337-50eaad4cdba6 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:39.222289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3527ed-9ce9-4557-bc92-3ceb82dc7905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:39.222946 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3527ed-9ce9-4557-bc92-3ceb82dc7905 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:39.223232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3527ed-9ce9-4557-bc92-3ceb82dc7905 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:39.223513 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3527ed-9ce9-4557-bc92-3ceb82dc7905 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:39.292032 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3527ed-9ce9-4557-bc92-3ceb82dc7905 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:39.293419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3527ed-9ce9-4557-bc92-3ceb82dc7905 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:39.355570 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:39.393538 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 597/1164] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:39:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 15:39:39.399575 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b10f62-5a32-48a3-9940-38cc3a154e32 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:39.453735 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:39.505654 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b10f62-5a32-48a3-9940-38cc3a154e32 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:39.540140 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6151bf-cf0c-4d88-ae4f-853b2def0dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:39.540964 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6151bf-cf0c-4d88-ae4f-853b2def0dc9 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:39.541293 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6151bf-cf0c-4d88-ae4f-853b2def0dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:39.541569 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6151bf-cf0c-4d88-ae4f-853b2def0dc9 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:39.548760 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6151bf-cf0c-4d88-ae4f-853b2def0dc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:39.550218 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6151bf-cf0c-4d88-ae4f-853b2def0dc9 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:39.564858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-fc6151bf-cf0c-4d88-ae4f-853b2def0dc9 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 15:39:39.564858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:39.564858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 23 15:39:39.564858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 23 15:39:39.564858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:39:39.564858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:39:39.564858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:39:39.564858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:39:39.564858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 23 15:39:39.564858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:39:39.564858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:39:39.564858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:39:39.564858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:39.564858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:39.564858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:39.564858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:39.564858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:39.566057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:39.566057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:39.566057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:39.566057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:39.566057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:39.566057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:39.566057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:39:39.566057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:39:39.566057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:39:39.566057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:39:39.566057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:39.566057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:39.566057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:39.566057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:39.566057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:39.566057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:39.567713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:39.567713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:39.567713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:39.567713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:39.567713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:39.567713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:39.567713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:39.567713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:39.567713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:39.567713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:39.567713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 23 15:39:39.567713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:39:39.567713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 15:39:39.567713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:39:39.567713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 568/1165] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jun 23 15:39:39 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:39:39.572026 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3527ed-9ce9-4557-bc92-3ceb82dc7905 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:39.677355 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3527ed-9ce9-4557-bc92-3ceb82dc7905 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:39.711163 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ccd8a-c5a7-4d54-b982-1dc3c4187244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:39.711818 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ccd8a-c5a7-4d54-b982-1dc3c4187244 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:39.712105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ccd8a-c5a7-4d54-b982-1dc3c4187244 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:39.712382 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ccd8a-c5a7-4d54-b982-1dc3c4187244 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:39.713132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ccd8a-c5a7-4d54-b982-1dc3c4187244 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:39.713443 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ccd8a-c5a7-4d54-b982-1dc3c4187244 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:39.714838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ccd8a-c5a7-4d54-b982-1dc3c4187244 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:39.721846 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 598/1166] 10.222.0.15 () {56 vars in 1115 bytes} [Thu Jun 23 15:39:39 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:41.800384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b3527-2f05-497a-b07e-3c11dab26506 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:41.800939 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b3527-2f05-497a-b07e-3c11dab26506 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:41.800939 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b3527-2f05-497a-b07e-3c11dab26506 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:41.802366 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 569/1167] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:39:41.808199 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b60347-ce3e-4423-8c3d-a0e71e209fbf None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:41.808593 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b60347-ce3e-4423-8c3d-a0e71e209fbf None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:41.808754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b60347-ce3e-4423-8c3d-a0e71e209fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:41.830996 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-30b60347-ce3e-4423-8c3d-a0e71e209fbf None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:39:41.832104 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-30b60347-ce3e-4423-8c3d-a0e71e209fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:39:41.854556 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:41.897959 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 599/1168] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:39:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:39:41.922611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b3527-2f05-497a-b07e-3c11dab26506 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:42.028196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b3527-2f05-497a-b07e-3c11dab26506 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:42.030713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:42.064507 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d4acd-92e2-48a6-902d-a17bc707c35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:42.065194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d4acd-92e2-48a6-902d-a17bc707c35e None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:42.065481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d4acd-92e2-48a6-902d-a17bc707c35e None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:42.065760 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d4acd-92e2-48a6-902d-a17bc707c35e None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:42.066536 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d4acd-92e2-48a6-902d-a17bc707c35e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:42.067894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d4acd-92e2-48a6-902d-a17bc707c35e None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:42.082041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 570/1169] 10.222.0.15 () {60 vars in 1138 bytes} [Thu Jun 23 15:39:41 2022] POST /identity/v3/domains => generated 267 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:39:44.204661 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7855d-16d6-4bf9-a918-7b4ff4449e7a None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:44.205282 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7855d-16d6-4bf9-a918-7b4ff4449e7a None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:44.205282 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7855d-16d6-4bf9-a918-7b4ff4449e7a None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:44.206634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 600/1170] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:39:44.212013 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56427f7b-4b47-47af-9b08-ca6b5378a935 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:44.212487 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56427f7b-4b47-47af-9b08-ca6b5378a935 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:44.212588 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56427f7b-4b47-47af-9b08-ca6b5378a935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:44.230953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-56427f7b-4b47-47af-9b08-ca6b5378a935 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:39:44.232132 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-56427f7b-4b47-47af-9b08-ca6b5378a935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:39:44.298858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 571/1171] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:39:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:39:44.323016 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7855d-16d6-4bf9-a918-7b4ff4449e7a None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:44.424869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7855d-16d6-4bf9-a918-7b4ff4449e7a None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:44.458294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b206ad-f389-43c5-ad08-73ce314a5cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:44.459078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b206ad-f389-43c5-ad08-73ce314a5cc8 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:44.459360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b206ad-f389-43c5-ad08-73ce314a5cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:44.459640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b206ad-f389-43c5-ad08-73ce314a5cc8 None admin] PATH_INFO: `/v3/domains/a531b1ea0f2240939cb753d7e5822498` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:44.471478 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b206ad-f389-43c5-ad08-73ce314a5cc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a531b1ea0f2240939cb753d7e5822498)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:44.472929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b206ad-f389-43c5-ad08-73ce314a5cc8 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:44.474690 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 601/1172] 10.222.0.15 () {56 vars in 1183 bytes} [Thu Jun 23 15:39:44 2022] GET /identity/v3/domains/a531b1ea0f2240939cb753d7e5822498 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:44.481201 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56427f7b-4b47-47af-9b08-ca6b5378a935 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:44.576277 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:44.584032 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56427f7b-4b47-47af-9b08-ca6b5378a935 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:44.619388 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1af39-23da-4260-9b48-b181709646b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:44.620042 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1af39-23da-4260-9b48-b181709646b5 None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:44.620329 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1af39-23da-4260-9b48-b181709646b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:44.620661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1af39-23da-4260-9b48-b181709646b5 None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:44.621380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1af39-23da-4260-9b48-b181709646b5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:44.622827 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1af39-23da-4260-9b48-b181709646b5 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:44.655933 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 572/1173] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 23 15:39:44 2022] POST /identity/v3/projects => generated 361 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:39:46.769252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e251611-7762-4ada-bfda-1792e389728a None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:46.769819 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e251611-7762-4ada-bfda-1792e389728a None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:46.769819 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e251611-7762-4ada-bfda-1792e389728a None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:46.771236 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 602/1174] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:39:46.776555 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a232e0-13d1-45aa-a38f-8b530c1b0ce2 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:46.776936 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a232e0-13d1-45aa-a38f-8b530c1b0ce2 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:46.777135 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a232e0-13d1-45aa-a38f-8b530c1b0ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:46.794390 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-d9a232e0-13d1-45aa-a38f-8b530c1b0ce2 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:39:46.795586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-d9a232e0-13d1-45aa-a38f-8b530c1b0ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:39:46.860144 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 573/1175] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:39:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:39:46.885391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e251611-7762-4ada-bfda-1792e389728a None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:46.905113 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:46.986188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e251611-7762-4ada-bfda-1792e389728a None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:47.019972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d76284-433d-4c91-9580-02168c814a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:47.020841 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d76284-433d-4c91-9580-02168c814a43 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:47.021126 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d76284-433d-4c91-9580-02168c814a43 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:47.021403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d76284-433d-4c91-9580-02168c814a43 None admin] PATH_INFO: `/v3/domains/a531b1ea0f2240939cb753d7e5822498` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:47.022621 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d76284-433d-4c91-9580-02168c814a43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a531b1ea0f2240939cb753d7e5822498)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:47.024058 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d76284-433d-4c91-9580-02168c814a43 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:47.026378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 603/1176] 10.222.0.15 () {56 vars in 1183 bytes} [Thu Jun 23 15:39:46 2022] GET /identity/v3/domains/a531b1ea0f2240939cb753d7e5822498 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:47.032305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a232e0-13d1-45aa-a38f-8b530c1b0ce2 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:47.106605 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:47.130853 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a232e0-13d1-45aa-a38f-8b530c1b0ce2 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:47.163935 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef070096-9bca-4e2d-8e0e-a8c7a0fd3701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:47.164674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef070096-9bca-4e2d-8e0e-a8c7a0fd3701 None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:47.164990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef070096-9bca-4e2d-8e0e-a8c7a0fd3701 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:47.165271 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef070096-9bca-4e2d-8e0e-a8c7a0fd3701 None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:47.166608 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef070096-9bca-4e2d-8e0e-a8c7a0fd3701 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:47.168033 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef070096-9bca-4e2d-8e0e-a8c7a0fd3701 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:47.188190 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 574/1177] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 23 15:39:47 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:39:49.294378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb3963-3bb7-4bfb-8eb1-c7eced92b1c0 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:49.294917 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb3963-3bb7-4bfb-8eb1-c7eced92b1c0 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:49.295355 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb3963-3bb7-4bfb-8eb1-c7eced92b1c0 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:49.297178 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 604/1178] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:39:49.304328 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecded2-2a2a-41f7-894a-8b3d02632d75 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:49.304749 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecded2-2a2a-41f7-894a-8b3d02632d75 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:49.304888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecded2-2a2a-41f7-894a-8b3d02632d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:49.323304 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-84ecded2-2a2a-41f7-894a-8b3d02632d75 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:39:49.324477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-84ecded2-2a2a-41f7-894a-8b3d02632d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:39:49.388871 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 575/1179] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:39:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:39:49.412667 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb3963-3bb7-4bfb-8eb1-c7eced92b1c0 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:49.496812 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:49.512790 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb3963-3bb7-4bfb-8eb1-c7eced92b1c0 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:49.544963 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be644e-91ec-4ad4-846f-98f98bf2c60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:49.545690 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be644e-91ec-4ad4-846f-98f98bf2c60c None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:49.546011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be644e-91ec-4ad4-846f-98f98bf2c60c None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:49.546295 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be644e-91ec-4ad4-846f-98f98bf2c60c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:49.557202 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be644e-91ec-4ad4-846f-98f98bf2c60c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:39:49.564788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-e4be644e-91ec-4ad4-846f-98f98bf2c60c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:39:49.564788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:49.564788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:49.564788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:49.564788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:49.564788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:49.564788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:49.564788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:49.564788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:49.564788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:49.564788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:49.564788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:49.564788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:39:49.564788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:39:49.564788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:39:49.564788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:39:49.565979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:39:49.565979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:39:49.565979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:39:49.565979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:39:49.565979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:49.565979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:49.565979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:49.565979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:49.565979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:49.565979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:49.565979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:49.565979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:49.565979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:49.565979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:49.565979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:49.565979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:49.567117 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:49.567117 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:49.567117 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:49.567117 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:49.567117 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:39:49.567117 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:39:49.567117 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:39:49.567117 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:39:49.567117 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:39:49.567117 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:39:49.567117 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:39:49.567117 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:39:49.567117 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 605/1180] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:39:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:39:49.571979 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecded2-2a2a-41f7-894a-8b3d02632d75 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:49.630779 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:49.669805 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecded2-2a2a-41f7-894a-8b3d02632d75 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:49.709783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86118bf2-2126-4d8b-9f4a-13dc99623cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:49.710495 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86118bf2-2126-4d8b-9f4a-13dc99623cfc None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:49.710780 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86118bf2-2126-4d8b-9f4a-13dc99623cfc None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:49.711056 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86118bf2-2126-4d8b-9f4a-13dc99623cfc None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:49.711826 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86118bf2-2126-4d8b-9f4a-13dc99623cfc None admin] RBAC: Adding query filter params (name=admin) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:49.712136 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86118bf2-2126-4d8b-9f4a-13dc99623cfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:49.713579 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86118bf2-2126-4d8b-9f4a-13dc99623cfc None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:49.725637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 576/1181] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:39:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:49.732345 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be644e-91ec-4ad4-846f-98f98bf2c60c None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:49.836814 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be644e-91ec-4ad4-846f-98f98bf2c60c None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:49.873283 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a723e-7d3e-414f-8d7b-e7ca69503dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:49.874209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a723e-7d3e-414f-8d7b-e7ca69503dba None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:49.874498 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a723e-7d3e-414f-8d7b-e7ca69503dba None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:49.874778 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a723e-7d3e-414f-8d7b-e7ca69503dba None admin] PATH_INFO: `/v3/users/a2c0c425b5f64a83bfff270c20c68bfa` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:49.890380 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a723e-7d3e-414f-8d7b-e7ca69503dba None admin] RBAC: Authorizing `identity:get_user(user_id=a2c0c425b5f64a83bfff270c20c68bfa)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:49.891863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723a723e-7d3e-414f-8d7b-e7ca69503dba None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:49.893660 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 606/1182] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:39:49 2022] GET /identity/v3/users/a2c0c425b5f64a83bfff270c20c68bfa => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:49.899855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86118bf2-2126-4d8b-9f4a-13dc99623cfc None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:50.007500 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86118bf2-2126-4d8b-9f4a-13dc99623cfc None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:50.031994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:50.042907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd843f0-153f-4dc4-a1bb-ce5664d928d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:50.043560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd843f0-153f-4dc4-a1bb-ce5664d928d7 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:50.043847 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd843f0-153f-4dc4-a1bb-ce5664d928d7 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:50.044124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd843f0-153f-4dc4-a1bb-ce5664d928d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:50.110594 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd843f0-153f-4dc4-a1bb-ce5664d928d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:50.111957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd843f0-153f-4dc4-a1bb-ce5664d928d7 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:50.211434 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 577/1183] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:39:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 15:39:50.217980 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a723e-7d3e-414f-8d7b-e7ca69503dba None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:50.221788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:50.318383 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a723e-7d3e-414f-8d7b-e7ca69503dba None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:50.351432 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33756a9f-128c-43cf-b873-b39907012614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:50.352273 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33756a9f-128c-43cf-b873-b39907012614 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:50.352550 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33756a9f-128c-43cf-b873-b39907012614 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:50.352821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33756a9f-128c-43cf-b873-b39907012614 None admin] PATH_INFO: `/v3/projects/0ca73da202f9419180eab2dc0e35da99` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:50.354619 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33756a9f-128c-43cf-b873-b39907012614 None admin] RBAC: Authorizing `identity:get_project(project_id=0ca73da202f9419180eab2dc0e35da99)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:50.356058 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33756a9f-128c-43cf-b873-b39907012614 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:50.357782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 607/1184] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:39:50 2022] GET /identity/v3/projects/0ca73da202f9419180eab2dc0e35da99 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:50.364122 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd843f0-153f-4dc4-a1bb-ce5664d928d7 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:50.388874 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:50.461580 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd843f0-153f-4dc4-a1bb-ce5664d928d7 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:50.494742 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af94418-71f8-4e87-a011-0b5af2bacc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:50.495489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af94418-71f8-4e87-a011-0b5af2bacc7c None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:50.495772 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af94418-71f8-4e87-a011-0b5af2bacc7c None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:50.496044 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af94418-71f8-4e87-a011-0b5af2bacc7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:50.496890 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af94418-71f8-4e87-a011-0b5af2bacc7c None admin] RBAC: Adding query filter params (role.id=abdc0e0957534149b3653eaa33cbd054, scope.project.id=0ca73da202f9419180eab2dc0e35da99, user.id=a2c0c425b5f64a83bfff270c20c68bfa) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:50.497199 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af94418-71f8-4e87-a011-0b5af2bacc7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:50.498641 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af94418-71f8-4e87-a011-0b5af2bacc7c None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:50.503902 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 578/1185] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:39:50 2022] GET /identity/v3/role_assignments?user.id=a2c0c425b5f64a83bfff270c20c68bfa&scope.project.id=0ca73da202f9419180eab2dc0e35da99&role.id=abdc0e0957534149b3653eaa33cbd054 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:52.514158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afce85d-a983-417e-b982-ab6816626b36 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:52.514722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afce85d-a983-417e-b982-ab6816626b36 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:52.514722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afce85d-a983-417e-b982-ab6816626b36 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:52.516091 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 608/1186] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:39:52.521629 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f77b9f-e648-43eb-ae2c-4bc6b79540da None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:52.522077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f77b9f-e648-43eb-ae2c-4bc6b79540da None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:52.522286 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f77b9f-e648-43eb-ae2c-4bc6b79540da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:52.540150 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-30f77b9f-e648-43eb-ae2c-4bc6b79540da None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:39:52.541948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-30f77b9f-e648-43eb-ae2c-4bc6b79540da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:39:52.611545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 579/1187] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:39:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:39:52.635018 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afce85d-a983-417e-b982-ab6816626b36 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:52.707327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:52.738696 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afce85d-a983-417e-b982-ab6816626b36 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:52.773269 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608d0fa-399c-4d7e-a3fc-4e3a4bdc8eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:52.774006 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608d0fa-399c-4d7e-a3fc-4e3a4bdc8eb8 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:52.774365 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608d0fa-399c-4d7e-a3fc-4e3a4bdc8eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:52.774644 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608d0fa-399c-4d7e-a3fc-4e3a4bdc8eb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:52.785890 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608d0fa-399c-4d7e-a3fc-4e3a4bdc8eb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:39:52.795641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-6608d0fa-399c-4d7e-a3fc-4e3a4bdc8eb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:39:52.795641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:52.795641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:52.795641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:52.795641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:52.795641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:52.795641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:52.795641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:52.795641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:52.795641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:52.795641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:52.795641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:52.795641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:39:52.795641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:39:52.795641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:39:52.795641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:39:52.796815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:39:52.796815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:39:52.796815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:39:52.796815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:39:52.796815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:52.796815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:52.796815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:52.796815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:52.796815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:52.796815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:52.796815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:52.796815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:52.796815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:52.796815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:52.796815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:52.796815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:52.797947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:52.797947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:52.797947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:52.797947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:52.797947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:39:52.797947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:39:52.797947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:39:52.797947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:39:52.797947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:39:52.797947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:39:52.797947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:39:52.797947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:39:52.797947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 609/1188] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:39:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:39:52.803276 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f77b9f-e648-43eb-ae2c-4bc6b79540da None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:52.822831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:52.907572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f77b9f-e648-43eb-ae2c-4bc6b79540da None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:52.942609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7dd0e2-20a9-47f0-b10c-5ed0da3ca1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:52.943268 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dd0e2-20a9-47f0-b10c-5ed0da3ca1c3 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:52.943548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dd0e2-20a9-47f0-b10c-5ed0da3ca1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:52.943830 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dd0e2-20a9-47f0-b10c-5ed0da3ca1c3 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:52.944598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7dd0e2-20a9-47f0-b10c-5ed0da3ca1c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:52.944903 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7dd0e2-20a9-47f0-b10c-5ed0da3ca1c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:52.946287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7dd0e2-20a9-47f0-b10c-5ed0da3ca1c3 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:52.954296 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 580/1189] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:39:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:52.960979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608d0fa-399c-4d7e-a3fc-4e3a4bdc8eb8 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:53.068298 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608d0fa-399c-4d7e-a3fc-4e3a4bdc8eb8 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:53.095226 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:53.100467 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ad33e-df91-4849-98d0-941d1ab48a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:53.101330 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ad33e-df91-4849-98d0-941d1ab48a70 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:53.101613 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ad33e-df91-4849-98d0-941d1ab48a70 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:53.101911 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ad33e-df91-4849-98d0-941d1ab48a70 None admin] PATH_INFO: `/v3/users/a2c0c425b5f64a83bfff270c20c68bfa` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:53.103085 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ad33e-df91-4849-98d0-941d1ab48a70 None admin] RBAC: Authorizing `identity:get_user(user_id=a2c0c425b5f64a83bfff270c20c68bfa)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:53.105009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ad33e-df91-4849-98d0-941d1ab48a70 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:53.106647 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 610/1190] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:39:52 2022] GET /identity/v3/users/a2c0c425b5f64a83bfff270c20c68bfa => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:53.112368 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7dd0e2-20a9-47f0-b10c-5ed0da3ca1c3 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:53.191661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:53.210115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7dd0e2-20a9-47f0-b10c-5ed0da3ca1c3 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:53.242497 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441869fd-85a0-4706-8396-624db7be2643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:53.243343 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441869fd-85a0-4706-8396-624db7be2643 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:53.243629 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441869fd-85a0-4706-8396-624db7be2643 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:53.243902 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441869fd-85a0-4706-8396-624db7be2643 None admin] PATH_INFO: `/v3/projects/0ca73da202f9419180eab2dc0e35da99` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:53.245042 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441869fd-85a0-4706-8396-624db7be2643 None admin] RBAC: Authorizing `identity:get_project(project_id=0ca73da202f9419180eab2dc0e35da99)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:53.246476 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441869fd-85a0-4706-8396-624db7be2643 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:53.248150 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 581/1191] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:39:53 2022] GET /identity/v3/projects/0ca73da202f9419180eab2dc0e35da99 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:53.254007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ad33e-df91-4849-98d0-941d1ab48a70 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:53.360965 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ad33e-df91-4849-98d0-941d1ab48a70 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:53.391926 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e0a8e-02d2-4dd9-a24c-380eebda0fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:53.392782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e0a8e-02d2-4dd9-a24c-380eebda0fcb None admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:53.393063 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e0a8e-02d2-4dd9-a24c-380eebda0fcb None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:53.393336 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e0a8e-02d2-4dd9-a24c-380eebda0fcb None admin] PATH_INFO: `/v3/projects/0ca73da202f9419180eab2dc0e35da99/users/a2c0c425b5f64a83bfff270c20c68bfa/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:53.395303 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e0a8e-02d2-4dd9-a24c-380eebda0fcb None admin] RBAC: Authorizing `identity:create_grant(project_id=0ca73da202f9419180eab2dc0e35da99, user_id=a2c0c425b5f64a83bfff270c20c68bfa, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:53.396720 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e0a8e-02d2-4dd9-a24c-380eebda0fcb None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:53.409697 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 611/1192] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 23 15:39:53 2022] PUT /identity/v3/projects/0ca73da202f9419180eab2dc0e35da99/users/a2c0c425b5f64a83bfff270c20c68bfa/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:39:55.599011 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa38cd-aa50-48d0-a547-7bf13d5e7332 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:55.599529 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa38cd-aa50-48d0-a547-7bf13d5e7332 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:55.599621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa38cd-aa50-48d0-a547-7bf13d5e7332 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:55.600910 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 582/1193] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:39:55.606632 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75293e89-3694-47b6-920e-5ceafafd153a None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:55.607047 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75293e89-3694-47b6-920e-5ceafafd153a None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:55.607190 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75293e89-3694-47b6-920e-5ceafafd153a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:55.624647 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-75293e89-3694-47b6-920e-5ceafafd153a None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:39:55.626025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-75293e89-3694-47b6-920e-5ceafafd153a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:39:55.686998 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:55.699485 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 612/1194] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:39:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:39:55.724625 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa38cd-aa50-48d0-a547-7bf13d5e7332 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:55.831607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa38cd-aa50-48d0-a547-7bf13d5e7332 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:55.864600 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11800f3a-e35e-4e9c-a3a3-8069b542fc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:55.865388 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11800f3a-e35e-4e9c-a3a3-8069b542fc3f None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:55.865676 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11800f3a-e35e-4e9c-a3a3-8069b542fc3f None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:55.865988 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11800f3a-e35e-4e9c-a3a3-8069b542fc3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:55.875823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11800f3a-e35e-4e9c-a3a3-8069b542fc3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:39:55.883332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-11800f3a-e35e-4e9c-a3a3-8069b542fc3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:39:55.883332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:39:55.883332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:39:55.883332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:39:55.883332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:39:55.883332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:39:55.883332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:39:55.883332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:39:55.883332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:39:55.883332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:39:55.883332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:39:55.883332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:39:55.883332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:39:55.883332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:39:55.883332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:39:55.883332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:39:55.884930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:39:55.884930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:39:55.884930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:39:55.884930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:39:55.884930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:39:55.884930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:39:55.884930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:39:55.884930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:39:55.884930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:39:55.884930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:39:55.884930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:39:55.884930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:39:55.884930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:39:55.884930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:39:55.884930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:39:55.884930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:39:55.885792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:39:55.885792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:39:55.885792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:39:55.885792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:39:55.885792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:39:55.885792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:39:55.885792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:39:55.885792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:39:55.885792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:39:55.885792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:39:55.885792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:39:55.885792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:39:55.885792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 583/1195] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:39:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:39:55.891175 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75293e89-3694-47b6-920e-5ceafafd153a None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:55.991247 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75293e89-3694-47b6-920e-5ceafafd153a None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:56.024731 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03b08b-1381-438f-a75b-882c57de92bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:56.025413 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03b08b-1381-438f-a75b-882c57de92bd None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:56.025699 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03b08b-1381-438f-a75b-882c57de92bd None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:56.025999 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03b08b-1381-438f-a75b-882c57de92bd None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:56.026740 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03b08b-1381-438f-a75b-882c57de92bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:56.027046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03b08b-1381-438f-a75b-882c57de92bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:56.028403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03b08b-1381-438f-a75b-882c57de92bd None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:56.036482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 613/1196] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:39:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:56.042783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11800f3a-e35e-4e9c-a3a3-8069b542fc3f None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:56.053988 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:56.139617 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11800f3a-e35e-4e9c-a3a3-8069b542fc3f None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:56.173389 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335d768-d87b-45ca-878d-51fa180585cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:56.174278 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335d768-d87b-45ca-878d-51fa180585cb None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:56.174565 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335d768-d87b-45ca-878d-51fa180585cb None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:56.174872 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335d768-d87b-45ca-878d-51fa180585cb None admin] PATH_INFO: `/v3/users/a2c0c425b5f64a83bfff270c20c68bfa` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:56.176051 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335d768-d87b-45ca-878d-51fa180585cb None admin] RBAC: Authorizing `identity:get_user(user_id=a2c0c425b5f64a83bfff270c20c68bfa)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:56.177478 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335d768-d87b-45ca-878d-51fa180585cb None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:56.179145 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 584/1197] 10.222.0.15 () {56 vars in 1177 bytes} [Thu Jun 23 15:39:56 2022] GET /identity/v3/users/a2c0c425b5f64a83bfff270c20c68bfa => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:56.184818 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03b08b-1381-438f-a75b-882c57de92bd None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:56.236165 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:56.287708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03b08b-1381-438f-a75b-882c57de92bd None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:56.321159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92250d-68a7-43d2-816b-39e25d55694d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:56.321795 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92250d-68a7-43d2-816b-39e25d55694d None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:56.322109 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92250d-68a7-43d2-816b-39e25d55694d None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:56.322387 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92250d-68a7-43d2-816b-39e25d55694d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:56.385997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92250d-68a7-43d2-816b-39e25d55694d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:56.387415 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a92250d-68a7-43d2-816b-39e25d55694d None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:56.435669 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:56.481527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 614/1198] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:39:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 15:39:56.487346 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335d768-d87b-45ca-878d-51fa180585cb None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:56.564265 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:39:56.587293 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335d768-d87b-45ca-878d-51fa180585cb None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:56.621003 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4fc5d-3c5f-49f3-9c7c-acedafd3b056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:56.621870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4fc5d-3c5f-49f3-9c7c-acedafd3b056 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:56.622173 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4fc5d-3c5f-49f3-9c7c-acedafd3b056 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:56.622450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4fc5d-3c5f-49f3-9c7c-acedafd3b056 None admin] PATH_INFO: `/v3/projects/0ca73da202f9419180eab2dc0e35da99` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:56.623616 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4fc5d-3c5f-49f3-9c7c-acedafd3b056 None admin] RBAC: Authorizing `identity:get_project(project_id=0ca73da202f9419180eab2dc0e35da99)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:56.625041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4fc5d-3c5f-49f3-9c7c-acedafd3b056 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:56.626779 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 585/1199] 10.222.0.15 () {56 vars in 1186 bytes} [Thu Jun 23 15:39:56 2022] GET /identity/v3/projects/0ca73da202f9419180eab2dc0e35da99 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:39:56.633096 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92250d-68a7-43d2-816b-39e25d55694d None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:39:56.729473 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a92250d-68a7-43d2-816b-39e25d55694d None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:39:56.761959 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8048ca5-61ee-4fa7-84c7-c1da4d90ca9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:39:56.762603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8048ca5-61ee-4fa7-84c7-c1da4d90ca9d None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:39:56.762891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8048ca5-61ee-4fa7-84c7-c1da4d90ca9d None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:39:56.763171 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8048ca5-61ee-4fa7-84c7-c1da4d90ca9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:39:56.763998 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8048ca5-61ee-4fa7-84c7-c1da4d90ca9d None admin] RBAC: Adding query filter params (role.id=abdc0e0957534149b3653eaa33cbd054, scope.project.id=0ca73da202f9419180eab2dc0e35da99, user.id=a2c0c425b5f64a83bfff270c20c68bfa) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:39:56.764316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8048ca5-61ee-4fa7-84c7-c1da4d90ca9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:39:56.765745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8048ca5-61ee-4fa7-84c7-c1da4d90ca9d None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:39:56.771522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 615/1200] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:39:56 2022] GET /identity/v3/role_assignments?user.id=a2c0c425b5f64a83bfff270c20c68bfa&scope.project.id=0ca73da202f9419180eab2dc0e35da99&role.id=abdc0e0957534149b3653eaa33cbd054 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:40:06.617160 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=28 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:40:06.769328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=92 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:40:53.047344 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cb2b2-970a-43c6-8f57-fa620e738abf None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:40:53.047943 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cb2b2-970a-43c6-8f57-fa620e738abf None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:40:53.047943 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0cb2b2-970a-43c6-8f57-fa620e738abf None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:40:53.049264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 586/1201] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:40:53.056786 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3a79a-c330-4328-ac55-b52e8a8c4897 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:40:53.056786 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3a79a-c330-4328-ac55-b52e8a8c4897 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:40:53.056786 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3a79a-c330-4328-ac55-b52e8a8c4897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:40:53.076479 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-98f3a79a-c330-4328-ac55-b52e8a8c4897 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:40:53.077985 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-98f3a79a-c330-4328-ac55-b52e8a8c4897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:40:53.168560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 616/1202] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:40:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:40:53.197363 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cb2b2-970a-43c6-8f57-fa620e738abf None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:40:53.340353 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0cb2b2-970a-43c6-8f57-fa620e738abf None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:40:53.386878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856eccf2-ce0a-4f99-9082-8ca6bab9e451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:40:53.387828 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856eccf2-ce0a-4f99-9082-8ca6bab9e451 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:40:53.387953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856eccf2-ce0a-4f99-9082-8ca6bab9e451 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:40:53.388215 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856eccf2-ce0a-4f99-9082-8ca6bab9e451 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:40:53.404063 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856eccf2-ce0a-4f99-9082-8ca6bab9e451 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:40:53.405540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856eccf2-ce0a-4f99-9082-8ca6bab9e451 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:40:53.426489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-856eccf2-ce0a-4f99-9082-8ca6bab9e451 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:40:53.426489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:40:53.426489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:40:53.426489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:40:53.426489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:40:53.426489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:40:53.426489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:40:53.426489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:40:53.426489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:40:53.426489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:40:53.426489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:40:53.426489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:40:53.426489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:40:53.426489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:40:53.426489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:40:53.427655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:40:53.427655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:40:53.427655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:40:53.427655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:40:53.427655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:40:53.427655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:40:53.427655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:40:53.427655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:40:53.427655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:40:53.427655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:40:53.427655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:40:53.427655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:40:53.427655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:40:53.427655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:40:53.427655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:40:53.427655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:40:53.427655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:40:53.428635 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:40:53.428635 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:40:53.428635 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:40:53.428635 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:40:53.428635 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 587/1203] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:40:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:40:53.434344 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3a79a-c330-4328-ac55-b52e8a8c4897 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:40:53.570152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3a79a-c330-4328-ac55-b52e8a8c4897 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:40:53.624163 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:40:53.631985 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b26b74-1cbb-4ed3-b266-56e489a990fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:40:53.636334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b26b74-1cbb-4ed3-b266-56e489a990fa None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:40:53.636334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b26b74-1cbb-4ed3-b266-56e489a990fa None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:40:53.636334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b26b74-1cbb-4ed3-b266-56e489a990fa None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:40:53.636334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b26b74-1cbb-4ed3-b266-56e489a990fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:40:53.636334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b26b74-1cbb-4ed3-b266-56e489a990fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:40:53.637082 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b26b74-1cbb-4ed3-b266-56e489a990fa None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:40:53.651917 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 617/1204] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:40:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:40:53.659057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856eccf2-ce0a-4f99-9082-8ca6bab9e451 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:40:53.758885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:40:53.824226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856eccf2-ce0a-4f99-9082-8ca6bab9e451 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:40:53.868929 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6fc37-44e4-4098-b6d9-4f3323bd65d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:40:53.869667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6fc37-44e4-4098-b6d9-4f3323bd65d3 None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:40:53.870115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6fc37-44e4-4098-b6d9-4f3323bd65d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:40:53.870416 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6fc37-44e4-4098-b6d9-4f3323bd65d3 None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:40:53.871353 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6fc37-44e4-4098-b6d9-4f3323bd65d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:40:53.876471 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6fc37-44e4-4098-b6d9-4f3323bd65d3 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:40:53.902958 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 588/1205] 10.222.0.15 () {60 vars in 1132 bytes} [Thu Jun 23 15:40:53 2022] POST /identity/v3/users => generated 251 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:40:56.425621 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe460c1-5020-4bad-863f-034992d408a3 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:40:56.426205 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe460c1-5020-4bad-863f-034992d408a3 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:40:56.426205 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe460c1-5020-4bad-863f-034992d408a3 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:40:56.427564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 618/1206] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:40:56.433836 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a84a7-b2b4-4316-a453-c278c73c084e None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:40:56.434611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a84a7-b2b4-4316-a453-c278c73c084e None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:40:56.434611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a84a7-b2b4-4316-a453-c278c73c084e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:40:56.454162 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-809a84a7-b2b4-4316-a453-c278c73c084e None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:40:56.456069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-809a84a7-b2b4-4316-a453-c278c73c084e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:40:56.537476 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 589/1207] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:40:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:40:56.563615 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe460c1-5020-4bad-863f-034992d408a3 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:40:56.692175 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe460c1-5020-4bad-863f-034992d408a3 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:40:56.730353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cef81-7f65-4df8-ba86-b40a267a9594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:40:56.731136 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cef81-7f65-4df8-ba86-b40a267a9594 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:40:56.731432 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cef81-7f65-4df8-ba86-b40a267a9594 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:40:56.731723 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cef81-7f65-4df8-ba86-b40a267a9594 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:40:56.744173 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256cef81-7f65-4df8-ba86-b40a267a9594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:40:56.752007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-256cef81-7f65-4df8-ba86-b40a267a9594 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:40:56.752007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:40:56.752007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:40:56.752007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:40:56.752007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:40:56.752007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:40:56.752007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:40:56.752007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:40:56.752007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:40:56.752007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:40:56.752007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:40:56.752007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:40:56.752007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:40:56.752007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:40:56.752007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:40:56.752007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:40:56.753044 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:40:56.753044 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:40:56.753044 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:40:56.753044 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:40:56.753044 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:40:56.753044 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:40:56.753044 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:40:56.753044 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:40:56.753044 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:40:56.753044 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:40:56.753044 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:40:56.753044 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:40:56.753044 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:40:56.753044 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:40:56.753044 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:40:56.753044 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:40:56.753928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:40:56.753928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:40:56.753928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:40:56.753928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:40:56.753928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:40:56.753928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:40:56.753928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:40:56.753928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:40:56.753928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:40:56.753928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:40:56.753928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:40:56.753928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:40:56.753928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 619/1208] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 23 15:40:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:40:56.759925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a84a7-b2b4-4316-a453-c278c73c084e None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:40:56.805732 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:40:56.877983 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a84a7-b2b4-4316-a453-c278c73c084e None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:40:56.920419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459756e0-57fb-4d1b-9e22-63b21999146d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:40:56.921139 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459756e0-57fb-4d1b-9e22-63b21999146d None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:40:56.921396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459756e0-57fb-4d1b-9e22-63b21999146d None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:40:56.921677 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459756e0-57fb-4d1b-9e22-63b21999146d None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:40:56.922506 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459756e0-57fb-4d1b-9e22-63b21999146d None admin] RBAC: Adding query filter params (name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:40:56.922826 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459756e0-57fb-4d1b-9e22-63b21999146d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:40:56.924216 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459756e0-57fb-4d1b-9e22-63b21999146d None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:40:56.934627 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 590/1209] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 23 15:40:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:40:56.940376 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cef81-7f65-4df8-ba86-b40a267a9594 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:40:57.004789 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:40:57.069879 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cef81-7f65-4df8-ba86-b40a267a9594 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:40:57.111676 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6d106-dc0c-459e-8224-e6c328d156e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:40:57.112763 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6d106-dc0c-459e-8224-e6c328d156e4 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:40:57.113199 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6d106-dc0c-459e-8224-e6c328d156e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:40:57.113631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb6d106-dc0c-459e-8224-e6c328d156e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:40:57.126171 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6d106-dc0c-459e-8224-e6c328d156e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:40:57.127658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb6d106-dc0c-459e-8224-e6c328d156e4 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:40:57.147320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-1bb6d106-dc0c-459e-8224-e6c328d156e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:40:57.147320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:40:57.147320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:40:57.147320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:40:57.147320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:40:57.147320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:40:57.147320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:40:57.147320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:40:57.147320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:40:57.147320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:40:57.147320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:40:57.147320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:40:57.147320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:40:57.147320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:40:57.147320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:40:57.148347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:40:57.148347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:40:57.148347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:40:57.148347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:40:57.148347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:40:57.148347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:40:57.148347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:40:57.148347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:40:57.148347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:40:57.148347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:40:57.148347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:40:57.148347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:40:57.148347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:40:57.148347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:40:57.148347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:40:57.148347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:40:57.148347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:40:57.149794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:40:57.149794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:40:57.149794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:40:57.149794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:40:57.149794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 620/1210] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:40:57.154979 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459756e0-57fb-4d1b-9e22-63b21999146d None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:40:57.276949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:40:57.280114 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459756e0-57fb-4d1b-9e22-63b21999146d None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:40:57.323422 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc299ec-24e4-487a-8ad9-f0942795c6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:40:57.324271 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc299ec-24e4-487a-8ad9-f0942795c6bd None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:40:57.324560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc299ec-24e4-487a-8ad9-f0942795c6bd None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:40:57.324872 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc299ec-24e4-487a-8ad9-f0942795c6bd None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:40:57.325693 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc299ec-24e4-487a-8ad9-f0942795c6bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:40:57.326069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc299ec-24e4-487a-8ad9-f0942795c6bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:40:57.327670 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc299ec-24e4-487a-8ad9-f0942795c6bd None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:40:57.344041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 591/1211] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:40:57.350017 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6d106-dc0c-459e-8224-e6c328d156e4 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:40:57.465303 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb6d106-dc0c-459e-8224-e6c328d156e4 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:40:57.466979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:40:57.506214 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a9c42-57cd-4d5a-aa9f-fc9b195d5ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:40:57.507029 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a9c42-57cd-4d5a-aa9f-fc9b195d5ea8 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:40:57.507343 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a9c42-57cd-4d5a-aa9f-fc9b195d5ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:40:57.507741 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a9c42-57cd-4d5a-aa9f-fc9b195d5ea8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:40:57.516823 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a9c42-57cd-4d5a-aa9f-fc9b195d5ea8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:40:57.518386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a9c42-57cd-4d5a-aa9f-fc9b195d5ea8 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:40:57.536453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-c53a9c42-57cd-4d5a-aa9f-fc9b195d5ea8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 15:40:57.536453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:40:57.536453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:40:57.536453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:40:57.536453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:40:57.536453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:40:57.536453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:40:57.536453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:40:57.536453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:40:57.536453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:40:57.536453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:40:57.536453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:40:57.536453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:40:57.536453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:40:57.536453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:40:57.536453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:40:57.537521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:40:57.537521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:40:57.537521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:40:57.537521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:40:57.537521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:40:57.537521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:40:57.537521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:40:57.537521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:40:57.537521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:40:57.537521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:40:57.537521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:40:57.537521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:40:57.537521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:40:57.537521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:40:57.537521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:40:57.537521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:40:57.537521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:40:57.537521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:40:57.538531 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:40:57.538531 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:40:57.538531 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:40:57.538531 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:40:57.538531 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:40:57.538531 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:40:57.538531 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:40:57.538531 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:40:57.538531 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 15:40:57.538531 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:40:57.544808 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 621/1212] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:40:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:40:57.544990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc299ec-24e4-487a-8ad9-f0942795c6bd None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:40:57.676857 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc299ec-24e4-487a-8ad9-f0942795c6bd None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:40:57.715869 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2be34d-d243-48fd-8b08-76b4f27bc8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:40:57.716547 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2be34d-d243-48fd-8b08-76b4f27bc8c6 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:40:57.716834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2be34d-d243-48fd-8b08-76b4f27bc8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:40:57.717132 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2be34d-d243-48fd-8b08-76b4f27bc8c6 None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:40:57.717984 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2be34d-d243-48fd-8b08-76b4f27bc8c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:40:57.718297 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2be34d-d243-48fd-8b08-76b4f27bc8c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:40:57.719727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2be34d-d243-48fd-8b08-76b4f27bc8c6 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:40:57.744331 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 592/1213] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Jun 23 15:40:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:40:57.753661 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a9c42-57cd-4d5a-aa9f-fc9b195d5ea8 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:40:57.885018 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a9c42-57cd-4d5a-aa9f-fc9b195d5ea8 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:40:57.926289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2083011-12ab-49e2-be60-bf67dad53be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:40:57.927015 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2083011-12ab-49e2-be60-bf67dad53be0 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:40:57.927324 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2083011-12ab-49e2-be60-bf67dad53be0 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:40:57.927545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2083011-12ab-49e2-be60-bf67dad53be0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:40:57.974741 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:40:58.030587 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2083011-12ab-49e2-be60-bf67dad53be0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:40:58.032325 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2083011-12ab-49e2-be60-bf67dad53be0 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:40:58.160665 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 622/1214] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:40:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 15:40:58.162355 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2be34d-d243-48fd-8b08-76b4f27bc8c6 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:40:58.186640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:40:58.289401 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2be34d-d243-48fd-8b08-76b4f27bc8c6 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:40:58.330403 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b985a-e197-4180-ba9b-a17ab83d0998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:40:58.331214 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b985a-e197-4180-ba9b-a17ab83d0998 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:40:58.331499 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b985a-e197-4180-ba9b-a17ab83d0998 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:40:58.331772 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6b985a-e197-4180-ba9b-a17ab83d0998 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:40:58.344288 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b985a-e197-4180-ba9b-a17ab83d0998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:40:58.345872 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6b985a-e197-4180-ba9b-a17ab83d0998 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:40:58.364561 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-9e6b985a-e197-4180-ba9b-a17ab83d0998 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:40:58.364561 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:40:58.364561 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:40:58.364561 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:40:58.364561 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:40:58.364561 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:40:58.364561 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:40:58.364561 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:40:58.364561 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:40:58.364561 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:40:58.364561 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:40:58.364561 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:40:58.364561 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:40:58.364561 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:40:58.364561 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:40:58.365604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:40:58.365604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:40:58.365604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:40:58.365604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:40:58.365604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:40:58.365604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:40:58.365604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:40:58.365604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:40:58.365604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:40:58.365604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:40:58.365604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:40:58.365604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:40:58.365604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:40:58.365604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:40:58.365604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:40:58.365604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:40:58.365604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:40:58.367594 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:40:58.367594 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:40:58.367594 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:40:58.367594 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:40:58.367594 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 593/1215] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:40:58.372136 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2083011-12ab-49e2-be60-bf67dad53be0 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:40:58.447845 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:40:58.499707 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2083011-12ab-49e2-be60-bf67dad53be0 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:40:58.535742 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42344339-9adf-4733-a8c7-dd188cecb8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:40:58.536416 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42344339-9adf-4733-a8c7-dd188cecb8cb None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:40:58.536705 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42344339-9adf-4733-a8c7-dd188cecb8cb None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:40:58.537000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42344339-9adf-4733-a8c7-dd188cecb8cb None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:40:58.537794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42344339-9adf-4733-a8c7-dd188cecb8cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:40:58.538557 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42344339-9adf-4733-a8c7-dd188cecb8cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:40:58.540497 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42344339-9adf-4733-a8c7-dd188cecb8cb None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:40:58.557921 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 623/1216] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:40:58.559183 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b985a-e197-4180-ba9b-a17ab83d0998 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:40:58.640148 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:40:58.682182 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6b985a-e197-4180-ba9b-a17ab83d0998 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:40:58.719490 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bcef87-281d-4215-949e-b5df55fe4dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:40:58.720210 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcef87-281d-4215-949e-b5df55fe4dfe None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:40:58.720497 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcef87-281d-4215-949e-b5df55fe4dfe None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:40:58.720776 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bcef87-281d-4215-949e-b5df55fe4dfe None admin] PATH_INFO: `/v3/projects/service` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:40:58.728519 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bcef87-281d-4215-949e-b5df55fe4dfe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:40:58.729988 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bcef87-281d-4215-949e-b5df55fe4dfe None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:40:58.744380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-00bcef87-281d-4215-949e-b5df55fe4dfe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:40:58.744380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:40:58.744380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:40:58.744380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:40:58.744380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:40:58.744380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:40:58.744380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:40:58.744380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:40:58.744380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:40:58.744380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:40:58.744380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:40:58.744380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:40:58.744380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:40:58.744380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:40:58.744380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:40:58.745350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:40:58.745350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:40:58.745350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:40:58.745350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:40:58.745350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:40:58.745350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:40:58.745350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:40:58.745350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:40:58.745350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:40:58.745350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:40:58.745350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:40:58.745350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:40:58.745350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:40:58.745350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:40:58.745350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:40:58.745350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:40:58.745350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:40:58.746284 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:40:58.746284 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:40:58.746284 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:40:58.746284 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:40:58.746284 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:40:58.746284 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:40:58.746284 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:40:58.746284 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:40:58.746284 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 594/1217] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:40:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:40:58.751558 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42344339-9adf-4733-a8c7-dd188cecb8cb None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:40:58.863642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42344339-9adf-4733-a8c7-dd188cecb8cb None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:40:58.888504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:40:58.902691 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7922fdc2-b378-4761-bc3c-2bfb0a93a111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:40:58.903357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922fdc2-b378-4761-bc3c-2bfb0a93a111 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:40:58.903642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922fdc2-b378-4761-bc3c-2bfb0a93a111 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:40:58.903922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7922fdc2-b378-4761-bc3c-2bfb0a93a111 None admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:40:58.904760 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922fdc2-b378-4761-bc3c-2bfb0a93a111 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:40:58.905027 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922fdc2-b378-4761-bc3c-2bfb0a93a111 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:40:58.906775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7922fdc2-b378-4761-bc3c-2bfb0a93a111 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:40:58.925083 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 624/1218] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:40:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:40:58.926855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bcef87-281d-4215-949e-b5df55fe4dfe None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:40:59.043999 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bcef87-281d-4215-949e-b5df55fe4dfe None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:40:59.075057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:40:59.081104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37108c1-3eb2-4258-90dc-497a670d26be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:40:59.081762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37108c1-3eb2-4258-90dc-497a670d26be None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:40:59.082076 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37108c1-3eb2-4258-90dc-497a670d26be None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:40:59.082356 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37108c1-3eb2-4258-90dc-497a670d26be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:40:59.083192 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37108c1-3eb2-4258-90dc-497a670d26be None admin] RBAC: Adding query filter params (role.id=e004305755a2468aa60ab6632d39207a, scope.project.id=ff90b874f5b84d28a2752bc95419ad95, user.id=9300c3a803e94f9a93442f551fc9646f) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:40:59.083510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37108c1-3eb2-4258-90dc-497a670d26be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:40:59.084920 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37108c1-3eb2-4258-90dc-497a670d26be None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:40:59.090845 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 595/1219] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:40:58 2022] GET /identity/v3/role_assignments?user.id=9300c3a803e94f9a93442f551fc9646f&scope.project.id=ff90b874f5b84d28a2752bc95419ad95&role.id=e004305755a2468aa60ab6632d39207a => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:01.162103 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff6a67-0e9d-4c71-ad3b-740ac556fc0e None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:01.162662 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff6a67-0e9d-4c71-ad3b-740ac556fc0e None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:01.162752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff6a67-0e9d-4c71-ad3b-740ac556fc0e None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:01.164098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 625/1220] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:41:01.170408 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fc1d7-6108-4aae-8fb1-e13b65843f09 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:01.171133 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fc1d7-6108-4aae-8fb1-e13b65843f09 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:01.171133 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749fc1d7-6108-4aae-8fb1-e13b65843f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:01.189405 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-749fc1d7-6108-4aae-8fb1-e13b65843f09 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:41:01.190680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-749fc1d7-6108-4aae-8fb1-e13b65843f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:41:01.265185 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 596/1221] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:41:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:41:01.291871 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff6a67-0e9d-4c71-ad3b-740ac556fc0e None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:01.410865 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eff6a67-0e9d-4c71-ad3b-740ac556fc0e None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:01.451037 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b300b-9b43-4077-82c3-79c3bcf9d993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:01.451977 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b300b-9b43-4077-82c3-79c3bcf9d993 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:01.452272 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b300b-9b43-4077-82c3-79c3bcf9d993 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:01.452538 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b300b-9b43-4077-82c3-79c3bcf9d993 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:01.464109 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b300b-9b43-4077-82c3-79c3bcf9d993 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:41:01.472886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-e77b300b-9b43-4077-82c3-79c3bcf9d993 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:41:01.472886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:01.472886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:01.472886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:01.472886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:01.472886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:01.472886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:01.472886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:01.472886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:01.472886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:01.472886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:01.472886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:01.472886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:41:01.472886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:41:01.472886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:41:01.472886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:41:01.474162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:41:01.474162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:41:01.474162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:41:01.474162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:41:01.474162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:01.474162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:01.474162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:01.474162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:01.474162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:01.474162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:01.474162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:01.474162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:01.474162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:01.474162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:01.474162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:01.474162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:01.475184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:01.475184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:01.475184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:01.475184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:01.475184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:41:01.475184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:41:01.475184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:41:01.475184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:41:01.475184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:41:01.475184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:41:01.475184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:41:01.475184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:41:01.475184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 626/1222] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 23 15:41:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:01.481200 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fc1d7-6108-4aae-8fb1-e13b65843f09 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:01.591285 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749fc1d7-6108-4aae-8fb1-e13b65843f09 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:01.618520 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:01.630214 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1049f-6f70-4203-9cfc-6bdee67ab691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:01.630862 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1049f-6f70-4203-9cfc-6bdee67ab691 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:01.631148 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1049f-6f70-4203-9cfc-6bdee67ab691 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:01.631429 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1049f-6f70-4203-9cfc-6bdee67ab691 None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:01.632179 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1049f-6f70-4203-9cfc-6bdee67ab691 None admin] RBAC: Adding query filter params (name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:01.632489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1049f-6f70-4203-9cfc-6bdee67ab691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:01.633908 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1049f-6f70-4203-9cfc-6bdee67ab691 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:01.642337 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 597/1223] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 23 15:41:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:01.648319 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b300b-9b43-4077-82c3-79c3bcf9d993 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:01.696818 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:01.756677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b300b-9b43-4077-82c3-79c3bcf9d993 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:01.792538 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e3996-5f3b-46bc-8736-5e75d5ad7330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:01.793352 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e3996-5f3b-46bc-8736-5e75d5ad7330 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:01.793688 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e3996-5f3b-46bc-8736-5e75d5ad7330 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:01.794017 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e3996-5f3b-46bc-8736-5e75d5ad7330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:01.806343 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e3996-5f3b-46bc-8736-5e75d5ad7330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:01.807911 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e3996-5f3b-46bc-8736-5e75d5ad7330 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:01.827441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-295e3996-5f3b-46bc-8736-5e75d5ad7330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:41:01.827441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:01.827441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:01.827441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:01.827441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:01.827441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:01.827441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:01.827441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:01.827441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:01.827441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:01.827441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:01.827441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:01.827441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:41:01.827441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:41:01.827441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:41:01.828509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:41:01.828509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:01.828509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:01.828509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:01.828509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:01.828509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:01.828509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:01.828509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:01.828509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:01.828509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:01.828509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:01.828509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:01.828509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:01.828509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:01.828509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:01.828509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:01.828509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:01.829640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:41:01.829640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:41:01.829640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:41:01.829640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:41:01.829640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 627/1224] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:41:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:01.834782 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1049f-6f70-4203-9cfc-6bdee67ab691 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:01.943841 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1049f-6f70-4203-9cfc-6bdee67ab691 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:01.982222 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f100b7-dc6c-4d5d-82d9-b93bc49952ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:01.983044 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f100b7-dc6c-4d5d-82d9-b93bc49952ac None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:01.983340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f100b7-dc6c-4d5d-82d9-b93bc49952ac None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:01.983710 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f100b7-dc6c-4d5d-82d9-b93bc49952ac None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:01.984522 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f100b7-dc6c-4d5d-82d9-b93bc49952ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:01.984842 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f100b7-dc6c-4d5d-82d9-b93bc49952ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:01.986443 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f100b7-dc6c-4d5d-82d9-b93bc49952ac None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:01.999916 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 598/1225] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:02.006031 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e3996-5f3b-46bc-8736-5e75d5ad7330 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:02.105308 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:02.113969 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e3996-5f3b-46bc-8736-5e75d5ad7330 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:02.154518 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b689a8-8f4d-47f4-be73-676e1642357f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:02.155397 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b689a8-8f4d-47f4-be73-676e1642357f None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:02.155748 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b689a8-8f4d-47f4-be73-676e1642357f None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:02.156117 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b689a8-8f4d-47f4-be73-676e1642357f None admin] PATH_INFO: `/v3/users/placement` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:02.165648 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b689a8-8f4d-47f4-be73-676e1642357f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:02.168297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b689a8-8f4d-47f4-be73-676e1642357f None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:02.184188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-e1b689a8-8f4d-47f4-be73-676e1642357f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 15:41:02.184188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:02.184188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:02.184188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:02.184188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:02.184188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:02.184188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:02.184188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:02.184188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:02.184188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:02.184188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:02.184188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:02.184188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:41:02.184188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:41:02.184188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:41:02.184188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:41:02.185535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:02.185535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:02.185535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:41:02.185535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:41:02.185535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:41:02.185535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:41:02.185535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:02.185535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:02.185535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:02.185535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:02.185535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:02.185535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:02.185535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:02.185535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:02.185535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:02.185535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:02.185535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:02.185535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:02.186964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:02.186964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:02.186964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:41:02.186964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:41:02.186964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:41:02.186964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:41:02.186964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:41:02.186964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:41:02.186964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 15:41:02.186964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:41:02.186964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 628/1226] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:41:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:02.191764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f100b7-dc6c-4d5d-82d9-b93bc49952ac None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:02.249963 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:02.311054 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f100b7-dc6c-4d5d-82d9-b93bc49952ac None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:02.349704 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400dfa4-6811-4d26-a0d0-0ce41ac143a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:02.350396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400dfa4-6811-4d26-a0d0-0ce41ac143a8 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:02.350676 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400dfa4-6811-4d26-a0d0-0ce41ac143a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:02.350951 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400dfa4-6811-4d26-a0d0-0ce41ac143a8 None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:02.352332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400dfa4-6811-4d26-a0d0-0ce41ac143a8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:02.352637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400dfa4-6811-4d26-a0d0-0ce41ac143a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:02.354091 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400dfa4-6811-4d26-a0d0-0ce41ac143a8 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:02.372982 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 599/1227] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Jun 23 15:41:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:02.380810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b689a8-8f4d-47f4-be73-676e1642357f None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:02.494982 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b689a8-8f4d-47f4-be73-676e1642357f None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:02.538454 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a984e-72f5-45e0-a1fe-ff13b35f2843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:02.539487 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a984e-72f5-45e0-a1fe-ff13b35f2843 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:02.539775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a984e-72f5-45e0-a1fe-ff13b35f2843 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:02.540052 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a984e-72f5-45e0-a1fe-ff13b35f2843 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:02.551666 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a984e-72f5-45e0-a1fe-ff13b35f2843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:02.553147 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a984e-72f5-45e0-a1fe-ff13b35f2843 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:02.574271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-142a984e-72f5-45e0-a1fe-ff13b35f2843 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:41:02.574271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:02.574271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:02.574271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:02.574271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:02.574271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:02.574271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:02.574271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:02.574271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:02.574271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:02.574271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:02.574271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:02.574271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:41:02.574271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:41:02.574271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:41:02.575322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:41:02.575322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:02.575322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:02.575322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:02.575322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:02.575322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:02.575322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:02.575322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:02.575322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:02.575322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:02.575322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:02.575322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:02.575322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:02.575322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:02.575322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:02.575322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:02.575322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:02.576314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:41:02.576314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:41:02.576314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:41:02.576314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:41:02.576314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 629/1228] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:41:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:41:02.581372 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400dfa4-6811-4d26-a0d0-0ce41ac143a8 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:02.687637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400dfa4-6811-4d26-a0d0-0ce41ac143a8 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:02.690072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:02.735319 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652c83a-8abe-4f4f-8de1-ed59f3c6e052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:02.736193 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652c83a-8abe-4f4f-8de1-ed59f3c6e052 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:02.736475 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652c83a-8abe-4f4f-8de1-ed59f3c6e052 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:02.736787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652c83a-8abe-4f4f-8de1-ed59f3c6e052 None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:02.737720 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652c83a-8abe-4f4f-8de1-ed59f3c6e052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:02.738170 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652c83a-8abe-4f4f-8de1-ed59f3c6e052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:02.739664 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9652c83a-8abe-4f4f-8de1-ed59f3c6e052 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:02.754003 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 600/1229] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:41:02.760388 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a984e-72f5-45e0-a1fe-ff13b35f2843 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:02.770347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:02.879366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a984e-72f5-45e0-a1fe-ff13b35f2843 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:02.922669 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830e61c-ca95-4856-94eb-667734ede122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:02.923583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830e61c-ca95-4856-94eb-667734ede122 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:02.923934 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830e61c-ca95-4856-94eb-667734ede122 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:02.924235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830e61c-ca95-4856-94eb-667734ede122 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:02.932456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830e61c-ca95-4856-94eb-667734ede122 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:02.934161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830e61c-ca95-4856-94eb-667734ede122 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:02.949634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-f830e61c-ca95-4856-94eb-667734ede122 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:41:02.949634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:02.949634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:02.949634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:02.949634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:02.949634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:02.949634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:02.949634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:02.949634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:02.949634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:02.949634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:02.949634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:02.949634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:41:02.949634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:41:02.949634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:41:02.950821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:41:02.950821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:02.950821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:02.950821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:02.950821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:02.950821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:02.950821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:02.950821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:02.950821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:02.950821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:02.950821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:02.950821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:02.950821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:02.950821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:02.950821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:02.950821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:02.950821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:02.951801 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:41:02.951801 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:41:02.951801 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:41:02.951801 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:41:02.951801 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:41:02.951801 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:41:02.951801 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:41:02.951801 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:41:02.951801 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 630/1230] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:41:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:02.956866 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652c83a-8abe-4f4f-8de1-ed59f3c6e052 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:03.068540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652c83a-8abe-4f4f-8de1-ed59f3c6e052 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:03.109796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47cc45-403b-4e69-b50d-b4cd7832a485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:03.110749 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47cc45-403b-4e69-b50d-b4cd7832a485 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:03.111046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47cc45-403b-4e69-b50d-b4cd7832a485 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:03.111447 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47cc45-403b-4e69-b50d-b4cd7832a485 None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:03.112330 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47cc45-403b-4e69-b50d-b4cd7832a485 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:03.112760 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47cc45-403b-4e69-b50d-b4cd7832a485 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:03.114488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47cc45-403b-4e69-b50d-b4cd7832a485 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:03.128574 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 601/1231] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:41:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:03.136134 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830e61c-ca95-4856-94eb-667734ede122 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:03.209216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:03.251532 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830e61c-ca95-4856-94eb-667734ede122 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:03.288835 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989de4b7-edfa-4dd3-b0dd-27763836a416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:03.290327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989de4b7-edfa-4dd3-b0dd-27763836a416 None admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:03.290616 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989de4b7-edfa-4dd3-b0dd-27763836a416 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:03.290898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989de4b7-edfa-4dd3-b0dd-27763836a416 None admin] PATH_INFO: `/v3/projects/ff90b874f5b84d28a2752bc95419ad95/users/9300c3a803e94f9a93442f551fc9646f/roles/e004305755a2468aa60ab6632d39207a` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:03.307917 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989de4b7-edfa-4dd3-b0dd-27763836a416 None admin] RBAC: Authorizing `identity:create_grant(project_id=ff90b874f5b84d28a2752bc95419ad95, user_id=9300c3a803e94f9a93442f551fc9646f, role_id=e004305755a2468aa60ab6632d39207a)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:03.309493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989de4b7-edfa-4dd3-b0dd-27763836a416 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:03.323753 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 631/1232] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 23 15:41:03 2022] PUT /identity/v3/projects/ff90b874f5b84d28a2752bc95419ad95/users/9300c3a803e94f9a93442f551fc9646f/roles/e004305755a2468aa60ab6632d39207a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:41:05.597065 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365febd-7aaf-498b-ba0c-4ea188159aba None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:05.597636 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365febd-7aaf-498b-ba0c-4ea188159aba None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:05.597636 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365febd-7aaf-498b-ba0c-4ea188159aba None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:05.599068 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 602/1233] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:41:05.604694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76bc1e-543c-49db-a18a-fad548df34c9 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:05.605309 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76bc1e-543c-49db-a18a-fad548df34c9 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:05.605309 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76bc1e-543c-49db-a18a-fad548df34c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:05.622742 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-da76bc1e-543c-49db-a18a-fad548df34c9 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:41:05.624002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-da76bc1e-543c-49db-a18a-fad548df34c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:41:05.694668 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 632/1234] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:41:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:41:05.718766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365febd-7aaf-498b-ba0c-4ea188159aba None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:05.745155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:05.823886 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365febd-7aaf-498b-ba0c-4ea188159aba None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:05.858484 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58dfe8-d2b6-438d-8b8a-2a73e3549585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:05.859281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58dfe8-d2b6-438d-8b8a-2a73e3549585 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:05.859560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58dfe8-d2b6-438d-8b8a-2a73e3549585 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:05.859839 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58dfe8-d2b6-438d-8b8a-2a73e3549585 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:05.871321 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d58dfe8-d2b6-438d-8b8a-2a73e3549585 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:41:05.878982 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-9d58dfe8-d2b6-438d-8b8a-2a73e3549585 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:41:05.878982 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:05.878982 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:05.878982 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:05.878982 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:05.878982 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:05.878982 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:05.878982 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:05.878982 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:05.878982 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:05.878982 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:05.878982 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:05.878982 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:41:05.878982 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:41:05.878982 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:41:05.878982 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:41:05.880127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:41:05.880127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:41:05.880127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:41:05.880127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:41:05.880127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:05.880127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:05.880127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:05.880127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:05.880127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:05.880127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:05.880127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:05.880127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:05.880127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:05.880127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:05.880127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:05.880127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:05.881249 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:05.881249 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:05.881249 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:05.881249 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:05.881249 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:41:05.881249 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:41:05.881249 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:41:05.881249 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:41:05.881249 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:41:05.881249 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:41:05.881249 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 15:41:05.881249 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:41:05.887593 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 603/1235] 10.222.0.15 () {56 vars in 1102 bytes} [Thu Jun 23 15:41:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:05.887772 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76bc1e-543c-49db-a18a-fad548df34c9 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:05.938412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:05.994415 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76bc1e-543c-49db-a18a-fad548df34c9 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:06.029844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150684da-73fa-4bc0-aa2f-db023fbb52c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:06.030540 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150684da-73fa-4bc0-aa2f-db023fbb52c6 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:06.030825 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150684da-73fa-4bc0-aa2f-db023fbb52c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:06.031105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150684da-73fa-4bc0-aa2f-db023fbb52c6 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:06.032116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150684da-73fa-4bc0-aa2f-db023fbb52c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:06.032427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150684da-73fa-4bc0-aa2f-db023fbb52c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:06.033807 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150684da-73fa-4bc0-aa2f-db023fbb52c6 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:06.043568 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 633/1236] 10.222.0.15 () {56 vars in 1103 bytes} [Thu Jun 23 15:41:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:06.049134 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58dfe8-d2b6-438d-8b8a-2a73e3549585 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:06.138692 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:06.156077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58dfe8-d2b6-438d-8b8a-2a73e3549585 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:06.194243 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f1686-c484-4152-941b-7908b3d68cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:06.195605 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f1686-c484-4152-941b-7908b3d68cae None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:06.195910 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f1686-c484-4152-941b-7908b3d68cae None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:06.196184 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f1686-c484-4152-941b-7908b3d68cae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:06.209609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f1686-c484-4152-941b-7908b3d68cae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:06.211703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f1686-c484-4152-941b-7908b3d68cae None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:06.229756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-bc1f1686-c484-4152-941b-7908b3d68cae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:41:06.229756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:06.229756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:06.229756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:06.229756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:06.229756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:06.229756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:06.229756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:06.229756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:06.229756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:06.229756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:06.229756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:06.229756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:41:06.229756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:41:06.229756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:41:06.230931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:41:06.230931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:06.230931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:06.230931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:06.230931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:06.230931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:06.230931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:06.230931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:06.230931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:06.230931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:06.230931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:06.230931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:06.230931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:06.230931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:06.230931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:06.230931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:06.230931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:06.231820 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:41:06.231820 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:41:06.231820 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:41:06.231820 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:41:06.231820 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 604/1237] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:41:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:06.236879 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150684da-73fa-4bc0-aa2f-db023fbb52c6 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:06.342676 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150684da-73fa-4bc0-aa2f-db023fbb52c6 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:06.353482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:06.380891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f1363-1d05-4c5f-9771-faecd3f11b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:06.381566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f1363-1d05-4c5f-9771-faecd3f11b09 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:06.381901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f1363-1d05-4c5f-9771-faecd3f11b09 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:06.382234 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f1363-1d05-4c5f-9771-faecd3f11b09 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:06.383656 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f1363-1d05-4c5f-9771-faecd3f11b09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:06.383973 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f1363-1d05-4c5f-9771-faecd3f11b09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:06.385400 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f1363-1d05-4c5f-9771-faecd3f11b09 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:06.397836 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 634/1238] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:06.404103 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f1686-c484-4152-941b-7908b3d68cae None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:06.515990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f1686-c484-4152-941b-7908b3d68cae None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:06.556709 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53531d7b-223a-4d30-8a57-565df6cce508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:06.557569 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53531d7b-223a-4d30-8a57-565df6cce508 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:06.557918 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53531d7b-223a-4d30-8a57-565df6cce508 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:06.558196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53531d7b-223a-4d30-8a57-565df6cce508 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:06.562801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:06.568854 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53531d7b-223a-4d30-8a57-565df6cce508 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:06.570946 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53531d7b-223a-4d30-8a57-565df6cce508 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:06.586104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-53531d7b-223a-4d30-8a57-565df6cce508 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 15:41:06.586104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:06.586104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:06.586104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:06.586104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:06.586104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:06.586104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:06.586104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:06.586104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:06.586104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:06.586104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:06.586104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:06.586104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:41:06.586104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:41:06.586104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:41:06.586104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:41:06.587309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:06.587309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:06.587309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:41:06.587309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:41:06.587309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:41:06.587309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:41:06.587309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:06.587309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:06.587309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:06.587309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:06.587309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:06.587309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:06.587309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:06.587309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:06.587309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:06.587309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:06.587309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:06.587309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:06.588302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:06.588302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:06.588302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:41:06.588302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:41:06.588302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:41:06.588302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:41:06.588302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:41:06.588302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:41:06.588302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 15:41:06.588302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:41:06.588302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 605/1239] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:41:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:06.593281 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f1363-1d05-4c5f-9771-faecd3f11b09 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:06.703717 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f1363-1d05-4c5f-9771-faecd3f11b09 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:06.739251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32588ac0-9777-4368-b6e6-722a5f9e79c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:06.739913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32588ac0-9777-4368-b6e6-722a5f9e79c5 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:06.740196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32588ac0-9777-4368-b6e6-722a5f9e79c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:06.740470 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32588ac0-9777-4368-b6e6-722a5f9e79c5 None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:06.741311 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32588ac0-9777-4368-b6e6-722a5f9e79c5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:06.741624 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32588ac0-9777-4368-b6e6-722a5f9e79c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:06.743672 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32588ac0-9777-4368-b6e6-722a5f9e79c5 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:06.762885 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 635/1240] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Jun 23 15:41:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:06.768899 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53531d7b-223a-4d30-8a57-565df6cce508 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:06.884995 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53531d7b-223a-4d30-8a57-565df6cce508 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:06.922419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fc302-9f1d-423a-a2b9-6fc45ee9b0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:06.923071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fc302-9f1d-423a-a2b9-6fc45ee9b0a2 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:06.923463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fc302-9f1d-423a-a2b9-6fc45ee9b0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:06.923742 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fc302-9f1d-423a-a2b9-6fc45ee9b0a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:06.993910 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:07.001405 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fc302-9f1d-423a-a2b9-6fc45ee9b0a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:07.004156 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fc302-9f1d-423a-a2b9-6fc45ee9b0a2 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:07.126398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 606/1241] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:41:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 15:41:07.127731 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32588ac0-9777-4368-b6e6-722a5f9e79c5 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:07.158763 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:07.254502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32588ac0-9777-4368-b6e6-722a5f9e79c5 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:07.292266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e5058-abbf-4d2c-bc75-282a35b42f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:07.293076 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e5058-abbf-4d2c-bc75-282a35b42f03 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:07.293352 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e5058-abbf-4d2c-bc75-282a35b42f03 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:07.293627 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188e5058-abbf-4d2c-bc75-282a35b42f03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:07.307226 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e5058-abbf-4d2c-bc75-282a35b42f03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:07.308693 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188e5058-abbf-4d2c-bc75-282a35b42f03 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:07.328820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-188e5058-abbf-4d2c-bc75-282a35b42f03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:41:07.328820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:07.328820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:07.328820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:07.328820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:07.328820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:07.328820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:07.328820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:07.328820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:07.328820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:07.328820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:07.328820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:07.328820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:41:07.328820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:41:07.328820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:41:07.330000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:41:07.330000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:07.330000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:07.330000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:07.330000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:07.330000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:07.330000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:07.330000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:07.330000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:07.330000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:07.330000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:07.330000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:07.330000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:07.330000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:07.330000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:07.330000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:07.330000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:07.331016 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:41:07.331016 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:41:07.331016 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:41:07.331016 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:41:07.331016 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 636/1242] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:41:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 15:41:07.336111 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fc302-9f1d-423a-a2b9-6fc45ee9b0a2 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:07.453077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:07.459609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fc302-9f1d-423a-a2b9-6fc45ee9b0a2 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:07.505610 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92e1f8-b264-47d3-a13e-499f88e8e6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:07.506250 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92e1f8-b264-47d3-a13e-499f88e8e6f0 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:07.506526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92e1f8-b264-47d3-a13e-499f88e8e6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:07.506855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92e1f8-b264-47d3-a13e-499f88e8e6f0 None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:07.508277 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92e1f8-b264-47d3-a13e-499f88e8e6f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:07.508627 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92e1f8-b264-47d3-a13e-499f88e8e6f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:07.510444 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd92e1f8-b264-47d3-a13e-499f88e8e6f0 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:07.524415 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 607/1243] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:41:07.532473 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e5058-abbf-4d2c-bc75-282a35b42f03 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:07.626867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:07.657944 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188e5058-abbf-4d2c-bc75-282a35b42f03 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:07.701407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3639b-80ea-4374-a1aa-582ae0d1679e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:07.702231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3639b-80ea-4374-a1aa-582ae0d1679e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:07.702514 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3639b-80ea-4374-a1aa-582ae0d1679e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:07.702789 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3639b-80ea-4374-a1aa-582ae0d1679e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:07.709618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3639b-80ea-4374-a1aa-582ae0d1679e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:07.711656 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3639b-80ea-4374-a1aa-582ae0d1679e None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:07.725223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-30c3639b-80ea-4374-a1aa-582ae0d1679e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:41:07.725223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:07.725223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:07.725223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:07.725223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:07.725223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:07.725223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:07.725223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:07.725223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:07.725223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:07.725223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:07.725223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:07.725223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:41:07.725223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:41:07.725223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:41:07.728253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:41:07.728253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:07.728253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:07.728253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:07.728253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:07.728253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:07.728253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:07.728253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:07.728253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:07.728253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:07.728253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:07.728253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:07.728253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:07.728253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:07.728253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:07.728253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:07.728253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:07.729165 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:41:07.729165 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:41:07.729165 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:41:07.729165 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:41:07.729165 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:41:07.729165 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:41:07.729165 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:41:07.729165 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:41:07.729165 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 637/1244] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:41:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:07.732294 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92e1f8-b264-47d3-a13e-499f88e8e6f0 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:07.846546 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92e1f8-b264-47d3-a13e-499f88e8e6f0 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:07.882101 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c265a62-d74f-4b60-825c-187cb230140d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:07.883342 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c265a62-d74f-4b60-825c-187cb230140d None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:07.883635 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c265a62-d74f-4b60-825c-187cb230140d None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:07.884604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c265a62-d74f-4b60-825c-187cb230140d None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:07.885491 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c265a62-d74f-4b60-825c-187cb230140d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:07.885746 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c265a62-d74f-4b60-825c-187cb230140d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:07.887234 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c265a62-d74f-4b60-825c-187cb230140d None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:07.900099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 608/1245] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:41:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:07.907180 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3639b-80ea-4374-a1aa-582ae0d1679e None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:08.015407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3639b-80ea-4374-a1aa-582ae0d1679e None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:08.052035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b130ae9-fff4-4674-b9d8-79e136159e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:08.052850 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b130ae9-fff4-4674-b9d8-79e136159e93 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:08.053142 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b130ae9-fff4-4674-b9d8-79e136159e93 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:08.053420 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b130ae9-fff4-4674-b9d8-79e136159e93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:08.054865 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b130ae9-fff4-4674-b9d8-79e136159e93 None admin] RBAC: Adding query filter params (role.id=e004305755a2468aa60ab6632d39207a, scope.project.id=ff90b874f5b84d28a2752bc95419ad95, user.id=9300c3a803e94f9a93442f551fc9646f) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:08.055317 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b130ae9-fff4-4674-b9d8-79e136159e93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:08.056983 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b130ae9-fff4-4674-b9d8-79e136159e93 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:08.064411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 638/1246] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:41:07 2022] GET /identity/v3/role_assignments?user.id=9300c3a803e94f9a93442f551fc9646f&scope.project.id=ff90b874f5b84d28a2752bc95419ad95&role.id=e004305755a2468aa60ab6632d39207a => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:10.203595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713f3b6-b4ce-48ca-9068-4aad40c230a6 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:10.204181 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713f3b6-b4ce-48ca-9068-4aad40c230a6 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:10.204181 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713f3b6-b4ce-48ca-9068-4aad40c230a6 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:10.205712 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 609/1247] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:41:10.211716 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece20999-6f7b-4cd4-85a8-da41deadd185 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:10.212259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece20999-6f7b-4cd4-85a8-da41deadd185 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:10.212259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece20999-6f7b-4cd4-85a8-da41deadd185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:10.217716 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:10.233492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-ece20999-6f7b-4cd4-85a8-da41deadd185 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:41:10.234786 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ece20999-6f7b-4cd4-85a8-da41deadd185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:41:10.327381 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 639/1248] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:41:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:41:10.355072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713f3b6-b4ce-48ca-9068-4aad40c230a6 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:10.378041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:10.473033 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713f3b6-b4ce-48ca-9068-4aad40c230a6 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:10.510169 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2741b96-b33a-426e-aa30-72c69187d177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:10.511087 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2741b96-b33a-426e-aa30-72c69187d177 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:10.511404 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2741b96-b33a-426e-aa30-72c69187d177 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:10.511681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2741b96-b33a-426e-aa30-72c69187d177 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:10.528110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2741b96-b33a-426e-aa30-72c69187d177 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:41:10.536957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-d2741b96-b33a-426e-aa30-72c69187d177 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:41:10.536957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:10.536957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:10.536957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:10.536957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:10.536957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:10.536957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:10.536957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:10.536957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:10.536957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:10.536957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:10.536957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:10.536957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:41:10.536957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:41:10.536957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:41:10.536957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:41:10.538270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:41:10.538270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:41:10.538270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:41:10.538270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:41:10.538270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:10.538270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:10.538270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:10.538270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:10.538270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:10.538270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:10.538270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:10.538270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:10.538270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:10.538270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:10.538270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:10.538270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:10.544680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:10.544680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:10.544680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:10.544680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:10.544680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:41:10.544680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:41:10.544680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:41:10.544680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:41:10.544680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:41:10.544680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:41:10.544680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:41:10.544680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:41:10.544680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 610/1249] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:41:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:10.545804 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece20999-6f7b-4cd4-85a8-da41deadd185 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:10.661042 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece20999-6f7b-4cd4-85a8-da41deadd185 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:10.693071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:10.699757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ec0d3-dbe4-41f5-8467-fad104a48d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:10.700541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ec0d3-dbe4-41f5-8467-fad104a48d4a None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:10.700841 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ec0d3-dbe4-41f5-8467-fad104a48d4a None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:10.701146 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ec0d3-dbe4-41f5-8467-fad104a48d4a None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:10.702016 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ec0d3-dbe4-41f5-8467-fad104a48d4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:10.702399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ec0d3-dbe4-41f5-8467-fad104a48d4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:10.703958 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ec0d3-dbe4-41f5-8467-fad104a48d4a None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:10.714384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 640/1250] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:41:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:10.720513 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2741b96-b33a-426e-aa30-72c69187d177 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:10.816978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:10.844020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2741b96-b33a-426e-aa30-72c69187d177 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:10.884427 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17560767-2a86-4dc5-8b90-99e79c63e1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:10.885320 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17560767-2a86-4dc5-8b90-99e79c63e1fa None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:10.885637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17560767-2a86-4dc5-8b90-99e79c63e1fa None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:10.885972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17560767-2a86-4dc5-8b90-99e79c63e1fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:10.898356 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17560767-2a86-4dc5-8b90-99e79c63e1fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:10.899934 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17560767-2a86-4dc5-8b90-99e79c63e1fa None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:10.920340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-17560767-2a86-4dc5-8b90-99e79c63e1fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:41:10.920340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:10.920340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:10.920340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:10.920340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:10.920340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:10.920340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:10.920340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:10.920340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:10.920340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:10.920340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:10.920340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:10.920340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:41:10.920340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:41:10.920340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:41:10.921426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:41:10.921426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:10.921426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:10.921426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:10.921426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:10.921426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:10.921426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:10.921426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:10.921426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:10.921426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:10.921426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:10.921426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:10.921426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:10.921426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:10.921426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:10.921426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:10.921426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:10.922454 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:41:10.922454 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:41:10.922454 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:41:10.922454 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:41:10.922454 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 611/1251] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:41:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:10.927769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ec0d3-dbe4-41f5-8467-fad104a48d4a None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:11.039873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ec0d3-dbe4-41f5-8467-fad104a48d4a None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:11.081362 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744aef6-e76e-43c6-be8a-d929d850aa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:11.082070 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744aef6-e76e-43c6-be8a-d929d850aa43 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:11.082369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744aef6-e76e-43c6-be8a-d929d850aa43 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:11.082650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744aef6-e76e-43c6-be8a-d929d850aa43 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:11.083476 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744aef6-e76e-43c6-be8a-d929d850aa43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:11.083823 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744aef6-e76e-43c6-be8a-d929d850aa43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:11.085303 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744aef6-e76e-43c6-be8a-d929d850aa43 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:11.099020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 641/1252] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:11.104743 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17560767-2a86-4dc5-8b90-99e79c63e1fa None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:11.224374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17560767-2a86-4dc5-8b90-99e79c63e1fa None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:11.257442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:11.269636 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e571a8e-bb58-4f20-85fc-98bfa053db8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:11.270911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e571a8e-bb58-4f20-85fc-98bfa053db8c None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:11.271376 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e571a8e-bb58-4f20-85fc-98bfa053db8c None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:11.271716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e571a8e-bb58-4f20-85fc-98bfa053db8c None admin] PATH_INFO: `/v3/users/placement` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:11.283248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e571a8e-bb58-4f20-85fc-98bfa053db8c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:11.285063 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e571a8e-bb58-4f20-85fc-98bfa053db8c None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:11.305685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-5e571a8e-bb58-4f20-85fc-98bfa053db8c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 15:41:11.305685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:11.305685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:11.305685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:11.305685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:11.305685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:11.305685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:11.305685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:11.305685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:11.305685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:11.305685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:11.305685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:11.305685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:41:11.305685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:41:11.305685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:41:11.305685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:41:11.306968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:11.306968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:11.306968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:41:11.306968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:41:11.306968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:41:11.306968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:41:11.306968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:11.306968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:11.306968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:11.306968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:11.306968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:11.306968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:11.306968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:11.306968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:11.306968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:11.306968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:11.306968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:11.306968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:11.308317 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:11.308317 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:11.308317 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:41:11.308317 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:41:11.308317 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:41:11.308317 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:41:11.308317 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:41:11.308317 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:41:11.308317 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 15:41:11.308317 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:41:11.308317 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 612/1253] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:41:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:11.315247 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744aef6-e76e-43c6-be8a-d929d850aa43 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:11.387786 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:11.445435 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744aef6-e76e-43c6-be8a-d929d850aa43 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:11.486281 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf1486-0ee9-44e6-a9a5-fdf109098fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:11.486975 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf1486-0ee9-44e6-a9a5-fdf109098fe1 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:11.487261 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf1486-0ee9-44e6-a9a5-fdf109098fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:11.487541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf1486-0ee9-44e6-a9a5-fdf109098fe1 None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:11.488391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf1486-0ee9-44e6-a9a5-fdf109098fe1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:11.488702 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf1486-0ee9-44e6-a9a5-fdf109098fe1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:11.490230 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf1486-0ee9-44e6-a9a5-fdf109098fe1 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:11.510583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 642/1254] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Jun 23 15:41:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:41:11.516641 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e571a8e-bb58-4f20-85fc-98bfa053db8c None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:11.633690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e571a8e-bb58-4f20-85fc-98bfa053db8c None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:11.674674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45247f5-cf6f-4bd3-9221-d35c7799f58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:11.678664 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45247f5-cf6f-4bd3-9221-d35c7799f58d None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:11.679027 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45247f5-cf6f-4bd3-9221-d35c7799f58d None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:11.679400 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45247f5-cf6f-4bd3-9221-d35c7799f58d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:11.744719 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:11.759071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45247f5-cf6f-4bd3-9221-d35c7799f58d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:11.760458 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45247f5-cf6f-4bd3-9221-d35c7799f58d None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:11.881105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 613/1255] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:41:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 15:41:11.887818 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf1486-0ee9-44e6-a9a5-fdf109098fe1 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:12.002137 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf1486-0ee9-44e6-a9a5-fdf109098fe1 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:12.018197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:12.043196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2fe6d-f12c-4fca-ad93-d344a1f1d35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:12.043977 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2fe6d-f12c-4fca-ad93-d344a1f1d35b None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:12.044265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2fe6d-f12c-4fca-ad93-d344a1f1d35b None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:12.044539 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2fe6d-f12c-4fca-ad93-d344a1f1d35b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:12.057216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2fe6d-f12c-4fca-ad93-d344a1f1d35b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:12.058712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2fe6d-f12c-4fca-ad93-d344a1f1d35b None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:12.080013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-16a2fe6d-f12c-4fca-ad93-d344a1f1d35b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:41:12.080013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:12.080013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:12.080013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:12.080013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:12.080013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:12.080013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:12.080013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:12.080013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:12.080013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:12.080013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:12.080013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:12.080013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:41:12.080013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:41:12.080013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:41:12.081098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:41:12.081098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:12.081098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:12.081098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:12.081098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:12.081098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:12.081098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:12.081098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:12.081098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:12.081098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:12.081098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:12.081098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:12.081098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:12.081098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:12.081098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:12.081098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:12.081098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:12.082261 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:41:12.082261 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:41:12.082261 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:41:12.082261 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:41:12.082261 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 643/1256] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:41:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:12.088093 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45247f5-cf6f-4bd3-9221-d35c7799f58d None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:12.195320 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:12.215111 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45247f5-cf6f-4bd3-9221-d35c7799f58d None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:12.262296 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd254a-9b88-4057-ae48-abdb9094f109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:12.262977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd254a-9b88-4057-ae48-abdb9094f109 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:12.263167 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd254a-9b88-4057-ae48-abdb9094f109 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:12.263442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd254a-9b88-4057-ae48-abdb9094f109 None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:12.264174 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd254a-9b88-4057-ae48-abdb9094f109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:12.264482 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd254a-9b88-4057-ae48-abdb9094f109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:12.265885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd254a-9b88-4057-ae48-abdb9094f109 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:12.278627 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 614/1257] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:12.285547 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2fe6d-f12c-4fca-ad93-d344a1f1d35b None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:12.410116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2fe6d-f12c-4fca-ad93-d344a1f1d35b None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:12.447386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98f4eb-56fb-40cf-9c0b-b6039b2beba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:12.448218 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98f4eb-56fb-40cf-9c0b-b6039b2beba5 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:12.448506 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98f4eb-56fb-40cf-9c0b-b6039b2beba5 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:12.448779 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98f4eb-56fb-40cf-9c0b-b6039b2beba5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:12.456583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98f4eb-56fb-40cf-9c0b-b6039b2beba5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:12.458291 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98f4eb-56fb-40cf-9c0b-b6039b2beba5 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:12.473423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-9f98f4eb-56fb-40cf-9c0b-b6039b2beba5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:41:12.473423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:12.473423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:12.473423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:12.473423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:12.473423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:12.473423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:12.473423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:12.473423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:12.473423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:12.473423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:12.473423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:12.473423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:41:12.473423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:41:12.473423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:41:12.474541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:41:12.474541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:12.474541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:12.474541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:12.474541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:12.474541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:12.474541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:12.474541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:12.474541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:12.474541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:12.474541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:12.474541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:12.474541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:12.474541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:12.474541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:12.474541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:12.474541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:12.475644 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:41:12.475644 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:41:12.475644 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:41:12.475644 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:41:12.475644 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:41:12.475644 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:41:12.475644 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:41:12.475644 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:41:12.475644 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 644/1258] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:41:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:12.480826 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd254a-9b88-4057-ae48-abdb9094f109 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:12.596816 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd254a-9b88-4057-ae48-abdb9094f109 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:12.636295 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ed50d-7a28-4faf-9eae-9313073acc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:12.637445 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ed50d-7a28-4faf-9eae-9313073acc76 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:12.637994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ed50d-7a28-4faf-9eae-9313073acc76 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:12.638501 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ed50d-7a28-4faf-9eae-9313073acc76 None admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:12.639929 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ed50d-7a28-4faf-9eae-9313073acc76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:12.640248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ed50d-7a28-4faf-9eae-9313073acc76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:12.642019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ed50d-7a28-4faf-9eae-9313073acc76 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:12.654499 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 615/1259] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:41:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:12.660964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98f4eb-56fb-40cf-9c0b-b6039b2beba5 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:12.687488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:12.764477 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98f4eb-56fb-40cf-9c0b-b6039b2beba5 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:12.801159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded65c1-aecc-42f5-86ef-c0592ec544d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:12.801827 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded65c1-aecc-42f5-86ef-c0592ec544d8 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:12.802148 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded65c1-aecc-42f5-86ef-c0592ec544d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:12.802456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded65c1-aecc-42f5-86ef-c0592ec544d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:12.803390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded65c1-aecc-42f5-86ef-c0592ec544d8 None admin] RBAC: Adding query filter params (role.id=abdc0e0957534149b3653eaa33cbd054, scope.project.id=ff90b874f5b84d28a2752bc95419ad95, user.id=9300c3a803e94f9a93442f551fc9646f) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:12.803747 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded65c1-aecc-42f5-86ef-c0592ec544d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:12.805805 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded65c1-aecc-42f5-86ef-c0592ec544d8 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:12.811875 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 645/1260] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:41:12 2022] GET /identity/v3/role_assignments?user.id=9300c3a803e94f9a93442f551fc9646f&scope.project.id=ff90b874f5b84d28a2752bc95419ad95&role.id=abdc0e0957534149b3653eaa33cbd054 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:14.850646 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7920fa9-48a9-40ca-9375-102bde6a9565 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:14.851376 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7920fa9-48a9-40ca-9375-102bde6a9565 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:14.851376 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7920fa9-48a9-40ca-9375-102bde6a9565 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:14.852540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 616/1261] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:41:14.862527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c7eee-7cc4-4556-bc58-037ee81381a4 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:14.863115 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c7eee-7cc4-4556-bc58-037ee81381a4 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:14.863115 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c7eee-7cc4-4556-bc58-037ee81381a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:14.883632 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-ca1c7eee-7cc4-4556-bc58-037ee81381a4 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:41:14.884809 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ca1c7eee-7cc4-4556-bc58-037ee81381a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:41:14.948633 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 646/1262] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:41:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 15:41:14.970954 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7920fa9-48a9-40ca-9375-102bde6a9565 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:14.982211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:15.070896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7920fa9-48a9-40ca-9375-102bde6a9565 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:15.104360 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b75d63-16bb-4cd4-bc3a-f774d376ed92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:15.105071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b75d63-16bb-4cd4-bc3a-f774d376ed92 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:15.105353 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b75d63-16bb-4cd4-bc3a-f774d376ed92 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:15.105627 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b75d63-16bb-4cd4-bc3a-f774d376ed92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:15.115549 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b75d63-16bb-4cd4-bc3a-f774d376ed92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:41:15.123668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-01b75d63-16bb-4cd4-bc3a-f774d376ed92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:41:15.123668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:15.123668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:15.123668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:15.123668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:15.123668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:15.123668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:15.123668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:15.123668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:15.123668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:15.123668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:15.123668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:15.123668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:41:15.123668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:41:15.123668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:41:15.123668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:41:15.124861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:41:15.124861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:41:15.124861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:41:15.124861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:41:15.124861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:15.124861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:15.124861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:15.124861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:15.124861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:15.124861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:15.124861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:15.124861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:15.124861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:15.124861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:15.124861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:15.124861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:15.125786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:15.125786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:15.125786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:15.125786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:15.125786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:41:15.125786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:41:15.125786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:41:15.125786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:41:15.125786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:41:15.125786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:41:15.125786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:41:15.125786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:41:15.125786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 617/1263] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:41:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:15.131117 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c7eee-7cc4-4556-bc58-037ee81381a4 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:15.150000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:15.235871 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c7eee-7cc4-4556-bc58-037ee81381a4 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:15.270746 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47127bb7-f96d-4c39-89e5-209e5e492094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:15.271412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47127bb7-f96d-4c39-89e5-209e5e492094 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:15.271693 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47127bb7-f96d-4c39-89e5-209e5e492094 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:15.271964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47127bb7-f96d-4c39-89e5-209e5e492094 None admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:15.272712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47127bb7-f96d-4c39-89e5-209e5e492094 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:15.273588 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47127bb7-f96d-4c39-89e5-209e5e492094 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:15.274998 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47127bb7-f96d-4c39-89e5-209e5e492094 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:15.284064 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 647/1264] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:41:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:15.290096 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b75d63-16bb-4cd4-bc3a-f774d376ed92 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:15.355553 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:15.391633 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b75d63-16bb-4cd4-bc3a-f774d376ed92 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:15.424185 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0bebe-04e9-41af-8f46-ec363f10d5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:15.424971 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0bebe-04e9-41af-8f46-ec363f10d5fa None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:15.425250 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0bebe-04e9-41af-8f46-ec363f10d5fa None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:15.425522 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0bebe-04e9-41af-8f46-ec363f10d5fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:15.436519 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0bebe-04e9-41af-8f46-ec363f10d5fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:15.437998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0bebe-04e9-41af-8f46-ec363f10d5fa None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:15.455380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-43c0bebe-04e9-41af-8f46-ec363f10d5fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:41:15.455380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:15.455380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:15.455380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:15.455380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:15.455380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:15.455380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:15.455380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:15.455380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:15.455380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:15.455380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:15.455380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:15.455380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:41:15.455380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:41:15.455380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:41:15.456504 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:41:15.456504 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:15.456504 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:15.456504 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:15.456504 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:15.456504 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:15.456504 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:15.456504 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:15.456504 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:15.456504 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:15.456504 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:15.456504 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:15.456504 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:15.456504 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:15.456504 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:15.456504 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:15.456504 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:15.457434 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:41:15.457434 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:41:15.457434 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:41:15.457434 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:41:15.457434 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 618/1265] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:41:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:15.463428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47127bb7-f96d-4c39-89e5-209e5e492094 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:15.546143 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:15.567375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47127bb7-f96d-4c39-89e5-209e5e492094 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:15.600077 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60785333-661d-4327-b734-6eee18dd5d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:15.600736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60785333-661d-4327-b734-6eee18dd5d18 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:15.601064 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60785333-661d-4327-b734-6eee18dd5d18 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:15.601344 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60785333-661d-4327-b734-6eee18dd5d18 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:15.602091 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60785333-661d-4327-b734-6eee18dd5d18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:15.602465 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60785333-661d-4327-b734-6eee18dd5d18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:15.603768 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60785333-661d-4327-b734-6eee18dd5d18 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:15.615236 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 648/1266] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:15.621399 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0bebe-04e9-41af-8f46-ec363f10d5fa None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:15.717793 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0bebe-04e9-41af-8f46-ec363f10d5fa None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:15.736929 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:15.750606 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd5a4a-577d-484a-b608-d80dc47007ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:15.751427 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd5a4a-577d-484a-b608-d80dc47007ed None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:15.751717 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd5a4a-577d-484a-b608-d80dc47007ed None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:15.751995 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd5a4a-577d-484a-b608-d80dc47007ed None admin] PATH_INFO: `/v3/users/placement` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:15.759705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd5a4a-577d-484a-b608-d80dc47007ed None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:15.761132 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd5a4a-577d-484a-b608-d80dc47007ed None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:15.775548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-42cd5a4a-577d-484a-b608-d80dc47007ed None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 15:41:15.775548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:15.775548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:15.775548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:15.775548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:15.775548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:15.775548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:15.775548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:15.775548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:15.775548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:15.775548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:15.775548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:15.775548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:41:15.775548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:41:15.775548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:41:15.775548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:41:15.776661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:15.776661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:15.776661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:41:15.776661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:41:15.776661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:41:15.776661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:41:15.776661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:15.776661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:15.776661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:15.776661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:15.776661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:15.776661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:15.776661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:15.776661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:15.776661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:15.776661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:15.776661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:15.776661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:15.778069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:15.778069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:15.778069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:41:15.778069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:41:15.778069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:41:15.778069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:41:15.778069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:41:15.778069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:41:15.778069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 15:41:15.778069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:41:15.778069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 619/1267] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:41:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:15.782730 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60785333-661d-4327-b734-6eee18dd5d18 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:15.877984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60785333-661d-4327-b734-6eee18dd5d18 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:15.911108 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69382be4-56b2-40d2-8d2d-9d6ff2c4677a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:15.911761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69382be4-56b2-40d2-8d2d-9d6ff2c4677a None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:15.912050 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69382be4-56b2-40d2-8d2d-9d6ff2c4677a None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:15.912326 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69382be4-56b2-40d2-8d2d-9d6ff2c4677a None admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:15.913151 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69382be4-56b2-40d2-8d2d-9d6ff2c4677a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:15.914015 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69382be4-56b2-40d2-8d2d-9d6ff2c4677a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:15.915432 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69382be4-56b2-40d2-8d2d-9d6ff2c4677a None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:15.923759 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:15.932901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 649/1268] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Jun 23 15:41:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:15.938663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd5a4a-577d-484a-b608-d80dc47007ed None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:16.038952 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd5a4a-577d-484a-b608-d80dc47007ed None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:16.073218 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10408873-add7-40a6-b229-f2f63e2b43e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:16.074033 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10408873-add7-40a6-b229-f2f63e2b43e4 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:16.074324 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10408873-add7-40a6-b229-f2f63e2b43e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:16.074608 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10408873-add7-40a6-b229-f2f63e2b43e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:16.085050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10408873-add7-40a6-b229-f2f63e2b43e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:16.086517 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10408873-add7-40a6-b229-f2f63e2b43e4 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:16.102863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-10408873-add7-40a6-b229-f2f63e2b43e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:41:16.102863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:16.102863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:16.102863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:16.102863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:16.102863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:16.102863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:16.102863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:16.102863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:16.102863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:16.102863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:16.102863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:16.102863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:41:16.102863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:41:16.102863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:41:16.103878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:41:16.103878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:16.103878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:16.103878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:16.103878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:16.103878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:16.103878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:16.103878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:16.103878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:16.103878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:16.103878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:16.103878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:16.103878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:16.103878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:16.103878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:16.103878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:16.103878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:16.104831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:41:16.104831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:41:16.104831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:41:16.104831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:41:16.104831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 620/1269] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:41:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:16.109951 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69382be4-56b2-40d2-8d2d-9d6ff2c4677a None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:16.214015 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69382be4-56b2-40d2-8d2d-9d6ff2c4677a None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:16.250711 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02c3eb-0577-47eb-a800-a69c2c04885e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:16.251375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02c3eb-0577-47eb-a800-a69c2c04885e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:16.251661 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02c3eb-0577-47eb-a800-a69c2c04885e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:16.251941 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02c3eb-0577-47eb-a800-a69c2c04885e None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:16.252670 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02c3eb-0577-47eb-a800-a69c2c04885e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:16.252983 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02c3eb-0577-47eb-a800-a69c2c04885e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:16.254384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02c3eb-0577-47eb-a800-a69c2c04885e None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:16.266095 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 650/1270] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:16.271788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10408873-add7-40a6-b229-f2f63e2b43e4 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:16.302546 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:16.378678 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10408873-add7-40a6-b229-f2f63e2b43e4 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:16.411308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280074c9-cee1-45b3-9956-3ba81b6a1b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:16.412069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280074c9-cee1-45b3-9956-3ba81b6a1b4b None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:16.412349 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280074c9-cee1-45b3-9956-3ba81b6a1b4b None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:16.412620 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280074c9-cee1-45b3-9956-3ba81b6a1b4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:16.419579 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280074c9-cee1-45b3-9956-3ba81b6a1b4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:16.421011 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280074c9-cee1-45b3-9956-3ba81b6a1b4b None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:16.435835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-280074c9-cee1-45b3-9956-3ba81b6a1b4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:41:16.435835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:16.435835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:16.435835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:16.435835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:16.435835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:16.435835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:16.435835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:16.435835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:16.435835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:16.435835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:16.435835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:16.435835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:41:16.435835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:41:16.435835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:41:16.436894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:41:16.436894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:16.436894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:16.436894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:16.436894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:16.436894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:16.436894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:16.436894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:16.436894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:16.436894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:16.436894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:16.436894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:16.436894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:16.436894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:16.436894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:16.436894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:16.436894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:16.438190 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:41:16.438190 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:41:16.438190 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:41:16.438190 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:41:16.438190 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:41:16.438190 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:41:16.438190 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:41:16.438190 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:41:16.438190 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 621/1271] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:41:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:16.442841 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02c3eb-0577-47eb-a800-a69c2c04885e None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:16.499931 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:16.541840 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02c3eb-0577-47eb-a800-a69c2c04885e None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:16.575726 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbd029-a964-4bde-99f2-768a9bef98ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:16.576392 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbd029-a964-4bde-99f2-768a9bef98ef None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:16.576675 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbd029-a964-4bde-99f2-768a9bef98ef None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:16.576952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbd029-a964-4bde-99f2-768a9bef98ef None admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:16.577742 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbd029-a964-4bde-99f2-768a9bef98ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:16.578087 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbd029-a964-4bde-99f2-768a9bef98ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:16.579521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbd029-a964-4bde-99f2-768a9bef98ef None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:16.591717 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 651/1272] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:41:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:16.597813 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280074c9-cee1-45b3-9956-3ba81b6a1b4b None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:16.694056 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:16.703787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280074c9-cee1-45b3-9956-3ba81b6a1b4b None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:16.737235 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328da3f-cd0e-4a7c-b82c-b066b8659d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:16.738141 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328da3f-cd0e-4a7c-b82c-b066b8659d2b None admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:16.738423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328da3f-cd0e-4a7c-b82c-b066b8659d2b None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:16.738698 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328da3f-cd0e-4a7c-b82c-b066b8659d2b None admin] PATH_INFO: `/v3/projects/ff90b874f5b84d28a2752bc95419ad95/users/9300c3a803e94f9a93442f551fc9646f/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:16.740625 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328da3f-cd0e-4a7c-b82c-b066b8659d2b None admin] RBAC: Authorizing `identity:create_grant(project_id=ff90b874f5b84d28a2752bc95419ad95, user_id=9300c3a803e94f9a93442f551fc9646f, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:16.742721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328da3f-cd0e-4a7c-b82c-b066b8659d2b None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:16.755397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 622/1273] 10.222.0.15 () {58 vars in 1439 bytes} [Thu Jun 23 15:41:16 2022] PUT /identity/v3/projects/ff90b874f5b84d28a2752bc95419ad95/users/9300c3a803e94f9a93442f551fc9646f/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:41:18.767779 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e939037-df48-47cc-807c-fbe1f7406fc3 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:18.768302 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e939037-df48-47cc-807c-fbe1f7406fc3 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:18.768302 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e939037-df48-47cc-807c-fbe1f7406fc3 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:18.769688 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 652/1274] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:41:18.774877 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef0a8e-483a-416e-84c1-ca3a27f0f43f None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:18.775254 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef0a8e-483a-416e-84c1-ca3a27f0f43f None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:18.775443 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef0a8e-483a-416e-84c1-ca3a27f0f43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:18.792540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-d2ef0a8e-483a-416e-84c1-ca3a27f0f43f None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:41:18.793715 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-d2ef0a8e-483a-416e-84c1-ca3a27f0f43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:41:18.857885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 623/1275] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:41:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:41:18.882027 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e939037-df48-47cc-807c-fbe1f7406fc3 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:18.990632 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e939037-df48-47cc-807c-fbe1f7406fc3 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:19.007609 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:19.028266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38095ed8-dc5f-4fa7-a9d5-e748d157ce9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:19.029061 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38095ed8-dc5f-4fa7-a9d5-e748d157ce9a None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:19.029345 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38095ed8-dc5f-4fa7-a9d5-e748d157ce9a None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:19.029626 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38095ed8-dc5f-4fa7-a9d5-e748d157ce9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:19.040448 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38095ed8-dc5f-4fa7-a9d5-e748d157ce9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 15:41:19.047916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-38095ed8-dc5f-4fa7-a9d5-e748d157ce9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:41:19.047916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:19.047916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:19.047916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:19.047916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:19.047916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:19.047916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:19.047916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:19.047916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:19.047916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:19.047916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:19.047916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:19.047916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 15:41:19.047916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 15:41:19.047916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 15:41:19.047916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 15:41:19.049024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 15:41:19.049024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 15:41:19.049024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 15:41:19.049024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 15:41:19.049024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:19.049024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:19.049024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:19.049024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:19.049024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:19.049024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:19.049024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:19.049024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:19.049024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:19.049024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:19.049024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:19.049024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:19.050123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:19.050123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:19.050123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:19.050123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:19.050123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 15:41:19.050123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 15:41:19.050123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 15:41:19.050123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 15:41:19.050123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 15:41:19.050123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 15:41:19.050123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 15:41:19.050123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:41:19.050123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 653/1276] 10.222.0.15 () {56 vars in 1096 bytes} [Thu Jun 23 15:41:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:19.055211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef0a8e-483a-416e-84c1-ca3a27f0f43f None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:19.134988 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:19.153831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef0a8e-483a-416e-84c1-ca3a27f0f43f None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:19.193292 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418a8b4-f445-418f-9480-3139f88292db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:19.194259 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418a8b4-f445-418f-9480-3139f88292db None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:19.194743 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418a8b4-f445-418f-9480-3139f88292db None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:19.195042 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418a8b4-f445-418f-9480-3139f88292db None admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:19.196066 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418a8b4-f445-418f-9480-3139f88292db None admin] RBAC: Adding query filter params (name=admin) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:19.196474 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418a8b4-f445-418f-9480-3139f88292db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:19.198341 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418a8b4-f445-418f-9480-3139f88292db None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:19.207849 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 624/1277] 10.222.0.15 () {56 vars in 1099 bytes} [Thu Jun 23 15:41:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:19.214096 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38095ed8-dc5f-4fa7-a9d5-e748d157ce9a None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:19.312783 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38095ed8-dc5f-4fa7-a9d5-e748d157ce9a None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:19.345403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a2dc9-063b-4275-adbb-0dd1da9897bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:19.346218 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a2dc9-063b-4275-adbb-0dd1da9897bd None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:19.346507 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a2dc9-063b-4275-adbb-0dd1da9897bd None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:19.346786 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a2dc9-063b-4275-adbb-0dd1da9897bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:19.357535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a2dc9-063b-4275-adbb-0dd1da9897bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:19.359004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a2dc9-063b-4275-adbb-0dd1da9897bd None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:19.375456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-ec1a2dc9-063b-4275-adbb-0dd1da9897bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:41:19.375456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:19.375456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:19.375456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:19.375456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:19.375456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:19.375456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:19.375456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:19.375456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:19.375456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:19.375456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:19.375456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:19.375456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:41:19.375456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:41:19.375456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:41:19.376369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:41:19.376369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:19.376369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:19.376369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:19.376369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:19.376369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:19.376369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:19.376369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:19.376369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:19.376369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:19.376369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:19.376369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:19.376369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:19.376369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:19.376369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:19.376369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:19.376369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:19.377401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:41:19.377401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:41:19.377401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:41:19.377401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:41:19.377401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 654/1278] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:41:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:19.382983 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418a8b4-f445-418f-9480-3139f88292db None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:19.478632 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418a8b4-f445-418f-9480-3139f88292db None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:19.510787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a5b50-6941-4a49-9bc9-7b084a20e7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:19.511436 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a5b50-6941-4a49-9bc9-7b084a20e7b4 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:19.511717 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a5b50-6941-4a49-9bc9-7b084a20e7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:19.511990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a5b50-6941-4a49-9bc9-7b084a20e7b4 None admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:19.512703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a5b50-6941-4a49-9bc9-7b084a20e7b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:19.513009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a5b50-6941-4a49-9bc9-7b084a20e7b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:19.514392 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a5b50-6941-4a49-9bc9-7b084a20e7b4 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:19.526108 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 625/1279] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:19.532030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a2dc9-063b-4275-adbb-0dd1da9897bd None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:19.561501 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:19.630412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a2dc9-063b-4275-adbb-0dd1da9897bd None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:19.662970 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ae396-5761-4300-88a4-0c6d53f29643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:19.664529 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ae396-5761-4300-88a4-0c6d53f29643 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:19.664888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ae396-5761-4300-88a4-0c6d53f29643 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:19.665168 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ae396-5761-4300-88a4-0c6d53f29643 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:19.673278 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ae396-5761-4300-88a4-0c6d53f29643 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:19.674738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ae396-5761-4300-88a4-0c6d53f29643 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:19.689232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-947ae396-5761-4300-88a4-0c6d53f29643 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 15:41:19.689232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:19.689232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:19.689232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:19.689232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:19.689232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:19.689232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:19.689232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:19.689232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:19.689232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:19.689232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:19.689232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:19.689232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 15:41:19.689232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 15:41:19.689232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 15:41:19.689232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 15:41:19.690496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:19.690496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:19.690496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 15:41:19.690496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:41:19.690496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 15:41:19.690496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 15:41:19.690496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:19.690496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:19.690496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:19.690496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:19.690496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:19.690496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:19.690496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:19.690496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:19.690496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:19.690496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:19.690496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:19.690496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:19.691451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:19.691451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:19.691451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 15:41:19.691451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 15:41:19.691451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 15:41:19.691451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 15:41:19.691451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 15:41:19.691451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 15:41:19.691451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 15:41:19.691451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:41:19.691451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 655/1280] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:41:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:19.696407 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a5b50-6941-4a49-9bc9-7b084a20e7b4 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:19.700174 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:19.794574 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a5b50-6941-4a49-9bc9-7b084a20e7b4 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:19.826847 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff32de-b163-46a0-89ca-1402626476ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:19.827520 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff32de-b163-46a0-89ca-1402626476ac None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:19.827804 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff32de-b163-46a0-89ca-1402626476ac None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:19.828084 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff32de-b163-46a0-89ca-1402626476ac None admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:19.828914 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff32de-b163-46a0-89ca-1402626476ac None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:19.829226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff32de-b163-46a0-89ca-1402626476ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:19.830664 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff32de-b163-46a0-89ca-1402626476ac None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:19.848448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 626/1281] 10.222.0.15 () {56 vars in 1143 bytes} [Thu Jun 23 15:41:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:19.854774 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ae396-5761-4300-88a4-0c6d53f29643 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:19.942207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:19.951756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ae396-5761-4300-88a4-0c6d53f29643 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:19.984573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8536c-ae27-4144-9829-d0f41f33ec1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:19.985225 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8536c-ae27-4144-9829-d0f41f33ec1f None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:19.985507 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8536c-ae27-4144-9829-d0f41f33ec1f None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:19.985780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8536c-ae27-4144-9829-d0f41f33ec1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:20.053497 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8536c-ae27-4144-9829-d0f41f33ec1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:20.054935 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8536c-ae27-4144-9829-d0f41f33ec1f None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:20.147224 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:20.158477 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 656/1282] 10.222.0.15 () {58 vars in 1282 bytes} [Thu Jun 23 15:41:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 15:41:20.164452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff32de-b163-46a0-89ca-1402626476ac None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:20.238574 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:20.277263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff32de-b163-46a0-89ca-1402626476ac None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:20.309686 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614fb96-a480-4c29-89bc-31dcc73caca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:20.310732 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614fb96-a480-4c29-89bc-31dcc73caca7 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:20.311023 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614fb96-a480-4c29-89bc-31dcc73caca7 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:20.311296 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614fb96-a480-4c29-89bc-31dcc73caca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:20.321532 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614fb96-a480-4c29-89bc-31dcc73caca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:20.323035 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614fb96-a480-4c29-89bc-31dcc73caca7 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:20.340598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-b614fb96-a480-4c29-89bc-31dcc73caca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:41:20.340598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:20.340598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:20.340598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:20.340598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:20.340598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:20.340598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:20.340598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:20.340598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:20.340598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:20.340598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:20.340598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:20.340598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 15:41:20.340598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 15:41:20.340598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 15:41:20.341713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 15:41:20.341713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:20.341713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:20.341713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:20.341713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:20.341713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:20.341713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:20.341713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:20.341713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:20.341713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:20.341713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:20.341713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:20.341713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:20.341713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:20.341713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:20.341713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:20.341713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:20.342658 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 15:41:20.342658 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 15:41:20.342658 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 15:41:20.342658 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:41:20.342658 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 627/1283] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:41:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:20.347547 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8536c-ae27-4144-9829-d0f41f33ec1f None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:20.446179 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8536c-ae27-4144-9829-d0f41f33ec1f None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:20.481560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b8a20-d717-4af9-91b1-5e8570ea1715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:20.482244 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b8a20-d717-4af9-91b1-5e8570ea1715 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:20.482530 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b8a20-d717-4af9-91b1-5e8570ea1715 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:20.482806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b8a20-d717-4af9-91b1-5e8570ea1715 None admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:20.483523 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b8a20-d717-4af9-91b1-5e8570ea1715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:20.483832 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b8a20-d717-4af9-91b1-5e8570ea1715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:20.485193 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b8a20-d717-4af9-91b1-5e8570ea1715 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:20.496198 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 657/1284] 10.222.0.15 () {56 vars in 1109 bytes} [Thu Jun 23 15:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:20.501808 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614fb96-a480-4c29-89bc-31dcc73caca7 None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:20.598561 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614fb96-a480-4c29-89bc-31dcc73caca7 None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:20.613197 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:20.634762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a2843-d826-497a-a4c5-4b06b6b3dadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:20.635564 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a2843-d826-497a-a4c5-4b06b6b3dadf None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:20.635846 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a2843-d826-497a-a4c5-4b06b6b3dadf None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:20.636123 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a2843-d826-497a-a4c5-4b06b6b3dadf None admin] PATH_INFO: `/v3/projects/service` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:20.643083 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a2843-d826-497a-a4c5-4b06b6b3dadf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:20.644510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a2843-d826-497a-a4c5-4b06b6b3dadf None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:20.657931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application [None req-a53a2843-d826-497a-a4c5-4b06b6b3dadf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:41:20.657931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:20.657931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:20.657931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:20.657931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:20.657931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:20.657931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:20.657931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:20.657931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:20.657931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:20.657931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:20.657931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:20.657931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 15:41:20.657931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 15:41:20.657931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 15:41:20.658940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 15:41:20.658940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:20.658940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:20.658940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:20.658940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:20.658940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:20.658940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:20.658940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:20.658940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:20.658940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:20.658940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:20.658940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:20.658940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:20.658940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:20.658940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:20.658940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:20.658940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:20.659977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 15:41:20.659977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 15:41:20.659977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 15:41:20.659977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 15:41:20.659977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 15:41:20.659977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 15:41:20.659977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 15:41:20.659977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: ERROR keystone.server.flask.application Jun 23 15:41:20.662011 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 628/1285] 10.222.0.15 () {56 vars in 1111 bytes} [Thu Jun 23 15:41:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:20.664873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b8a20-d717-4af9-91b1-5e8570ea1715 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:20.715453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:20.767657 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b8a20-d717-4af9-91b1-5e8570ea1715 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:20.799419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a73df1-8e64-4926-ac8e-3d0fffb5cfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:20.800071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a73df1-8e64-4926-ac8e-3d0fffb5cfd4 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:20.800354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a73df1-8e64-4926-ac8e-3d0fffb5cfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:20.800631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a73df1-8e64-4926-ac8e-3d0fffb5cfd4 None admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:20.801405 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a73df1-8e64-4926-ac8e-3d0fffb5cfd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:20.801714 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a73df1-8e64-4926-ac8e-3d0fffb5cfd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:20.803162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a73df1-8e64-4926-ac8e-3d0fffb5cfd4 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:20.815139 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 658/1286] 10.222.0.15 () {56 vars in 1148 bytes} [Thu Jun 23 15:41:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:20.821932 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a2843-d826-497a-a4c5-4b06b6b3dadf None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:20.922054 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a2843-d826-497a-a4c5-4b06b6b3dadf None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:20.954751 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde8a9b-43d3-48f3-b41d-32069780fb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:20.955406 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde8a9b-43d3-48f3-b41d-32069780fb5c None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:20.955690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde8a9b-43d3-48f3-b41d-32069780fb5c None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:20.955973 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde8a9b-43d3-48f3-b41d-32069780fb5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:20.956809 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde8a9b-43d3-48f3-b41d-32069780fb5c None admin] RBAC: Adding query filter params (role.id=abdc0e0957534149b3653eaa33cbd054, scope.project.id=ff90b874f5b84d28a2752bc95419ad95, user.id=9300c3a803e94f9a93442f551fc9646f) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:20.957125 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde8a9b-43d3-48f3-b41d-32069780fb5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:20.958582 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde8a9b-43d3-48f3-b41d-32069780fb5c None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:20.964522 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 629/1287] 10.222.0.15 () {56 vars in 1374 bytes} [Thu Jun 23 15:41:20 2022] GET /identity/v3/role_assignments?user.id=9300c3a803e94f9a93442f551fc9646f&scope.project.id=ff90b874f5b84d28a2752bc95419ad95&role.id=abdc0e0957534149b3653eaa33cbd054 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:23.015314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d628e6-8198-4398-babf-7c16a3ea72cd None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:23.015884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d628e6-8198-4398-babf-7c16a3ea72cd None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:23.015884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d628e6-8198-4398-babf-7c16a3ea72cd None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:23.017254 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 659/1288] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:41:23.022421 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a7e34-6226-4871-b320-69052d835df4 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:23.022871 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a7e34-6226-4871-b320-69052d835df4 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:23.022989 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a7e34-6226-4871-b320-69052d835df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:23.039785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-593a7e34-6226-4871-b320-69052d835df4 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:41:23.040976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-593a7e34-6226-4871-b320-69052d835df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:41:23.070596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:23.106618 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 630/1289] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:41:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:41:23.129726 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d628e6-8198-4398-babf-7c16a3ea72cd None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:23.234429 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d628e6-8198-4398-babf-7c16a3ea72cd None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:23.246022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:23.269520 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcefb79-d7ab-471c-9b6d-1f3dd172f300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:23.270271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcefb79-d7ab-471c-9b6d-1f3dd172f300 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:23.270553 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcefb79-d7ab-471c-9b6d-1f3dd172f300 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:23.270827 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcefb79-d7ab-471c-9b6d-1f3dd172f300 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:23.271480 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcefb79-d7ab-471c-9b6d-1f3dd172f300 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:23.273000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcefb79-d7ab-471c-9b6d-1f3dd172f300 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:23.284721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-abcefb79-d7ab-471c-9b6d-1f3dd172f300 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 15:41:23.284721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:23.284721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:41:23.284721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:41:23.284721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:41:23.284721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:41:23.284721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:41:23.284721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:41:23.284721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 15:41:23.284721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:41:23.284721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:41:23.284721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:41:23.284721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:23.284721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:23.284721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:23.284721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:23.284721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:23.285990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:23.285990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:23.285990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:23.285990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:23.285990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:23.285990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:23.285990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:41:23.285990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:41:23.285990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:41:23.285990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:41:23.285990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:23.285990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:23.285990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:23.285990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:23.285990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:23.285990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:23.287157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:23.287157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:23.287157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:23.287157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:23.287157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:23.287157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:23.287157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:23.287157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:23.287157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:23.287157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:23.287157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:41:23.287157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:41:23.287157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 15:41:23.287157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:41:23.287157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 660/1290] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jun 23 15:41:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:23.292392 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a7e34-6226-4871-b320-69052d835df4 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:23.388301 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a7e34-6226-4871-b320-69052d835df4 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:23.421181 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fc067-1771-464f-a9dd-c0cfc33edbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:23.421833 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fc067-1771-464f-a9dd-c0cfc33edbd8 None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:23.422144 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fc067-1771-464f-a9dd-c0cfc33edbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:23.422419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fc067-1771-464f-a9dd-c0cfc33edbd8 None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:23.423114 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fc067-1771-464f-a9dd-c0cfc33edbd8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:23.423419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fc067-1771-464f-a9dd-c0cfc33edbd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:23.424763 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fc067-1771-464f-a9dd-c0cfc33edbd8 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:23.430123 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 631/1291] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Jun 23 15:41:23 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:23.435899 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcefb79-d7ab-471c-9b6d-1f3dd172f300 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:23.532934 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcefb79-d7ab-471c-9b6d-1f3dd172f300 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:23.565565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07da304-4665-442f-9a32-3a02a8176445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:23.566147 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07da304-4665-442f-9a32-3a02a8176445 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:23.566432 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07da304-4665-442f-9a32-3a02a8176445 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:23.566709 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07da304-4665-442f-9a32-3a02a8176445 None admin] PATH_INFO: `/v3/services` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:23.567413 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07da304-4665-442f-9a32-3a02a8176445 None admin] RBAC: Adding query filter params (type=placement) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:23.567885 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07da304-4665-442f-9a32-3a02a8176445 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:23.569087 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07da304-4665-442f-9a32-3a02a8176445 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:23.573585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 661/1292] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Jun 23 15:41:23 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:25.574723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aaf5a0-5149-48e1-9ca5-21ce15540feb None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:25.575192 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aaf5a0-5149-48e1-9ca5-21ce15540feb None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:25.575285 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aaf5a0-5149-48e1-9ca5-21ce15540feb None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:25.576635 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 632/1293] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:41:25.581593 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cf463-1e5d-4d41-b008-7e810fa2c0a3 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:25.581997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cf463-1e5d-4d41-b008-7e810fa2c0a3 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:25.582184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cf463-1e5d-4d41-b008-7e810fa2c0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:25.598418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-565cf463-1e5d-4d41-b008-7e810fa2c0a3 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:41:25.599594 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-565cf463-1e5d-4d41-b008-7e810fa2c0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:41:25.628510 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:25.664956 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 662/1294] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:41:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:41:25.687981 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aaf5a0-5149-48e1-9ca5-21ce15540feb None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:25.717616 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:25.786532 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aaf5a0-5149-48e1-9ca5-21ce15540feb None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:25.818518 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce3026-ac37-4de1-8de8-72883f65c9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:25.819102 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce3026-ac37-4de1-8de8-72883f65c9c5 None admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:25.819384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce3026-ac37-4de1-8de8-72883f65c9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:25.819659 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce3026-ac37-4de1-8de8-72883f65c9c5 None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:25.820378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce3026-ac37-4de1-8de8-72883f65c9c5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:25.821769 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce3026-ac37-4de1-8de8-72883f65c9c5 None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:25.834447 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 633/1295] 10.222.0.15 () {60 vars in 1141 bytes} [Thu Jun 23 15:41:25 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:41:27.877367 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7f63f-a5c0-4a9a-bb28-bfeb8b5cb0f6 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:27.877908 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7f63f-a5c0-4a9a-bb28-bfeb8b5cb0f6 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:27.877908 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7f63f-a5c0-4a9a-bb28-bfeb8b5cb0f6 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:27.879237 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 663/1296] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:41:27.884836 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c037cc1-1d29-46b3-b06f-b8198d01480d None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:27.885251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c037cc1-1d29-46b3-b06f-b8198d01480d None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:27.885393 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c037cc1-1d29-46b3-b06f-b8198d01480d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:27.902208 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-7c037cc1-1d29-46b3-b06f-b8198d01480d None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:41:27.903386 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-7c037cc1-1d29-46b3-b06f-b8198d01480d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:41:27.975009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 634/1297] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:41:27 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:41:27.998976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7f63f-a5c0-4a9a-bb28-bfeb8b5cb0f6 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:28.098290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7f63f-a5c0-4a9a-bb28-bfeb8b5cb0f6 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:28.131684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4cd58-607f-4a65-9ac8-f557deef687e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:28.133011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4cd58-607f-4a65-9ac8-f557deef687e None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:28.133292 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4cd58-607f-4a65-9ac8-f557deef687e None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:28.133564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4cd58-607f-4a65-9ac8-f557deef687e None admin] PATH_INFO: `/v3/services/placement` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:28.134261 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4cd58-607f-4a65-9ac8-f557deef687e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:28.135631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed4cd58-607f-4a65-9ac8-f557deef687e None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:28.147606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-5ed4cd58-607f-4a65-9ac8-f557deef687e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 15:41:28.147606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:28.147606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:41:28.147606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:41:28.147606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:41:28.147606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:41:28.147606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:41:28.147606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:41:28.147606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 15:41:28.147606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:41:28.147606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:41:28.147606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:41:28.147606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:28.147606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:28.147606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:28.147606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:28.147606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:28.148797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:28.148797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:28.148797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:28.148797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:28.148797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:28.148797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:28.148797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:41:28.148797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:41:28.148797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:41:28.148797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:41:28.148797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:28.148797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:28.148797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:28.148797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:28.148797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:28.148797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:28.149660 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:28.149660 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:28.149660 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:28.149660 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:28.149660 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:28.149660 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:28.149660 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:28.149660 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:28.149660 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:28.149660 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:28.149660 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:41:28.149660 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:41:28.149660 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 15:41:28.149660 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:41:28.149660 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 664/1298] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jun 23 15:41:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:28.154851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c037cc1-1d29-46b3-b06f-b8198d01480d None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:28.173255 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:28.267288 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c037cc1-1d29-46b3-b06f-b8198d01480d None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:28.300545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c3cdf-0033-47dc-9b74-b3b23ecdc7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:28.301208 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c3cdf-0033-47dc-9b74-b3b23ecdc7eb None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:28.301492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c3cdf-0033-47dc-9b74-b3b23ecdc7eb None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:28.301776 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c3cdf-0033-47dc-9b74-b3b23ecdc7eb None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:28.302522 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c3cdf-0033-47dc-9b74-b3b23ecdc7eb None admin] RBAC: Adding query filter params (name=placement) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:28.302828 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c3cdf-0033-47dc-9b74-b3b23ecdc7eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:28.304687 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c3cdf-0033-47dc-9b74-b3b23ecdc7eb None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:28.309776 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 635/1299] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Jun 23 15:41:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:28.315874 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4cd58-607f-4a65-9ac8-f557deef687e None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:28.347650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:28.416494 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4cd58-607f-4a65-9ac8-f557deef687e None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:28.448910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf3cf6-86aa-4c4f-9b35-dc61c5832748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:28.449566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf3cf6-86aa-4c4f-9b35-dc61c5832748 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:28.449884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf3cf6-86aa-4c4f-9b35-dc61c5832748 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:28.450163 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf3cf6-86aa-4c4f-9b35-dc61c5832748 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:28.450955 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf3cf6-86aa-4c4f-9b35-dc61c5832748 None admin] RBAC: Adding query filter params (interface=public, service_id=f740d5f2b89b4643b1ab72ac2b461378, region_id=RegionOne) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:28.451272 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf3cf6-86aa-4c4f-9b35-dc61c5832748 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:28.452634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf3cf6-86aa-4c4f-9b35-dc61c5832748 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:28.457628 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 665/1300] 10.222.0.15 () {56 vars in 1251 bytes} [Thu Jun 23 15:41:28 2022] GET /identity/v3/endpoints?service_id=f740d5f2b89b4643b1ab72ac2b461378&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:41:28.463878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c3cdf-0033-47dc-9b74-b3b23ecdc7eb None admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:28.544319 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:28.562001 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c3cdf-0033-47dc-9b74-b3b23ecdc7eb None admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:28.595572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bcea5-721f-4d5f-bb37-208759060dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:28.596230 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bcea5-721f-4d5f-bb37-208759060dfd None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:28.596512 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bcea5-721f-4d5f-bb37-208759060dfd None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:28.596788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bcea5-721f-4d5f-bb37-208759060dfd None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:28.597465 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bcea5-721f-4d5f-bb37-208759060dfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:28.598857 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bcea5-721f-4d5f-bb37-208759060dfd None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:28.605620 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 636/1301] 10.222.0.15 () {56 vars in 1087 bytes} [Thu Jun 23 15:41:28 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 15:41:30.620048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c3fd2-fa3c-4eca-b808-6dbf2cedce60 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:30.620645 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c3fd2-fa3c-4eca-b808-6dbf2cedce60 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:30.620645 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c3fd2-fa3c-4eca-b808-6dbf2cedce60 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:30.622013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 666/1302] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:41:30.627279 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca508868-bec0-4236-8141-f23e69e8382a None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:30.627718 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca508868-bec0-4236-8141-f23e69e8382a None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:30.627833 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca508868-bec0-4236-8141-f23e69e8382a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:30.644928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-ca508868-bec0-4236-8141-f23e69e8382a None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:41:30.646144 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-ca508868-bec0-4236-8141-f23e69e8382a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:41:30.711710 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 637/1303] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:41:30 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 15:41:30.735262 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c3fd2-fa3c-4eca-b808-6dbf2cedce60 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:30.830915 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:30.838222 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c3fd2-fa3c-4eca-b808-6dbf2cedce60 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:30.872288 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a09f71-004c-4229-a1df-d873966afc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:30.873093 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a09f71-004c-4229-a1df-d873966afc55 None admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:30.873382 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a09f71-004c-4229-a1df-d873966afc55 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:30.873664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a09f71-004c-4229-a1df-d873966afc55 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:30.874357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a09f71-004c-4229-a1df-d873966afc55 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:30.875727 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a09f71-004c-4229-a1df-d873966afc55 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:30.887653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application [None req-89a09f71-004c-4229-a1df-d873966afc55 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 15:41:30.887653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:30.887653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 15:41:30.887653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 15:41:30.887653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 15:41:30.887653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 15:41:30.887653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 15:41:30.887653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:41:30.887653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 15:41:30.887653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:41:30.887653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 15:41:30.887653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:41:30.887653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 15:41:30.887653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 15:41:30.887653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 15:41:30.887653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 15:41:30.887653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 15:41:30.888865 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 15:41:30.888865 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 15:41:30.888865 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 15:41:30.888865 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 15:41:30.888865 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 15:41:30.888865 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 15:41:30.888865 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 15:41:30.888865 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 15:41:30.888865 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 15:41:30.888865 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 15:41:30.888865 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 15:41:30.888865 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 15:41:30.888865 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 15:41:30.888865 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 15:41:30.888865 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 15:41:30.888865 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 15:41:30.890008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 15:41:30.890008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application with Lock( Jun 23 15:41:30.890008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 15:41:30.890008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self._enter() Jun 23 15:41:30.890008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 15:41:30.890008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 15:41:30.890008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 15:41:30.890008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application return self.creator() Jun 23 15:41:30.890008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 15:41:30.890008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application created_value = creator( Jun 23 15:41:30.890008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 15:41:30.890008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 15:41:30.890008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 15:41:30.890008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: ERROR keystone.server.flask.application Jun 23 15:41:30.890008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 667/1304] 10.222.0.15 () {56 vars in 1117 bytes} [Thu Jun 23 15:41:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 15:41:30.894955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca508868-bec0-4236-8141-f23e69e8382a None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:30.976743 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:31.001246 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca508868-bec0-4236-8141-f23e69e8382a None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:31.035406 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107b8da-0945-4abd-a364-61b1eb18237e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:31.036070 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107b8da-0945-4abd-a364-61b1eb18237e None admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:31.036356 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107b8da-0945-4abd-a364-61b1eb18237e None admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:31.036639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107b8da-0945-4abd-a364-61b1eb18237e None admin] PATH_INFO: `/v3/services` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:31.037345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107b8da-0945-4abd-a364-61b1eb18237e None admin] RBAC: Adding query filter params (name=placement) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:41:31.037655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107b8da-0945-4abd-a364-61b1eb18237e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:31.039094 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107b8da-0945-4abd-a364-61b1eb18237e None admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:31.044272 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 638/1305] 10.222.0.15 () {56 vars in 1116 bytes} [Thu Jun 23 15:41:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:41:31.050391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a09f71-004c-4229-a1df-d873966afc55 None admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:41:31.148502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a09f71-004c-4229-a1df-d873966afc55 None admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:41:31.182695 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4b279-983b-4988-9f4a-fe0b33922731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:41:31.183399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4b279-983b-4988-9f4a-fe0b33922731 None admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:41:31.183681 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4b279-983b-4988-9f4a-fe0b33922731 None admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:41:31.183961 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4b279-983b-4988-9f4a-fe0b33922731 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:41:31.184830 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4b279-983b-4988-9f4a-fe0b33922731 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:41:31.186343 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4b279-983b-4988-9f4a-fe0b33922731 None admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:41:31.204866 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 668/1306] 10.222.0.15 () {60 vars in 1144 bytes} [Thu Jun 23 15:41:31 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:41:41.041786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=30 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:41:41.200247 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:42:34.823866 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ac0a6-945c-4aa6-8aef-0b50ecaa2c15 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:34.823866 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ac0a6-945c-4aa6-8aef-0b50ecaa2c15 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:34.823866 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ac0a6-945c-4aa6-8aef-0b50ecaa2c15 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:34.827988 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 639/1307] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:42:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:42:34.829679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6faf3-f6c9-4d75-b3aa-4b4a3043d89f None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:34.830169 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6faf3-f6c9-4d75-b3aa-4b4a3043d89f None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:34.830370 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6faf3-f6c9-4d75-b3aa-4b4a3043d89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:34.917987 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-d0e6faf3-f6c9-4d75-b3aa-4b4a3043d89f None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:42:34.919221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-d0e6faf3-f6c9-4d75-b3aa-4b4a3043d89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:35.046237 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 669/1308] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:42:35.101801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51555e6-2e02-4de1-9a6e-b1549207f86f None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:35.102149 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51555e6-2e02-4de1-9a6e-b1549207f86f None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:35.102415 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51555e6-2e02-4de1-9a6e-b1549207f86f None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:35.104032 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 640/1309] 10.222.0.15 () {54 vars in 964 bytes} [Thu Jun 23 15:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:42:35.113211 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e2658-73b5-41dc-996c-3213e123cff6 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:35.113508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e2658-73b5-41dc-996c-3213e123cff6 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:35.113794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e2658-73b5-41dc-996c-3213e123cff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:35.209310 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-429e2658-73b5-41dc-996c-3213e123cff6 None None] MFA Rules not processed for user `44e9fc6def5341a589221350067bb0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:42:35.210838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-429e2658-73b5-41dc-996c-3213e123cff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:35.237042 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:42:35.308843 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 670/1310] 10.222.0.15 () {58 vars in 1061 bytes} [Thu Jun 23 15:42:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:42:35.318929 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51555e6-2e02-4de1-9a6e-b1549207f86f None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:42:35.320742 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-e51555e6-2e02-4de1-9a6e-b1549207f86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:35.444545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51555e6-2e02-4de1-9a6e-b1549207f86f None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:42:35.526724 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37334963-f7c2-4ebc-a221-01685c503fa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:42:35.527543 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37334963-f7c2-4ebc-a221-01685c503fa5 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:35.527937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37334963-f7c2-4ebc-a221-01685c503fa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:35.528324 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37334963-f7c2-4ebc-a221-01685c503fa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:35.530112 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-37334963-f7c2-4ebc-a221-01685c503fa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:35.595342 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:42:35.655713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37334963-f7c2-4ebc-a221-01685c503fa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:42:35.657624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37334963-f7c2-4ebc-a221-01685c503fa5 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:42:35.679425 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 641/1311] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:42:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:42:38.026122 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551f7dc-fe88-4f7e-baa1-8c74ecdcd1a3 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:38.026661 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551f7dc-fe88-4f7e-baa1-8c74ecdcd1a3 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:38.026661 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4551f7dc-fe88-4f7e-baa1-8c74ecdcd1a3 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:38.028051 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 671/1312] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:42:38.033604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc1109-d4e2-4f0f-acca-4d92dcbafb6f None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:38.034102 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc1109-d4e2-4f0f-acca-4d92dcbafb6f None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:38.034199 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc1109-d4e2-4f0f-acca-4d92dcbafb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:38.115044 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-75fc1109-d4e2-4f0f-acca-4d92dcbafb6f None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:42:38.116252 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-75fc1109-d4e2-4f0f-acca-4d92dcbafb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:38.215859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 642/1313] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:42:38.254690 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551f7dc-fe88-4f7e-baa1-8c74ecdcd1a3 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:42:38.256848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-4551f7dc-fe88-4f7e-baa1-8c74ecdcd1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:38.368961 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4551f7dc-fe88-4f7e-baa1-8c74ecdcd1a3 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:42:38.440581 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:42:38.443781 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eef445-423c-4fec-9664-7b1e5b9fb234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:42:38.444681 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eef445-423c-4fec-9664-7b1e5b9fb234 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:38.445185 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eef445-423c-4fec-9664-7b1e5b9fb234 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:38.445703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eef445-423c-4fec-9664-7b1e5b9fb234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:38.447381 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-19eef445-423c-4fec-9664-7b1e5b9fb234 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:38.556976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eef445-423c-4fec-9664-7b1e5b9fb234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:42:38.558439 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eef445-423c-4fec-9664-7b1e5b9fb234 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:42:38.577212 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 672/1314] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:42:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:42:40.951927 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95c386-b2ad-4441-aeb6-65936dc4a037 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:40.952466 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95c386-b2ad-4441-aeb6-65936dc4a037 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:40.952466 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95c386-b2ad-4441-aeb6-65936dc4a037 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:40.953878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 643/1315] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:42:40.959133 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b41673-a4dc-4b25-92be-bb4f1b817cf8 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:40.959568 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b41673-a4dc-4b25-92be-bb4f1b817cf8 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:40.959854 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b41673-a4dc-4b25-92be-bb4f1b817cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:41.025904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-63b41673-a4dc-4b25-92be-bb4f1b817cf8 None None] MFA Rules not processed for user `7fe27f63d24a4cff85a9c0ae32b154cc`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:42:41.027152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-63b41673-a4dc-4b25-92be-bb4f1b817cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:41.084829 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:42:41.132170 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 673/1316] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:42:40 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:42:41.172750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95c386-b2ad-4441-aeb6-65936dc4a037 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:42:41.174335 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-af95c386-b2ad-4441-aeb6-65936dc4a037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:41.185151 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:42:41.282205 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95c386-b2ad-4441-aeb6-65936dc4a037 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:42:41.356072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d74ab2-df89-49a1-8b3e-bf7e779b52d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:42:41.356723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d74ab2-df89-49a1-8b3e-bf7e779b52d1 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:41.357010 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d74ab2-df89-49a1-8b3e-bf7e779b52d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:41.357290 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d74ab2-df89-49a1-8b3e-bf7e779b52d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:41.358987 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-53d74ab2-df89-49a1-8b3e-bf7e779b52d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:41.422341 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:42:41.470380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d74ab2-df89-49a1-8b3e-bf7e779b52d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:42:41.471822 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d74ab2-df89-49a1-8b3e-bf7e779b52d1 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:42:41.490558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 644/1317] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:42:41 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:42:44.091488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2df187-24b6-4e6a-9f08-44f81eb74e2a None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:44.092033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2df187-24b6-4e6a-9f08-44f81eb74e2a None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:44.092033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2df187-24b6-4e6a-9f08-44f81eb74e2a None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:44.093418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 674/1318] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:42:44.099038 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b9e6e-e27b-4ab8-87ab-90de546b7781 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:44.099472 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b9e6e-e27b-4ab8-87ab-90de546b7781 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:44.099590 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b9e6e-e27b-4ab8-87ab-90de546b7781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:44.163113 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-3e2b9e6e-e27b-4ab8-87ab-90de546b7781 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:42:44.164320 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-3e2b9e6e-e27b-4ab8-87ab-90de546b7781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:44.259828 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 645/1319] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:42:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:42:44.299129 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2df187-24b6-4e6a-9f08-44f81eb74e2a None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:42:44.300639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-0d2df187-24b6-4e6a-9f08-44f81eb74e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:44.410521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2df187-24b6-4e6a-9f08-44f81eb74e2a None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:42:44.485877 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54ade5-6330-4fd7-9bdb-092135b44437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:42:44.486540 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54ade5-6330-4fd7-9bdb-092135b44437 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:44.486823 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54ade5-6330-4fd7-9bdb-092135b44437 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:44.487099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54ade5-6330-4fd7-9bdb-092135b44437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:44.488742 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-0d54ade5-6330-4fd7-9bdb-092135b44437 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:44.496349 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:42:44.597943 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54ade5-6330-4fd7-9bdb-092135b44437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:42:44.599388 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54ade5-6330-4fd7-9bdb-092135b44437 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:42:44.617309 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 675/1320] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:42:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:42:47.370130 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9f186-da83-4f99-8284-a17efe8b205e None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:47.370779 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9f186-da83-4f99-8284-a17efe8b205e None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:47.370779 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9f186-da83-4f99-8284-a17efe8b205e None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:47.372062 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 646/1321] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:42:47.377365 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4ca9f-1af3-4418-bbbb-e8c4a3eef39d None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:47.377844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4ca9f-1af3-4418-bbbb-e8c4a3eef39d None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:47.377979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4ca9f-1af3-4418-bbbb-e8c4a3eef39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:47.443795 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-c7e4ca9f-1af3-4418-bbbb-e8c4a3eef39d None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:42:47.445017 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-c7e4ca9f-1af3-4418-bbbb-e8c4a3eef39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:47.507611 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:42:47.557417 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 676/1322] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:42:47.610884 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f4ab9-0b9b-4f00-8a0d-a3d6183ce32d None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:47.611181 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f4ab9-0b9b-4f00-8a0d-a3d6183ce32d None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:47.611518 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3f4ab9-0b9b-4f00-8a0d-a3d6183ce32d None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:47.612898 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 647/1323] 10.222.0.15 () {54 vars in 964 bytes} [Thu Jun 23 15:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:42:47.619674 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e3d62-654e-4971-be26-a5ef93acb475 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:47.620054 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e3d62-654e-4971-be26-a5ef93acb475 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:47.620455 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e3d62-654e-4971-be26-a5ef93acb475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:47.701934 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-ee6e3d62-654e-4971-be26-a5ef93acb475 None None] MFA Rules not processed for user `44e9fc6def5341a589221350067bb0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:42:47.703140 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ee6e3d62-654e-4971-be26-a5ef93acb475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:47.779382 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 677/1324] 10.222.0.15 () {58 vars in 1061 bytes} [Thu Jun 23 15:42:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:42:47.788843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f4ab9-0b9b-4f00-8a0d-a3d6183ce32d None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:42:47.790394 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-4b3f4ab9-0b9b-4f00-8a0d-a3d6183ce32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:47.809097 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:42:47.895042 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3f4ab9-0b9b-4f00-8a0d-a3d6183ce32d None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:42:47.968967 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccee8a1-9879-4683-a437-bfe8e037d34e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:42:47.969616 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccee8a1-9879-4683-a437-bfe8e037d34e service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:47.969926 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccee8a1-9879-4683-a437-bfe8e037d34e service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:47.970218 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccee8a1-9879-4683-a437-bfe8e037d34e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:47.971845 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-3ccee8a1-9879-4683-a437-bfe8e037d34e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:48.042588 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:42:48.080845 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccee8a1-9879-4683-a437-bfe8e037d34e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:42:48.082332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccee8a1-9879-4683-a437-bfe8e037d34e service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:42:48.101555 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 648/1325] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:42:50.448816 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e8e6c-5b20-4c86-b42c-39eb3730d6c3 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:50.449372 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e8e6c-5b20-4c86-b42c-39eb3730d6c3 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:50.449372 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e8e6c-5b20-4c86-b42c-39eb3730d6c3 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:50.450946 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 678/1326] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:42:50.455950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b16435-f52f-4b2c-9d43-d97897246d36 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:50.456374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b16435-f52f-4b2c-9d43-d97897246d36 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:50.456519 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b16435-f52f-4b2c-9d43-d97897246d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:50.531165 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-46b16435-f52f-4b2c-9d43-d97897246d36 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:42:50.532664 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-46b16435-f52f-4b2c-9d43-d97897246d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:50.650470 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 649/1327] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:42:50.687110 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e8e6c-5b20-4c86-b42c-39eb3730d6c3 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:42:50.688706 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ea7e8e6c-5b20-4c86-b42c-39eb3730d6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:50.751659 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:42:50.803357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e8e6c-5b20-4c86-b42c-39eb3730d6c3 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:42:50.880397 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99bfac-b887-4e0e-ac69-c7f6b7bfcbb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:42:50.880883 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99bfac-b887-4e0e-ac69-c7f6b7bfcbb6 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:50.881168 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99bfac-b887-4e0e-ac69-c7f6b7bfcbb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:50.881445 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99bfac-b887-4e0e-ac69-c7f6b7bfcbb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:50.883484 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-3a99bfac-b887-4e0e-ac69-c7f6b7bfcbb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:50.994243 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:42:50.996916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99bfac-b887-4e0e-ac69-c7f6b7bfcbb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:42:50.998843 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99bfac-b887-4e0e-ac69-c7f6b7bfcbb6 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:42:51.017897 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 679/1328] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:42:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:42:53.114531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f9372-e8cf-4660-abee-601e33fefc49 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:53.114531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f9372-e8cf-4660-abee-601e33fefc49 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:53.114531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f9372-e8cf-4660-abee-601e33fefc49 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:53.115921 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 650/1329] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:42:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:42:53.121438 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65553f3b-bc7c-4fe8-a2ea-84a2fb848f47 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:53.121957 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65553f3b-bc7c-4fe8-a2ea-84a2fb848f47 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:53.122079 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65553f3b-bc7c-4fe8-a2ea-84a2fb848f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:53.188362 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-65553f3b-bc7c-4fe8-a2ea-84a2fb848f47 None None] MFA Rules not processed for user `7fe27f63d24a4cff85a9c0ae32b154cc`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:42:53.189558 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-65553f3b-bc7c-4fe8-a2ea-84a2fb848f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:53.312016 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 680/1330] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:42:53 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:42:53.351739 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f9372-e8cf-4660-abee-601e33fefc49 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:42:53.353292 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-d85f9372-e8cf-4660-abee-601e33fefc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:53.389159 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:42:53.463427 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f9372-e8cf-4660-abee-601e33fefc49 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:42:53.546560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca89d77-5224-40fe-ae8c-5fa43807ff13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:42:53.547147 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca89d77-5224-40fe-ae8c-5fa43807ff13 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:53.547437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca89d77-5224-40fe-ae8c-5fa43807ff13 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:53.547716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca89d77-5224-40fe-ae8c-5fa43807ff13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:53.549435 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-7ca89d77-5224-40fe-ae8c-5fa43807ff13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:53.634650 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:42:53.677087 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca89d77-5224-40fe-ae8c-5fa43807ff13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:42:53.678665 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca89d77-5224-40fe-ae8c-5fa43807ff13 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:42:53.699252 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 651/1331] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:42:53 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:42:56.027772 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d193f-b560-4c3e-a00e-bfa8d254b0c0 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:56.028315 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d193f-b560-4c3e-a00e-bfa8d254b0c0 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:56.028315 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d193f-b560-4c3e-a00e-bfa8d254b0c0 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:56.029710 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 681/1332] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:42:56.035161 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d083e6-c15d-4151-99e1-c4a70c4e1f79 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:56.035611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d083e6-c15d-4151-99e1-c4a70c4e1f79 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:56.035749 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d083e6-c15d-4151-99e1-c4a70c4e1f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:56.098499 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-55d083e6-c15d-4151-99e1-c4a70c4e1f79 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:42:56.099718 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-55d083e6-c15d-4151-99e1-c4a70c4e1f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:56.202892 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 652/1333] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:42:56.238077 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d193f-b560-4c3e-a00e-bfa8d254b0c0 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:42:56.240119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-948d193f-b560-4c3e-a00e-bfa8d254b0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:56.310970 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:42:56.347819 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d193f-b560-4c3e-a00e-bfa8d254b0c0 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:42:56.424331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f327f-d758-41a6-96f3-7ec8beda2795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:42:56.424971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f327f-d758-41a6-96f3-7ec8beda2795 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:56.425257 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f327f-d758-41a6-96f3-7ec8beda2795 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:56.425529 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f327f-d758-41a6-96f3-7ec8beda2795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:56.427711 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ef2f327f-d758-41a6-96f3-7ec8beda2795 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:56.541549 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f327f-d758-41a6-96f3-7ec8beda2795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:42:56.543038 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f327f-d758-41a6-96f3-7ec8beda2795 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:42:56.552883 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:42:56.562135 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 682/1334] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:42:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:42:58.673609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124aef73-7455-4f9b-8afe-839254a6adc6 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:58.674178 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124aef73-7455-4f9b-8afe-839254a6adc6 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:58.674178 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124aef73-7455-4f9b-8afe-839254a6adc6 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:58.675566 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 653/1335] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:42:58.681490 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5930d-edd8-4427-a487-aff67ea21e42 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:58.682018 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5930d-edd8-4427-a487-aff67ea21e42 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:58.682112 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5930d-edd8-4427-a487-aff67ea21e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:58.746295 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-e7e5930d-edd8-4427-a487-aff67ea21e42 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:42:58.747504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e7e5930d-edd8-4427-a487-aff67ea21e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:58.841937 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 683/1336] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:42:58.882598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124aef73-7455-4f9b-8afe-839254a6adc6 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:42:58.884125 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-124aef73-7455-4f9b-8afe-839254a6adc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:58.923554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:42:58.987348 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124aef73-7455-4f9b-8afe-839254a6adc6 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:42:59.059203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ff6217-7b1c-473c-8a04-7c2dc36436c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:42:59.059882 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff6217-7b1c-473c-8a04-7c2dc36436c2 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:42:59.060181 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff6217-7b1c-473c-8a04-7c2dc36436c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:42:59.060434 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ff6217-7b1c-473c-8a04-7c2dc36436c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:42:59.062108 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-38ff6217-7b1c-473c-8a04-7c2dc36436c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:42:59.149336 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:42:59.176025 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff6217-7b1c-473c-8a04-7c2dc36436c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:42:59.177548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ff6217-7b1c-473c-8a04-7c2dc36436c2 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:42:59.195523 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 654/1337] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:42:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:43:01.890053 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bc489-b881-467c-962e-ec99ae348d89 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:01.890576 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bc489-b881-467c-962e-ec99ae348d89 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:01.890576 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bc489-b881-467c-962e-ec99ae348d89 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:01.891892 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 684/1338] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:01.897192 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6de0f7-298b-4e0c-b223-8022e747caac None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:01.897618 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6de0f7-298b-4e0c-b223-8022e747caac None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:01.897806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6de0f7-298b-4e0c-b223-8022e747caac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:01.964374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-4a6de0f7-298b-4e0c-b223-8022e747caac None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:01.965685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-4a6de0f7-298b-4e0c-b223-8022e747caac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:02.059658 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 655/1339] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:43:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:43:02.097614 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bc489-b881-467c-962e-ec99ae348d89 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:43:02.099216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-dc9bc489-b881-467c-962e-ec99ae348d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:02.174057 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:43:02.204794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bc489-b881-467c-962e-ec99ae348d89 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:43:02.278184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064199f-ef21-4f1b-8575-a00e3ba02ed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:43:02.278854 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064199f-ef21-4f1b-8575-a00e3ba02ed2 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:02.279144 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064199f-ef21-4f1b-8575-a00e3ba02ed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:02.279417 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064199f-ef21-4f1b-8575-a00e3ba02ed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:02.281025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5064199f-ef21-4f1b-8575-a00e3ba02ed2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:02.391686 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064199f-ef21-4f1b-8575-a00e3ba02ed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:43:02.393131 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064199f-ef21-4f1b-8575-a00e3ba02ed2 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:43:02.412369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 685/1340] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:43:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:43:06.563235 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2246e-0ac0-4653-9189-458c6850f366 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:06.563701 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2246e-0ac0-4653-9189-458c6850f366 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:06.563835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2246e-0ac0-4653-9189-458c6850f366 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:06.565435 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 656/1341] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:06.571318 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6ed42-495d-486d-9251-8068ef98da53 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:06.571806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6ed42-495d-486d-9251-8068ef98da53 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:06.571887 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6ed42-495d-486d-9251-8068ef98da53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:06.578432 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:43:06.664282 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-9ab6ed42-495d-486d-9251-8068ef98da53 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:06.664282 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-9ab6ed42-495d-486d-9251-8068ef98da53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:06.789576 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 686/1342] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:43:06.827963 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2246e-0ac0-4653-9189-458c6850f366 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:43:06.830415 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-e1a2246e-0ac0-4653-9189-458c6850f366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:06.893148 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:43:06.944042 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2246e-0ac0-4653-9189-458c6850f366 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:43:06.949229 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf4daa-1ff5-45d4-85a6-e6df8e102f3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:43:06.950545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf4daa-1ff5-45d4-85a6-e6df8e102f3e service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:06.950545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf4daa-1ff5-45d4-85a6-e6df8e102f3e service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:06.950727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf4daa-1ff5-45d4-85a6-e6df8e102f3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:06.961156 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf4daa-1ff5-45d4-85a6-e6df8e102f3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:43:06.962639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf4daa-1ff5-45d4-85a6-e6df8e102f3e service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:43:06.978073 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 657/1343] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:43:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:43:09.692172 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688910ab-32c0-4ed2-b377-0af79c459519 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:09.692712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688910ab-32c0-4ed2-b377-0af79c459519 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:09.692712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688910ab-32c0-4ed2-b377-0af79c459519 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:09.694204 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 687/1344] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:09.699793 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3a39d-035d-4526-8d70-2ab21bc468af None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:09.700310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3a39d-035d-4526-8d70-2ab21bc468af None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:09.700406 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3a39d-035d-4526-8d70-2ab21bc468af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:09.729535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-f5e3a39d-035d-4526-8d70-2ab21bc468af None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:09.730763 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-f5e3a39d-035d-4526-8d70-2ab21bc468af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:09.812804 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 658/1345] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:43:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:43:09.858223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688910ab-32c0-4ed2-b377-0af79c459519 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:43:09.869656 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688910ab-32c0-4ed2-b377-0af79c459519 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:43:09.874443 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485fb8b-f928-4e6b-bb48-010ba843ff70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:43:09.875500 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485fb8b-f928-4e6b-bb48-010ba843ff70 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:09.876009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485fb8b-f928-4e6b-bb48-010ba843ff70 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:09.876462 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485fb8b-f928-4e6b-bb48-010ba843ff70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:09.887712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485fb8b-f928-4e6b-bb48-010ba843ff70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:43:09.889168 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2485fb8b-f928-4e6b-bb48-010ba843ff70 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:43:09.900602 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 688/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:43:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:43:13.953195 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab27884-7151-44bf-b487-5dad89890c56 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:13.953716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab27884-7151-44bf-b487-5dad89890c56 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:13.953831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab27884-7151-44bf-b487-5dad89890c56 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:13.955169 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 659/1347] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:13.961258 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decbc1f-8d92-4b2f-a672-0c66507dcd78 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:13.961687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decbc1f-8d92-4b2f-a672-0c66507dcd78 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:13.961970 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decbc1f-8d92-4b2f-a672-0c66507dcd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:13.980111 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-2decbc1f-8d92-4b2f-a672-0c66507dcd78 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:13.981335 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-2decbc1f-8d92-4b2f-a672-0c66507dcd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:13.989350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 689/1348] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:43:14.028066 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab27884-7151-44bf-b487-5dad89890c56 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:43:14.038920 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab27884-7151-44bf-b487-5dad89890c56 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:43:14.042408 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb818712-5df8-4924-842a-b35f711d0f83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:43:14.043049 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb818712-5df8-4924-842a-b35f711d0f83 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:14.043338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb818712-5df8-4924-842a-b35f711d0f83 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:14.043618 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb818712-5df8-4924-842a-b35f711d0f83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:14.052856 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb818712-5df8-4924-842a-b35f711d0f83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:43:14.054380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb818712-5df8-4924-842a-b35f711d0f83 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:43:14.063913 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 660/1349] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:43:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:43:19.079137 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb2cfd-bf07-4e17-b7d1-2273590aa966 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:19.079703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb2cfd-bf07-4e17-b7d1-2273590aa966 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:19.079954 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb2cfd-bf07-4e17-b7d1-2273590aa966 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:19.081830 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 690/1350] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jun 23 15:43:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:19.089211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0a8b0-e2f2-4e13-badf-aacb1e390152 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:19.089211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0a8b0-e2f2-4e13-badf-aacb1e390152 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:19.089211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0a8b0-e2f2-4e13-badf-aacb1e390152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:19.168445 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-06b0a8b0-e2f2-4e13-badf-aacb1e390152 None None] MFA Rules not processed for user `9300c3a803e94f9a93442f551fc9646f`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:19.169795 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-06b0a8b0-e2f2-4e13-badf-aacb1e390152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:19.214336 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:43:19.308916 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 661/1351] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jun 23 15:43:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:43:23.638250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf68d20-07bb-4247-82af-95bc0dc77110 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:23.639155 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf68d20-07bb-4247-82af-95bc0dc77110 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:23.639614 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf68d20-07bb-4247-82af-95bc0dc77110 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:23.641155 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 691/1352] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jun 23 15:43:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:23.646482 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30dbe4-acab-49eb-859f-46c518da57ce None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:23.646952 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30dbe4-acab-49eb-859f-46c518da57ce None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:23.647149 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30dbe4-acab-49eb-859f-46c518da57ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:23.668298 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-0a30dbe4-acab-49eb-859f-46c518da57ce None None] MFA Rules not processed for user `9300c3a803e94f9a93442f551fc9646f`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:23.669508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-0a30dbe4-acab-49eb-859f-46c518da57ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:23.678927 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 662/1353] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jun 23 15:43:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:43:23.974972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=72 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:43:25.286287 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb862ba-9fbe-43e5-8d7b-171c2e52bd3c None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:25.287304 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb862ba-9fbe-43e5-8d7b-171c2e52bd3c None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:25.287616 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb862ba-9fbe-43e5-8d7b-171c2e52bd3c None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:25.289029 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 692/1354] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jun 23 15:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:25.294185 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32688bb-b394-4d67-b41d-59b9c2b97055 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:25.294624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32688bb-b394-4d67-b41d-59b9c2b97055 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:25.294863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32688bb-b394-4d67-b41d-59b9c2b97055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:25.312758 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-e32688bb-b394-4d67-b41d-59b9c2b97055 None None] MFA Rules not processed for user `9300c3a803e94f9a93442f551fc9646f`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:25.314088 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-e32688bb-b394-4d67-b41d-59b9c2b97055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:25.323268 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 663/1355] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jun 23 15:43:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:43:28.905386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17056f29-cd4e-464a-a730-886cddd647da None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:28.906681 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17056f29-cd4e-464a-a730-886cddd647da None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:28.907186 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17056f29-cd4e-464a-a730-886cddd647da None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:28.913744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 693/1356] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:43:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:28.916111 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966a304-690a-4d75-a4f7-bb1e62db56b4 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:28.916978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966a304-690a-4d75-a4f7-bb1e62db56b4 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:28.917477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966a304-690a-4d75-a4f7-bb1e62db56b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:28.946207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-9966a304-690a-4d75-a4f7-bb1e62db56b4 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:28.947771 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-9966a304-690a-4d75-a4f7-bb1e62db56b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:28.957977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 664/1357] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:43:29.018851 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f57e6-82a2-4c22-8f3e-3336d0761bdd None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:29.019766 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f57e6-82a2-4c22-8f3e-3336d0761bdd None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:29.020200 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f57e6-82a2-4c22-8f3e-3336d0761bdd None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:29.023293 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 694/1358] 10.222.0.15 () {54 vars in 961 bytes} [Thu Jun 23 15:43:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:29.031688 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e822cee-d412-40f2-92ac-881bfaa51b5f None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:29.032071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e822cee-d412-40f2-92ac-881bfaa51b5f None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:29.032260 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e822cee-d412-40f2-92ac-881bfaa51b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:29.085365 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-1e822cee-d412-40f2-92ac-881bfaa51b5f None None] MFA Rules not processed for user `d54521ea1dca44c98d6723d0b9fd6468`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:29.086632 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-1e822cee-d412-40f2-92ac-881bfaa51b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:29.174185 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 665/1359] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Jun 23 15:43:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:43:29.182710 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f57e6-82a2-4c22-8f3e-3336d0761bdd None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:43:29.200415 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f57e6-82a2-4c22-8f3e-3336d0761bdd None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:43:29.207837 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c395ba-9a4f-4dca-96a5-caa11a521832 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:43:29.209023 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c395ba-9a4f-4dca-96a5-caa11a521832 service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:29.209417 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c395ba-9a4f-4dca-96a5-caa11a521832 service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:29.209800 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c395ba-9a4f-4dca-96a5-caa11a521832 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:29.220424 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c395ba-9a4f-4dca-96a5-caa11a521832 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:43:29.222199 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c395ba-9a4f-4dca-96a5-caa11a521832 service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:43:29.235434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 695/1360] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:43:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:43:31.496308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45cbfb-c8b9-45e2-a8c9-f06ddf05810d None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:31.496802 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45cbfb-c8b9-45e2-a8c9-f06ddf05810d None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:31.496897 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45cbfb-c8b9-45e2-a8c9-f06ddf05810d None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:31.498275 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 666/1361] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:31.504373 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab9f00-b64d-42e7-b9c3-27ef6c781f21 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:31.504853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab9f00-b64d-42e7-b9c3-27ef6c781f21 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:31.504952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab9f00-b64d-42e7-b9c3-27ef6c781f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:31.523431 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-05ab9f00-b64d-42e7-b9c3-27ef6c781f21 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:31.524650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-05ab9f00-b64d-42e7-b9c3-27ef6c781f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:31.537140 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 696/1362] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:43:31.578573 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45cbfb-c8b9-45e2-a8c9-f06ddf05810d None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:43:31.593718 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45cbfb-c8b9-45e2-a8c9-f06ddf05810d None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:43:31.599344 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90dca1e-0586-49dc-bd2c-6504778175dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:43:31.599996 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dca1e-0586-49dc-bd2c-6504778175dc service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:31.600285 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dca1e-0586-49dc-bd2c-6504778175dc service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:31.600566 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dca1e-0586-49dc-bd2c-6504778175dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:31.609732 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90dca1e-0586-49dc-bd2c-6504778175dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:43:31.611362 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90dca1e-0586-49dc-bd2c-6504778175dc service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:43:31.622478 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 667/1363] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:43:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:43:34.033831 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6230722-c830-40da-8ee0-843c96a88f53 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:34.034336 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6230722-c830-40da-8ee0-843c96a88f53 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:34.034524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6230722-c830-40da-8ee0-843c96a88f53 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:34.036547 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 697/1364] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:43:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:34.041754 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d18b8-9ac5-4dbe-a1e7-142b393d0b55 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:34.042211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d18b8-9ac5-4dbe-a1e7-142b393d0b55 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:34.042364 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d18b8-9ac5-4dbe-a1e7-142b393d0b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:34.062365 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-226d18b8-9ac5-4dbe-a1e7-142b393d0b55 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:34.063576 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-226d18b8-9ac5-4dbe-a1e7-142b393d0b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:34.072537 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 668/1365] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:43:34.123414 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b9a90-9218-4b87-8680-09ef11b29547 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:34.123630 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b9a90-9218-4b87-8680-09ef11b29547 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:34.124116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b9a90-9218-4b87-8680-09ef11b29547 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:34.125543 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 698/1366] 10.222.0.15 () {54 vars in 961 bytes} [Thu Jun 23 15:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:34.144836 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f49829-a913-46f5-b211-801ca490de5f None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:34.145479 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f49829-a913-46f5-b211-801ca490de5f None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:34.145838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f49829-a913-46f5-b211-801ca490de5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:34.167418 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-f5f49829-a913-46f5-b211-801ca490de5f None None] MFA Rules not processed for user `d54521ea1dca44c98d6723d0b9fd6468`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:34.168746 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-f5f49829-a913-46f5-b211-801ca490de5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:34.178114 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 669/1367] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Jun 23 15:43:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:43:34.186101 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b9a90-9218-4b87-8680-09ef11b29547 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:43:34.201879 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b9a90-9218-4b87-8680-09ef11b29547 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:43:34.207995 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be5393-ca44-44f5-87bf-f84a3403eafb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:43:34.208631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be5393-ca44-44f5-87bf-f84a3403eafb service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:34.208914 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be5393-ca44-44f5-87bf-f84a3403eafb service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:34.209189 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be5393-ca44-44f5-87bf-f84a3403eafb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:34.217539 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be5393-ca44-44f5-87bf-f84a3403eafb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:43:34.219166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be5393-ca44-44f5-87bf-f84a3403eafb service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:43:34.228606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 699/1368] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:43:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:43:36.381193 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c975c-314a-4c1d-9481-47bd3d2cf74b None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:36.381734 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c975c-314a-4c1d-9481-47bd3d2cf74b None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:36.381734 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102c975c-314a-4c1d-9481-47bd3d2cf74b None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:36.383613 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 670/1369] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:36.388908 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef46ba-83b7-4f1b-abdb-02d19c9e77de None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:36.389893 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef46ba-83b7-4f1b-abdb-02d19c9e77de None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:36.390354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef46ba-83b7-4f1b-abdb-02d19c9e77de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:36.412997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-89ef46ba-83b7-4f1b-abdb-02d19c9e77de None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:36.414425 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-89ef46ba-83b7-4f1b-abdb-02d19c9e77de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:36.423295 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 700/1370] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:43:36.469333 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c975c-314a-4c1d-9481-47bd3d2cf74b None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:43:36.484150 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102c975c-314a-4c1d-9481-47bd3d2cf74b None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:43:36.489661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aea5e7-b4c2-45c4-9250-a8a8aa15e372 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:43:36.490328 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aea5e7-b4c2-45c4-9250-a8a8aa15e372 service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:36.490611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aea5e7-b4c2-45c4-9250-a8a8aa15e372 service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:36.490998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aea5e7-b4c2-45c4-9250-a8a8aa15e372 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:36.499461 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aea5e7-b4c2-45c4-9250-a8a8aa15e372 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:43:36.501059 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aea5e7-b4c2-45c4-9250-a8a8aa15e372 service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:43:36.511971 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 671/1371] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:43:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:43:37.135993 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934218b-ec75-4b1c-953b-7985da0e33c8 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:37.136694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934218b-ec75-4b1c-953b-7985da0e33c8 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:37.137093 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a934218b-ec75-4b1c-953b-7985da0e33c8 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:37.138639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 701/1372] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:43:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:37.143880 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a12e71-bdcb-4b5e-a241-8d140c98e0af None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:37.144743 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a12e71-bdcb-4b5e-a241-8d140c98e0af None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:37.145024 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a12e71-bdcb-4b5e-a241-8d140c98e0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:37.163200 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-b8a12e71-bdcb-4b5e-a241-8d140c98e0af None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:37.164388 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-b8a12e71-bdcb-4b5e-a241-8d140c98e0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:37.172350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 672/1373] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:43:37.512051 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cd700-778d-4fd7-b8e1-e5857cb10add None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:37.512818 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cd700-778d-4fd7-b8e1-e5857cb10add None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:37.512818 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261cd700-778d-4fd7-b8e1-e5857cb10add None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:37.514590 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 702/1374] 10.222.0.15 () {54 vars in 963 bytes} [Thu Jun 23 15:43:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:37.520262 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f37ce-50f0-4966-96b4-5e8c70673df2 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:37.520824 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f37ce-50f0-4966-96b4-5e8c70673df2 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:37.521012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732f37ce-50f0-4966-96b4-5e8c70673df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:37.529062 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:43:37.594441 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-732f37ce-50f0-4966-96b4-5e8c70673df2 None None] MFA Rules not processed for user `b524afb3b4b24025ad8bef85aa64bd91`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:37.596199 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-732f37ce-50f0-4966-96b4-5e8c70673df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:37.671456 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 673/1375] 10.222.0.15 () {58 vars in 1060 bytes} [Thu Jun 23 15:43:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:43:37.679267 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cd700-778d-4fd7-b8e1-e5857cb10add None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:43:37.694554 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261cd700-778d-4fd7-b8e1-e5857cb10add None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:43:37.698630 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980dc0e-0d6a-4110-b8c0-6dce9bf6c53a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:43:37.701333 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980dc0e-0d6a-4110-b8c0-6dce9bf6c53a service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:37.702009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980dc0e-0d6a-4110-b8c0-6dce9bf6c53a service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:37.702438 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980dc0e-0d6a-4110-b8c0-6dce9bf6c53a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:37.713902 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980dc0e-0d6a-4110-b8c0-6dce9bf6c53a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:43:37.715765 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980dc0e-0d6a-4110-b8c0-6dce9bf6c53a service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:43:37.740574 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 703/1376] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:43:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:43:38.687166 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e077b1c-0999-46cb-8c51-011c3af69052 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:38.687672 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e077b1c-0999-46cb-8c51-011c3af69052 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:38.687672 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e077b1c-0999-46cb-8c51-011c3af69052 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:38.689083 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 674/1377] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:38.694326 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd450f1-3456-4d7c-86de-7078c529e539 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:38.694745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd450f1-3456-4d7c-86de-7078c529e539 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:38.694971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd450f1-3456-4d7c-86de-7078c529e539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:38.713382 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-0cd450f1-3456-4d7c-86de-7078c529e539 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:38.714632 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-0cd450f1-3456-4d7c-86de-7078c529e539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:38.723065 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 704/1378] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:43:38.768045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e077b1c-0999-46cb-8c51-011c3af69052 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:43:38.782868 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e077b1c-0999-46cb-8c51-011c3af69052 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:43:38.788808 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e254e-caa5-462f-91f9-b821f3d18907 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:43:38.789492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e254e-caa5-462f-91f9-b821f3d18907 service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:38.789760 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e254e-caa5-462f-91f9-b821f3d18907 service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:38.790070 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e254e-caa5-462f-91f9-b821f3d18907 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:38.798485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e254e-caa5-462f-91f9-b821f3d18907 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:43:38.800064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e254e-caa5-462f-91f9-b821f3d18907 service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:43:38.810139 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 675/1379] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:43:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:43:40.886590 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00d039-0ac1-4183-813c-6c86f33db4e8 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:40.887107 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00d039-0ac1-4183-813c-6c86f33db4e8 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:40.887207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00d039-0ac1-4183-813c-6c86f33db4e8 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:40.888598 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 705/1380] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:40.894919 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c333fa6-a18b-484b-a17f-42b959feb698 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:40.895379 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c333fa6-a18b-484b-a17f-42b959feb698 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:40.895526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c333fa6-a18b-484b-a17f-42b959feb698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:40.914785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-2c333fa6-a18b-484b-a17f-42b959feb698 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:40.916102 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-2c333fa6-a18b-484b-a17f-42b959feb698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:40.924034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 676/1381] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:43:40.969149 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00d039-0ac1-4183-813c-6c86f33db4e8 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:43:40.983527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00d039-0ac1-4183-813c-6c86f33db4e8 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:43:40.989016 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814a0d8-d27f-4e76-bb7a-7ab17ae33264 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:43:40.989662 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814a0d8-d27f-4e76-bb7a-7ab17ae33264 service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:40.989987 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814a0d8-d27f-4e76-bb7a-7ab17ae33264 service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:40.990270 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814a0d8-d27f-4e76-bb7a-7ab17ae33264 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:40.998994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814a0d8-d27f-4e76-bb7a-7ab17ae33264 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:43:41.000577 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814a0d8-d27f-4e76-bb7a-7ab17ae33264 service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:43:41.010946 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 706/1382] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:43:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:43:43.128745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67f2a8-34de-4a7f-81d7-6c3faf8224d6 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:43.129301 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67f2a8-34de-4a7f-81d7-6c3faf8224d6 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:43.129301 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67f2a8-34de-4a7f-81d7-6c3faf8224d6 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:43.130696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 677/1383] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:43.136457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f501f18-9226-4824-94e3-9d14574ffcd2 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:43.136913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f501f18-9226-4824-94e3-9d14574ffcd2 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:43.137131 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f501f18-9226-4824-94e3-9d14574ffcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:43.155962 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-9f501f18-9226-4824-94e3-9d14574ffcd2 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:43.157664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-9f501f18-9226-4824-94e3-9d14574ffcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:43.166478 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 707/1384] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:43:43.210210 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67f2a8-34de-4a7f-81d7-6c3faf8224d6 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:43:43.226145 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67f2a8-34de-4a7f-81d7-6c3faf8224d6 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:43:43.231940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955337b8-a6c7-4cb6-9a92-656dbb328930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:43:43.232593 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955337b8-a6c7-4cb6-9a92-656dbb328930 service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:43.232889 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955337b8-a6c7-4cb6-9a92-656dbb328930 service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:43.233168 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955337b8-a6c7-4cb6-9a92-656dbb328930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:43.242960 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955337b8-a6c7-4cb6-9a92-656dbb328930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:43:43.244551 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955337b8-a6c7-4cb6-9a92-656dbb328930 service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:43:43.255332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 678/1385] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:43:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:43:45.311501 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7156c6d-be49-43d0-8460-be9bd4787d9d None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:45.312005 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7156c6d-be49-43d0-8460-be9bd4787d9d None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:45.312005 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7156c6d-be49-43d0-8460-be9bd4787d9d None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:45.313361 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 708/1386] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:45.318838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bcd77-a9ce-4cce-9f51-351194cb5dd1 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:45.319291 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bcd77-a9ce-4cce-9f51-351194cb5dd1 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:45.319384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bcd77-a9ce-4cce-9f51-351194cb5dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:45.341899 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-cb4bcd77-a9ce-4cce-9f51-351194cb5dd1 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:45.343146 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-cb4bcd77-a9ce-4cce-9f51-351194cb5dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:45.351821 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 679/1387] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:43:45.396379 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7156c6d-be49-43d0-8460-be9bd4787d9d None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:43:45.413170 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7156c6d-be49-43d0-8460-be9bd4787d9d None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:43:45.420455 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992226f-24c5-4c9c-89c7-eb7459212f8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:43:45.421334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992226f-24c5-4c9c-89c7-eb7459212f8b service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:45.421667 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992226f-24c5-4c9c-89c7-eb7459212f8b service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:45.422121 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992226f-24c5-4c9c-89c7-eb7459212f8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:45.435045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992226f-24c5-4c9c-89c7-eb7459212f8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:43:45.437354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992226f-24c5-4c9c-89c7-eb7459212f8b service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:43:45.453271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 709/1388] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:43:48.137087 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d772fb8-b20a-4064-ba7e-878f2b2e62ef None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:48.137635 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d772fb8-b20a-4064-ba7e-878f2b2e62ef None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:48.137635 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d772fb8-b20a-4064-ba7e-878f2b2e62ef None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:48.139038 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 680/1389] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:48.145674 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a7a4f-10b9-40b3-856c-04a7d72f0896 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:48.146229 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a7a4f-10b9-40b3-856c-04a7d72f0896 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:48.146506 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a7a4f-10b9-40b3-856c-04a7d72f0896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:48.171804 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-375a7a4f-10b9-40b3-856c-04a7d72f0896 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:48.173543 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-375a7a4f-10b9-40b3-856c-04a7d72f0896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:48.185442 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 710/1390] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:43:48.236372 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d772fb8-b20a-4064-ba7e-878f2b2e62ef None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:43:48.260324 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d772fb8-b20a-4064-ba7e-878f2b2e62ef None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:43:48.265584 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35237d7f-ca8c-41d9-b5ac-f1adafff5699 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:43:48.266269 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35237d7f-ca8c-41d9-b5ac-f1adafff5699 service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:48.266554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35237d7f-ca8c-41d9-b5ac-f1adafff5699 service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:48.266836 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35237d7f-ca8c-41d9-b5ac-f1adafff5699 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:48.277361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35237d7f-ca8c-41d9-b5ac-f1adafff5699 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:43:48.278988 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35237d7f-ca8c-41d9-b5ac-f1adafff5699 service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:43:48.293376 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 681/1391] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:43:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:43:50.425352 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452e05f-52b8-435c-affc-e105a67cf769 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:50.426165 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452e05f-52b8-435c-affc-e105a67cf769 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:50.426273 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452e05f-52b8-435c-affc-e105a67cf769 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:50.428308 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 711/1392] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:43:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:50.434293 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d78897-8514-44f1-b31c-8cc8edccdbc4 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:50.434940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d78897-8514-44f1-b31c-8cc8edccdbc4 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:50.434940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d78897-8514-44f1-b31c-8cc8edccdbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:50.458122 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-96d78897-8514-44f1-b31c-8cc8edccdbc4 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:50.459336 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-96d78897-8514-44f1-b31c-8cc8edccdbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:50.469139 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 682/1393] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:43:50.535595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452e05f-52b8-435c-affc-e105a67cf769 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:43:50.560411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452e05f-52b8-435c-affc-e105a67cf769 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:43:50.569645 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac2cac-4fc9-4be8-9167-c7ecf4257531 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:43:50.570536 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac2cac-4fc9-4be8-9167-c7ecf4257531 service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:50.570981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac2cac-4fc9-4be8-9167-c7ecf4257531 service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:50.571370 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac2cac-4fc9-4be8-9167-c7ecf4257531 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:50.584528 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac2cac-4fc9-4be8-9167-c7ecf4257531 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:43:50.586173 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac2cac-4fc9-4be8-9167-c7ecf4257531 service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:43:50.596975 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 712/1394] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:43:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:43:52.761423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24c152-36dd-4d02-b48d-e71731e88719 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:52.762014 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24c152-36dd-4d02-b48d-e71731e88719 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:52.762014 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24c152-36dd-4d02-b48d-e71731e88719 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:52.763403 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 683/1395] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:52.769327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725bf46-37c6-4e62-a2c1-0bd67fe561a6 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:52.769890 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725bf46-37c6-4e62-a2c1-0bd67fe561a6 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:52.770012 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725bf46-37c6-4e62-a2c1-0bd67fe561a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:52.789535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-f725bf46-37c6-4e62-a2c1-0bd67fe561a6 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:52.790772 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-f725bf46-37c6-4e62-a2c1-0bd67fe561a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:52.798667 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 713/1396] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:43:52.843727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24c152-36dd-4d02-b48d-e71731e88719 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:43:52.858325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24c152-36dd-4d02-b48d-e71731e88719 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:43:52.863908 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51545ce0-4a06-4b19-b0c3-385cb321d78c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:43:52.864576 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51545ce0-4a06-4b19-b0c3-385cb321d78c service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:52.864861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51545ce0-4a06-4b19-b0c3-385cb321d78c service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:52.865138 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51545ce0-4a06-4b19-b0c3-385cb321d78c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:52.874025 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51545ce0-4a06-4b19-b0c3-385cb321d78c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:43:52.875600 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51545ce0-4a06-4b19-b0c3-385cb321d78c service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:43:52.885878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 684/1397] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:43:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:43:52.969008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caeebec-6e01-4dcc-9910-5ba8c5dbcd50 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:52.969306 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caeebec-6e01-4dcc-9910-5ba8c5dbcd50 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:52.969595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caeebec-6e01-4dcc-9910-5ba8c5dbcd50 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:52.971097 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 714/1398] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:52.977411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0393aa-bccb-4c7e-bf83-9c197ef42b6f None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:52.977705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0393aa-bccb-4c7e-bf83-9c197ef42b6f None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:52.978025 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0393aa-bccb-4c7e-bf83-9c197ef42b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:52.997012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-7d0393aa-bccb-4c7e-bf83-9c197ef42b6f None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:52.998305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-7d0393aa-bccb-4c7e-bf83-9c197ef42b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:53.007422 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 685/1399] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:43:53.066465 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440860c-a64e-44c4-a51b-062857f88037 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:53.066753 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440860c-a64e-44c4-a51b-062857f88037 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:53.067036 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440860c-a64e-44c4-a51b-062857f88037 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:53.068459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 715/1400] 10.222.0.15 () {54 vars in 962 bytes} [Thu Jun 23 15:43:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:53.074189 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891fc27-77ef-40ec-8f23-0842fd692c62 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:53.074486 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891fc27-77ef-40ec-8f23-0842fd692c62 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:53.074772 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891fc27-77ef-40ec-8f23-0842fd692c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:53.127805 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-c891fc27-77ef-40ec-8f23-0842fd692c62 None None] MFA Rules not processed for user `79239c95306c43f0a1a0b51715440009`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:53.129485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-c891fc27-77ef-40ec-8f23-0842fd692c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:53.163595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:43:53.195832 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 686/1401] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Jun 23 15:43:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:43:53.203941 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440860c-a64e-44c4-a51b-062857f88037 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:43:53.215889 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440860c-a64e-44c4-a51b-062857f88037 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:43:53.219457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9f5cb-a49a-4ba0-9ab0-385f10f719c3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79239c95306c43f0a1a0b51715440009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:43:53.220192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9f5cb-a49a-4ba0-9ab0-385f10f719c3 service glance] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:53.220536 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9f5cb-a49a-4ba0-9ab0-385f10f719c3 service glance] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:53.220904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9f5cb-a49a-4ba0-9ab0-385f10f719c3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:53.230623 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9f5cb-a49a-4ba0-9ab0-385f10f719c3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:43:53.232055 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9f5cb-a49a-4ba0-9ab0-385f10f719c3 service glance] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:43:53.244215 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 716/1402] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:43:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:43:53.968230 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a29c4-f898-4777-a7a5-160a78b0cbcc None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:53.969008 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a29c4-f898-4777-a7a5-160a78b0cbcc None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:53.969008 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a29c4-f898-4777-a7a5-160a78b0cbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:54.019784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-4c6a29c4-f898-4777-a7a5-160a78b0cbcc None None] MFA Rules not processed for user `dbf2c12174e94e2db9be178973183ced`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:54.020975 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-4c6a29c4-f898-4777-a7a5-160a78b0cbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:54.090837 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 687/1403] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 23 15:43:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:43:54.138800 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1975b-df80-417f-92c0-ccbebc40e1fc None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:54.139353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1975b-df80-417f-92c0-ccbebc40e1fc None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:54.139353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1975b-df80-417f-92c0-ccbebc40e1fc None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:54.140760 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 717/1404] 10.222.0.15 () {54 vars in 942 bytes} [Thu Jun 23 15:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:54.147973 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f03220-502b-49a5-9955-a7e211fb1e10 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:54.148267 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f03220-502b-49a5-9955-a7e211fb1e10 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:54.148576 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f03220-502b-49a5-9955-a7e211fb1e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:54.210589 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-42f03220-502b-49a5-9955-a7e211fb1e10 None None] MFA Rules not processed for user `5824ee17e276483faf20db88a93545f3`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:54.211714 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-42f03220-502b-49a5-9955-a7e211fb1e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:54.293402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 688/1405] 10.222.0.15 () {58 vars in 1039 bytes} [Thu Jun 23 15:43:54 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:43:54.302893 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1975b-df80-417f-92c0-ccbebc40e1fc None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:43:54.310642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=61 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:43:54.319708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1975b-df80-417f-92c0-ccbebc40e1fc None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:43:54.325432 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825077b-65a4-404e-80b0-ea5cc548a49e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5824ee17e276483faf20db88a93545f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:43:54.326111 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825077b-65a4-404e-80b0-ea5cc548a49e service swift] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:54.326398 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825077b-65a4-404e-80b0-ea5cc548a49e service swift] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:54.326678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825077b-65a4-404e-80b0-ea5cc548a49e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:54.338810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825077b-65a4-404e-80b0-ea5cc548a49e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:43:54.340416 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825077b-65a4-404e-80b0-ea5cc548a49e service swift] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:43:54.348986 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 718/1406] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 23 15:43:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 15:43:55.010098 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b35c5-0240-47eb-b205-7bf22fc2f9d6 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:55.010665 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b35c5-0240-47eb-b205-7bf22fc2f9d6 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:55.010665 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b35c5-0240-47eb-b205-7bf22fc2f9d6 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:55.012179 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 689/1407] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:43:55.017528 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6634c-f774-4ab1-9092-5987bc1ec4eb None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:55.017826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6634c-f774-4ab1-9092-5987bc1ec4eb None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:55.018137 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6634c-f774-4ab1-9092-5987bc1ec4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:55.037434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-d4d6634c-f774-4ab1-9092-5987bc1ec4eb None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:43:55.038720 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-d4d6634c-f774-4ab1-9092-5987bc1ec4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:43:55.048614 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 719/1408] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:43:55.094753 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b35c5-0240-47eb-b205-7bf22fc2f9d6 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:43:55.111823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b35c5-0240-47eb-b205-7bf22fc2f9d6 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:43:55.122129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c632c-d027-4f27-b1a5-c9471dee4072 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:43:55.122966 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c632c-d027-4f27-b1a5-c9471dee4072 service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:43:55.123360 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c632c-d027-4f27-b1a5-c9471dee4072 service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:43:55.123738 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c632c-d027-4f27-b1a5-c9471dee4072 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:43:55.133408 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c632c-d027-4f27-b1a5-c9471dee4072 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:43:55.135274 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297c632c-d027-4f27-b1a5-c9471dee4072 service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:43:55.141519 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:43:55.147574 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 690/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:43:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:44:05.031310 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=8 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:44:16.550604 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db460785-6a80-4369-ae69-831109fafe3d None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:16.551656 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db460785-6a80-4369-ae69-831109fafe3d None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:16.551656 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db460785-6a80-4369-ae69-831109fafe3d None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:16.552936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 720/1410] 10.222.0.15 () {54 vars in 918 bytes} [Thu Jun 23 15:44:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:44:16.558711 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e131c82-9674-4d2f-9b35-ac1440645c3b None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:16.559192 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e131c82-9674-4d2f-9b35-ac1440645c3b None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:16.559298 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e131c82-9674-4d2f-9b35-ac1440645c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:16.578045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-1e131c82-9674-4d2f-9b35-ac1440645c3b None None] MFA Rules not processed for user `9300c3a803e94f9a93442f551fc9646f`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:44:16.579248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-1e131c82-9674-4d2f-9b35-ac1440645c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:44:16.588251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 691/1411] 10.222.0.15 () {58 vars in 1015 bytes} [Thu Jun 23 15:44:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:44:16.602167 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698f415-4417-4ff7-ab2a-b0a89adf108f None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:16.602463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698f415-4417-4ff7-ab2a-b0a89adf108f None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:16.602777 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698f415-4417-4ff7-ab2a-b0a89adf108f None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:16.604141 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 721/1412] 10.222.0.15 () {54 vars in 918 bytes} [Thu Jun 23 15:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:44:16.608477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107a875-acf2-454c-b290-1d793cc07d6a None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:16.608765 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107a875-acf2-454c-b290-1d793cc07d6a None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:16.609044 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107a875-acf2-454c-b290-1d793cc07d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:16.626897 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-4107a875-acf2-454c-b290-1d793cc07d6a None None] MFA Rules not processed for user `d54521ea1dca44c98d6723d0b9fd6468`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:44:16.628683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-4107a875-acf2-454c-b290-1d793cc07d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:44:16.637616 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 692/1413] 10.222.0.15 () {58 vars in 1015 bytes} [Thu Jun 23 15:44:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:44:19.145144 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef504e0-f495-4269-bbca-0db16e9769ab None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:19.145708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef504e0-f495-4269-bbca-0db16e9769ab None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:19.145708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef504e0-f495-4269-bbca-0db16e9769ab None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:19.147132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 722/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 15:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:44:19.152244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeca71-d584-4219-a47e-b89edb55279f None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:19.152673 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeca71-d584-4219-a47e-b89edb55279f None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:19.152783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaeca71-d584-4219-a47e-b89edb55279f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:19.170733 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-5eaeca71-d584-4219-a47e-b89edb55279f None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:44:19.171906 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-5eaeca71-d584-4219-a47e-b89edb55279f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:44:19.180578 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 693/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 15:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:44:19.224316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef504e0-f495-4269-bbca-0db16e9769ab None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:44:19.239846 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef504e0-f495-4269-bbca-0db16e9769ab None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:44:19.245348 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb412c-b5d5-49c3-a41d-c9da5689aa5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:44:19.246020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb412c-b5d5-49c3-a41d-c9da5689aa5b service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:19.246310 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb412c-b5d5-49c3-a41d-c9da5689aa5b service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:19.246590 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb412c-b5d5-49c3-a41d-c9da5689aa5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:19.254690 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb412c-b5d5-49c3-a41d-c9da5689aa5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:44:19.256249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb412c-b5d5-49c3-a41d-c9da5689aa5b service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:44:19.265998 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 723/1416] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:44:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:44:20.154745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f38f16-8b28-44ae-a8e5-baf5a6a83141 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:20.155317 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f38f16-8b28-44ae-a8e5-baf5a6a83141 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:20.155317 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f38f16-8b28-44ae-a8e5-baf5a6a83141 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:20.156952 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 694/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 15:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:44:20.161814 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b4394-0a1e-4c40-a9d5-b8840d3b106b None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:20.162240 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b4394-0a1e-4c40-a9d5-b8840d3b106b None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:20.162421 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b4394-0a1e-4c40-a9d5-b8840d3b106b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:20.181024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-ec2b4394-0a1e-4c40-a9d5-b8840d3b106b None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:44:20.182238 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ec2b4394-0a1e-4c40-a9d5-b8840d3b106b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:44:20.190673 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 724/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 15:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:44:20.339458 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f38f16-8b28-44ae-a8e5-baf5a6a83141 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:44:20.353639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f38f16-8b28-44ae-a8e5-baf5a6a83141 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:44:20.359005 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e37388-95bd-4639-9201-054b3574edb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:44:20.359634 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e37388-95bd-4639-9201-054b3574edb4 service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:20.359917 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e37388-95bd-4639-9201-054b3574edb4 service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:20.360194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e37388-95bd-4639-9201-054b3574edb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:20.368937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e37388-95bd-4639-9201-054b3574edb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:44:20.370576 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e37388-95bd-4639-9201-054b3574edb4 service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:44:20.381061 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 695/1419] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:44:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:44:21.251986 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8540c-5b42-43af-a792-83785be5bab9 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:21.252571 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8540c-5b42-43af-a792-83785be5bab9 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:21.252571 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8540c-5b42-43af-a792-83785be5bab9 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:21.253938 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 725/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 15:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:44:21.258974 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed6214-a1ed-448b-87c8-9258049b8707 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:21.259373 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed6214-a1ed-448b-87c8-9258049b8707 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:21.259540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed6214-a1ed-448b-87c8-9258049b8707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:21.277743 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-29ed6214-a1ed-448b-87c8-9258049b8707 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:44:21.279047 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-29ed6214-a1ed-448b-87c8-9258049b8707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:44:21.287766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 696/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 15:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:44:21.440601 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8540c-5b42-43af-a792-83785be5bab9 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:44:21.454629 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8540c-5b42-43af-a792-83785be5bab9 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:44:21.460409 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87d623-7554-4e90-b284-d78889ef92f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:44:21.461038 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87d623-7554-4e90-b284-d78889ef92f4 service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:21.461315 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87d623-7554-4e90-b284-d78889ef92f4 service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:21.461584 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87d623-7554-4e90-b284-d78889ef92f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:21.469405 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87d623-7554-4e90-b284-d78889ef92f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:44:21.470999 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87d623-7554-4e90-b284-d78889ef92f4 service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:44:21.480068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 726/1422] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:44:22.354830 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ed8f5-9e67-4ca9-81d4-2cd3e6061525 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:22.355373 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ed8f5-9e67-4ca9-81d4-2cd3e6061525 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:22.355373 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ed8f5-9e67-4ca9-81d4-2cd3e6061525 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:22.356767 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 697/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 15:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:44:22.361667 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780bf53-6619-4743-b9ae-c8c1b1efc9a0 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:22.362114 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780bf53-6619-4743-b9ae-c8c1b1efc9a0 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:22.362870 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780bf53-6619-4743-b9ae-c8c1b1efc9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:22.380524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-c780bf53-6619-4743-b9ae-c8c1b1efc9a0 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:44:22.381712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-c780bf53-6619-4743-b9ae-c8c1b1efc9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:44:22.389457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 727/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 15:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:44:22.538603 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ed8f5-9e67-4ca9-81d4-2cd3e6061525 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:44:22.553318 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ed8f5-9e67-4ca9-81d4-2cd3e6061525 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:44:22.558858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00642e5d-81c3-44a5-8730-73b47327ad1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:44:22.559488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00642e5d-81c3-44a5-8730-73b47327ad1e service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:22.559766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00642e5d-81c3-44a5-8730-73b47327ad1e service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:22.560041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00642e5d-81c3-44a5-8730-73b47327ad1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:22.568286 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00642e5d-81c3-44a5-8730-73b47327ad1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:44:22.569865 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00642e5d-81c3-44a5-8730-73b47327ad1e service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:44:22.579084 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 698/1425] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:44:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:44:23.435566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e0794-2581-40d7-9781-c215c41933ef None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:23.436260 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e0794-2581-40d7-9781-c215c41933ef None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:23.436260 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e0794-2581-40d7-9781-c215c41933ef None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:23.437481 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 728/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 15:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:44:23.442957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf9e87-902a-4466-b420-48be118af493 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:23.443372 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf9e87-902a-4466-b420-48be118af493 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:23.443513 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf9e87-902a-4466-b420-48be118af493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:23.460922 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-61bf9e87-902a-4466-b420-48be118af493 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:44:23.462133 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-61bf9e87-902a-4466-b420-48be118af493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:44:23.469721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 699/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 15:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:44:23.618597 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e0794-2581-40d7-9781-c215c41933ef None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:44:23.632494 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e0794-2581-40d7-9781-c215c41933ef None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:44:23.638112 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3647b-01ef-416f-b418-d08c4db0d42f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:44:23.638758 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3647b-01ef-416f-b418-d08c4db0d42f service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:23.639043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3647b-01ef-416f-b418-d08c4db0d42f service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:23.639320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3647b-01ef-416f-b418-d08c4db0d42f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:23.647482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3647b-01ef-416f-b418-d08c4db0d42f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:44:23.649053 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3647b-01ef-416f-b418-d08c4db0d42f service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:44:23.659111 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 729/1428] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:44:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:44:24.451445 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d53a1-d21f-4ece-bb46-4284bc0bf5dc None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:24.452038 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d53a1-d21f-4ece-bb46-4284bc0bf5dc None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:24.452038 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d53a1-d21f-4ece-bb46-4284bc0bf5dc None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:24.453390 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 700/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 15:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:44:24.459155 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5d662-723b-4221-9582-dbfce02e172b None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:24.459583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5d662-723b-4221-9582-dbfce02e172b None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:24.459726 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5d662-723b-4221-9582-dbfce02e172b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:24.477301 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-aee5d662-723b-4221-9582-dbfce02e172b None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:44:24.478527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-aee5d662-723b-4221-9582-dbfce02e172b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:44:24.486327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 730/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 15:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:44:24.639128 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d53a1-d21f-4ece-bb46-4284bc0bf5dc None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:44:24.659491 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d53a1-d21f-4ece-bb46-4284bc0bf5dc None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:44:24.665468 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a356954b-82c7-4bc8-945e-3a6651eca38b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:44:24.666144 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356954b-82c7-4bc8-945e-3a6651eca38b service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:24.666428 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356954b-82c7-4bc8-945e-3a6651eca38b service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:24.666707 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a356954b-82c7-4bc8-945e-3a6651eca38b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:24.675588 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356954b-82c7-4bc8-945e-3a6651eca38b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:44:24.677154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a356954b-82c7-4bc8-945e-3a6651eca38b service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:44:24.687056 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 701/1431] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:44:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:44:25.494558 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e47039-0895-463b-94ab-bdbfad305f03 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:25.495138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e47039-0895-463b-94ab-bdbfad305f03 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:25.495138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e47039-0895-463b-94ab-bdbfad305f03 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:25.496492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 731/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 15:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:44:25.501450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca590b14-9148-472b-b167-dc95cf22d31f None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:25.501848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca590b14-9148-472b-b167-dc95cf22d31f None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:25.502057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca590b14-9148-472b-b167-dc95cf22d31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:25.520060 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-ca590b14-9148-472b-b167-dc95cf22d31f None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:44:25.521252 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-ca590b14-9148-472b-b167-dc95cf22d31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:44:25.528994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 702/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 15:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:44:25.680776 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e47039-0895-463b-94ab-bdbfad305f03 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:44:25.695175 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e47039-0895-463b-94ab-bdbfad305f03 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:44:25.700371 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670aaddb-5efb-4818-80b1-ed232be57239 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:44:25.700998 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670aaddb-5efb-4818-80b1-ed232be57239 service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:25.701278 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670aaddb-5efb-4818-80b1-ed232be57239 service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:25.701552 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670aaddb-5efb-4818-80b1-ed232be57239 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:25.710004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670aaddb-5efb-4818-80b1-ed232be57239 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:44:25.711658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670aaddb-5efb-4818-80b1-ed232be57239 service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:44:25.721301 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 732/1434] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:44:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:44:26.520750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df39e6-7459-43c1-bfd4-e92f33295fc6 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:26.521326 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df39e6-7459-43c1-bfd4-e92f33295fc6 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:26.521326 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8df39e6-7459-43c1-bfd4-e92f33295fc6 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:26.522692 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 703/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 15:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:44:26.527690 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2827dad-1b63-4d63-ad1e-212559d7d0b8 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:26.528081 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2827dad-1b63-4d63-ad1e-212559d7d0b8 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:26.528258 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2827dad-1b63-4d63-ad1e-212559d7d0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:26.546791 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-c2827dad-1b63-4d63-ad1e-212559d7d0b8 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:44:26.548000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-c2827dad-1b63-4d63-ad1e-212559d7d0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:44:26.556403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 733/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 15:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:44:26.705765 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df39e6-7459-43c1-bfd4-e92f33295fc6 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:44:26.719675 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8df39e6-7459-43c1-bfd4-e92f33295fc6 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:44:26.725479 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848d32d-7bf6-4326-8cf3-41f7eae71f33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:44:26.726137 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848d32d-7bf6-4326-8cf3-41f7eae71f33 service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:26.726418 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848d32d-7bf6-4326-8cf3-41f7eae71f33 service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:26.726694 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848d32d-7bf6-4326-8cf3-41f7eae71f33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:26.734551 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848d32d-7bf6-4326-8cf3-41f7eae71f33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:44:26.736104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848d32d-7bf6-4326-8cf3-41f7eae71f33 service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:44:26.745712 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 704/1437] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:44:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:44:27.547872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3af7d-892e-47de-ad56-743a231de728 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:27.548407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3af7d-892e-47de-ad56-743a231de728 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:27.548407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3af7d-892e-47de-ad56-743a231de728 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:27.549790 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 734/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 15:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:44:27.554703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407347f-b72b-47f8-853e-0eafaed4b70e None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:27.555155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407347f-b72b-47f8-853e-0eafaed4b70e None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:27.555253 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407347f-b72b-47f8-853e-0eafaed4b70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:27.573803 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-c407347f-b72b-47f8-853e-0eafaed4b70e None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:44:27.575008 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-c407347f-b72b-47f8-853e-0eafaed4b70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:44:27.583298 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 705/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 15:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:44:27.732919 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3af7d-892e-47de-ad56-743a231de728 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:44:27.747605 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3af7d-892e-47de-ad56-743a231de728 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:44:27.753587 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d3e8f-426e-43c0-b309-7f8512223bd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:44:27.754255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d3e8f-426e-43c0-b309-7f8512223bd1 service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:27.754544 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d3e8f-426e-43c0-b309-7f8512223bd1 service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:27.754824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d3e8f-426e-43c0-b309-7f8512223bd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:27.763092 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d3e8f-426e-43c0-b309-7f8512223bd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:44:27.764656 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d3e8f-426e-43c0-b309-7f8512223bd1 service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:44:27.774325 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 735/1440] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:44:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:44:29.696377 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99921f1f-ba9f-4ce1-9a80-dce7001fe888 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:29.697035 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99921f1f-ba9f-4ce1-9a80-dce7001fe888 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:29.697035 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99921f1f-ba9f-4ce1-9a80-dce7001fe888 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:29.698324 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 706/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 15:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:44:29.703502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340817d-2035-4eb6-b140-67c90518561f None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:29.703975 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340817d-2035-4eb6-b140-67c90518561f None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:29.704079 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5340817d-2035-4eb6-b140-67c90518561f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:29.721694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-5340817d-2035-4eb6-b140-67c90518561f None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:44:29.722890 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5340817d-2035-4eb6-b140-67c90518561f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:44:29.730523 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 736/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 15:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:44:29.769163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99921f1f-ba9f-4ce1-9a80-dce7001fe888 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:44:29.779850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99921f1f-ba9f-4ce1-9a80-dce7001fe888 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:44:29.784087 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce0239-5efa-424c-8da0-9df1cb4e8d7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:44:29.784717 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce0239-5efa-424c-8da0-9df1cb4e8d7a service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:29.784997 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce0239-5efa-424c-8da0-9df1cb4e8d7a service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:29.785273 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce0239-5efa-424c-8da0-9df1cb4e8d7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:29.793895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce0239-5efa-424c-8da0-9df1cb4e8d7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:44:29.795303 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce0239-5efa-424c-8da0-9df1cb4e8d7a service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:44:29.805257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 707/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:44:32.069195 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6ebfe-fdd4-4cba-9aa0-bd178c984c2e None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:32.069772 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6ebfe-fdd4-4cba-9aa0-bd178c984c2e None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:32.069772 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6ebfe-fdd4-4cba-9aa0-bd178c984c2e None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:32.071165 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 737/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 15:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:44:32.076462 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7ac13-bcd6-4eff-b383-c67b3512aea5 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:32.076905 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7ac13-bcd6-4eff-b383-c67b3512aea5 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:32.077010 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7ac13-bcd6-4eff-b383-c67b3512aea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:32.094812 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-edf7ac13-bcd6-4eff-b383-c67b3512aea5 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:44:32.096510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-edf7ac13-bcd6-4eff-b383-c67b3512aea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:44:32.104241 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 708/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 15:44:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:44:32.143147 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6ebfe-fdd4-4cba-9aa0-bd178c984c2e None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:44:32.153742 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6ebfe-fdd4-4cba-9aa0-bd178c984c2e None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:44:32.157454 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6c312-4f04-42f5-8632-ff8fa92150df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:44:32.158721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6c312-4f04-42f5-8632-ff8fa92150df service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:32.159009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6c312-4f04-42f5-8632-ff8fa92150df service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:32.159289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6c312-4f04-42f5-8632-ff8fa92150df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:32.167924 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6c312-4f04-42f5-8632-ff8fa92150df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:44:32.169329 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6c312-4f04-42f5-8632-ff8fa92150df service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:44:32.178508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 738/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:44:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:44:34.509990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c413356-171a-438c-b632-1086e1707a4e None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:34.510553 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c413356-171a-438c-b632-1086e1707a4e None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:34.510553 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c413356-171a-438c-b632-1086e1707a4e None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:34.511924 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 709/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 15:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:44:34.517108 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c3983-d4a8-4a5f-8af3-7d298033b5d5 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:34.518158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c3983-d4a8-4a5f-8af3-7d298033b5d5 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:34.518254 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c3983-d4a8-4a5f-8af3-7d298033b5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:34.536221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-ed7c3983-d4a8-4a5f-8af3-7d298033b5d5 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:44:34.537398 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ed7c3983-d4a8-4a5f-8af3-7d298033b5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:44:34.545199 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 739/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 15:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:44:34.583921 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c413356-171a-438c-b632-1086e1707a4e None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:44:34.595325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c413356-171a-438c-b632-1086e1707a4e None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:44:34.599631 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d410ed-7aac-4ebd-9e35-8b731e9a1da6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:44:34.600275 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d410ed-7aac-4ebd-9e35-8b731e9a1da6 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:34.600562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d410ed-7aac-4ebd-9e35-8b731e9a1da6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:34.600877 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d410ed-7aac-4ebd-9e35-8b731e9a1da6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:34.610064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d410ed-7aac-4ebd-9e35-8b731e9a1da6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:44:34.611423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d410ed-7aac-4ebd-9e35-8b731e9a1da6 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:44:34.621109 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 710/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:44:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:44:36.740175 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c89ca-c338-402c-8817-25b678117aca None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:36.740689 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c89ca-c338-402c-8817-25b678117aca None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:36.740808 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c89ca-c338-402c-8817-25b678117aca None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:36.742135 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 740/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 15:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:44:36.747537 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897199d-9a27-4d23-9718-b3ae89b9931a None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:36.747944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897199d-9a27-4d23-9718-b3ae89b9931a None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:36.748094 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0897199d-9a27-4d23-9718-b3ae89b9931a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:36.768287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-0897199d-9a27-4d23-9718-b3ae89b9931a None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:44:36.769497 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-0897199d-9a27-4d23-9718-b3ae89b9931a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:44:36.777302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 711/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 15:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:44:36.820572 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c89ca-c338-402c-8817-25b678117aca None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:44:36.831158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c89ca-c338-402c-8817-25b678117aca None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:44:36.834764 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12589561-3516-4203-8a77-f700096c0ed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:44:36.835401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12589561-3516-4203-8a77-f700096c0ed6 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:36.835685 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12589561-3516-4203-8a77-f700096c0ed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:36.835968 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12589561-3516-4203-8a77-f700096c0ed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:36.844889 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12589561-3516-4203-8a77-f700096c0ed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:44:36.846405 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12589561-3516-4203-8a77-f700096c0ed6 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:44:36.855752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 741/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:44:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:44:38.947151 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a15d9d-5598-4119-a6e7-ce2da2fc737f None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:38.947679 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a15d9d-5598-4119-a6e7-ce2da2fc737f None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:38.947679 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a15d9d-5598-4119-a6e7-ce2da2fc737f None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:38.949039 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 712/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 15:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:44:38.954485 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670dbff-def0-402f-8c0f-e3b16de5594c None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:38.955446 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670dbff-def0-402f-8c0f-e3b16de5594c None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:38.955572 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670dbff-def0-402f-8c0f-e3b16de5594c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:38.973534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-0670dbff-def0-402f-8c0f-e3b16de5594c None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:44:38.974768 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-0670dbff-def0-402f-8c0f-e3b16de5594c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:44:38.982987 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 742/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 15:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:44:39.024147 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a15d9d-5598-4119-a6e7-ce2da2fc737f None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:44:39.035669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a15d9d-5598-4119-a6e7-ce2da2fc737f None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:44:39.039197 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25414b42-f856-411c-affe-daacf44fba10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:44:39.039831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25414b42-f856-411c-affe-daacf44fba10 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:39.040115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25414b42-f856-411c-affe-daacf44fba10 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:39.040395 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25414b42-f856-411c-affe-daacf44fba10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:39.049250 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25414b42-f856-411c-affe-daacf44fba10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:44:39.050700 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25414b42-f856-411c-affe-daacf44fba10 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:44:39.059881 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 713/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:44:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:44:41.122002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ef2fa-3327-49c4-9c11-d4a2ca8e9e66 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:41.122544 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ef2fa-3327-49c4-9c11-d4a2ca8e9e66 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:41.122544 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ef2fa-3327-49c4-9c11-d4a2ca8e9e66 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:41.123970 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 743/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 15:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:44:41.129232 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea5ad3-f671-4fd2-a58b-24f3939e6aad None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:41.129640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea5ad3-f671-4fd2-a58b-24f3939e6aad None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:41.129799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea5ad3-f671-4fd2-a58b-24f3939e6aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:41.148001 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-00ea5ad3-f671-4fd2-a58b-24f3939e6aad None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:44:41.149224 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-00ea5ad3-f671-4fd2-a58b-24f3939e6aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:44:41.157435 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 714/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 15:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:44:41.196312 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ef2fa-3327-49c4-9c11-d4a2ca8e9e66 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:44:41.208028 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ef2fa-3327-49c4-9c11-d4a2ca8e9e66 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:44:41.211532 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61a9f2-34d6-4005-8647-e6d9afda532a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:44:41.212186 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61a9f2-34d6-4005-8647-e6d9afda532a service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:41.212470 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61a9f2-34d6-4005-8647-e6d9afda532a service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:41.212859 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61a9f2-34d6-4005-8647-e6d9afda532a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:41.223825 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61a9f2-34d6-4005-8647-e6d9afda532a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:44:41.225251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61a9f2-34d6-4005-8647-e6d9afda532a service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:44:41.234832 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 744/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:44:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:44:43.293074 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028a7ac-bc1f-4d26-977b-bfeafb4fcfe0 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:43.293613 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028a7ac-bc1f-4d26-977b-bfeafb4fcfe0 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:43.293613 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028a7ac-bc1f-4d26-977b-bfeafb4fcfe0 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:43.295049 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 715/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 15:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:44:43.300970 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45568804-2b05-46ee-b82f-1351d117906d None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:43.301410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45568804-2b05-46ee-b82f-1351d117906d None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:43.301532 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45568804-2b05-46ee-b82f-1351d117906d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:43.318725 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-45568804-2b05-46ee-b82f-1351d117906d None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:44:43.319903 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-45568804-2b05-46ee-b82f-1351d117906d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:44:43.327646 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 745/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 15:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:44:43.367405 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028a7ac-bc1f-4d26-977b-bfeafb4fcfe0 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:44:43.369070 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-f028a7ac-bc1f-4d26-977b-bfeafb4fcfe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:44:43.381789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028a7ac-bc1f-4d26-977b-bfeafb4fcfe0 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:44:43.385295 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c632e-9282-4a7a-8264-d744ff7633d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:44:43.385965 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c632e-9282-4a7a-8264-d744ff7633d0 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:43.386253 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c632e-9282-4a7a-8264-d744ff7633d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:43.386530 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c632e-9282-4a7a-8264-d744ff7633d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:43.395790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c632e-9282-4a7a-8264-d744ff7633d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:44:43.397206 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c632e-9282-4a7a-8264-d744ff7633d0 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:44:43.407017 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 716/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:44:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:44:45.468956 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23464393-7129-4af4-b268-5b27e7c7140f None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:45.469529 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23464393-7129-4af4-b268-5b27e7c7140f None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:45.469529 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23464393-7129-4af4-b268-5b27e7c7140f None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:45.471472 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 746/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 15:44:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:44:45.476876 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd7fa7-da43-4b3c-8e44-476ce12c2dd4 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:45.477293 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd7fa7-da43-4b3c-8e44-476ce12c2dd4 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:45.477437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd7fa7-da43-4b3c-8e44-476ce12c2dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:45.483487 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=79 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:44:45.496495 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-87dd7fa7-da43-4b3c-8e44-476ce12c2dd4 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:44:45.497671 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-87dd7fa7-da43-4b3c-8e44-476ce12c2dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:44:45.505334 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 717/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 15:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:44:45.543652 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23464393-7129-4af4-b268-5b27e7c7140f None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:44:45.549577 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=73 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:44:45.555525 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23464393-7129-4af4-b268-5b27e7c7140f None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:44:45.558991 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b553a2d-ae98-406a-99b9-ce7431a859fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:44:45.559618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b553a2d-ae98-406a-99b9-ce7431a859fa service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:45.559903 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b553a2d-ae98-406a-99b9-ce7431a859fa service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:45.560184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b553a2d-ae98-406a-99b9-ce7431a859fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:45.569138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b553a2d-ae98-406a-99b9-ce7431a859fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:44:45.570608 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b553a2d-ae98-406a-99b9-ce7431a859fa service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:44:45.579929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 747/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:44:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:44:47.612790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d88bd0-2d5e-4dbe-ad9c-40a9b95b7253 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:47.613358 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d88bd0-2d5e-4dbe-ad9c-40a9b95b7253 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:47.613358 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d88bd0-2d5e-4dbe-ad9c-40a9b95b7253 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:47.614745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 718/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 15:44:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:44:47.619986 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15732dc-4d26-42a4-9605-09e8b86193fa None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:47.620409 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15732dc-4d26-42a4-9605-09e8b86193fa None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:47.620576 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15732dc-4d26-42a4-9605-09e8b86193fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:47.637871 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-d15732dc-4d26-42a4-9605-09e8b86193fa None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:44:47.639066 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-d15732dc-4d26-42a4-9605-09e8b86193fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:44:47.646894 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 748/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 15:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:44:47.683698 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d88bd0-2d5e-4dbe-ad9c-40a9b95b7253 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:44:47.694187 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d88bd0-2d5e-4dbe-ad9c-40a9b95b7253 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:44:47.697626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca1612-a01e-44ab-83e0-8a4ad7e08aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:44:47.698283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca1612-a01e-44ab-83e0-8a4ad7e08aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:47.698565 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca1612-a01e-44ab-83e0-8a4ad7e08aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:47.698839 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca1612-a01e-44ab-83e0-8a4ad7e08aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:47.707832 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca1612-a01e-44ab-83e0-8a4ad7e08aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:44:47.709249 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca1612-a01e-44ab-83e0-8a4ad7e08aa6 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:44:47.718656 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 719/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:44:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:44:49.747727 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fb3f7-6b51-43ff-b08f-b96f537acd11 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:49.748341 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fb3f7-6b51-43ff-b08f-b96f537acd11 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:49.748341 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fb3f7-6b51-43ff-b08f-b96f537acd11 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:49.749690 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 749/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 15:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:44:49.755516 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081cb14-62de-44ea-b8d8-1ed3d509640e None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:49.755944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081cb14-62de-44ea-b8d8-1ed3d509640e None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:49.756073 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081cb14-62de-44ea-b8d8-1ed3d509640e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:49.774413 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-6081cb14-62de-44ea-b8d8-1ed3d509640e None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:44:49.775793 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-6081cb14-62de-44ea-b8d8-1ed3d509640e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:44:49.784882 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 720/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 15:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:44:49.822033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fb3f7-6b51-43ff-b08f-b96f537acd11 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:44:49.832485 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1fb3f7-6b51-43ff-b08f-b96f537acd11 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:44:49.835967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998bd27-b2bf-4d0c-addd-debd9de540e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:44:49.836593 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998bd27-b2bf-4d0c-addd-debd9de540e7 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:44:49.836875 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998bd27-b2bf-4d0c-addd-debd9de540e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:44:49.837152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998bd27-b2bf-4d0c-addd-debd9de540e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:44:49.845771 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998bd27-b2bf-4d0c-addd-debd9de540e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:44:49.847776 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998bd27-b2bf-4d0c-addd-debd9de540e7 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:44:49.856913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 750/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:44:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:44:59.768727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=11 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:44:59.852928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=14 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:45:09.644052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c2ebd-fd42-466a-8276-3945de6f9db9 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:45:09.644690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c2ebd-fd42-466a-8276-3945de6f9db9 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:45:09.644690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c2ebd-fd42-466a-8276-3945de6f9db9 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:45:09.646050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 721/1471] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:45:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:45:09.651514 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dccba-aa53-43fa-bec4-e4dfd2537535 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:45:09.652009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dccba-aa53-43fa-bec4-e4dfd2537535 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:45:09.652111 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dccba-aa53-43fa-bec4-e4dfd2537535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:45:09.670764 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-1c7dccba-aa53-43fa-bec4-e4dfd2537535 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:45:09.671964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-1c7dccba-aa53-43fa-bec4-e4dfd2537535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:45:09.679680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 751/1472] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:45:09.727971 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e977531-482a-43c2-bb15-a17b614e8d84 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:45:09.728264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e977531-482a-43c2-bb15-a17b614e8d84 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:45:09.728542 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e977531-482a-43c2-bb15-a17b614e8d84 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:45:09.729922 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 722/1473] 10.222.0.15 () {54 vars in 962 bytes} [Thu Jun 23 15:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:45:09.734978 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050bc6a-d0cf-48e7-83b7-929d6a82df56 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:45:09.735274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050bc6a-d0cf-48e7-83b7-929d6a82df56 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:45:09.735561 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050bc6a-d0cf-48e7-83b7-929d6a82df56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:45:09.753219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-c050bc6a-d0cf-48e7-83b7-929d6a82df56 None None] MFA Rules not processed for user `79239c95306c43f0a1a0b51715440009`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:45:09.754462 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-c050bc6a-d0cf-48e7-83b7-929d6a82df56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:45:09.760871 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 752/1474] 10.222.0.15 () {58 vars in 1059 bytes} [Thu Jun 23 15:45:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:45:09.769015 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e977531-482a-43c2-bb15-a17b614e8d84 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:45:09.779548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e977531-482a-43c2-bb15-a17b614e8d84 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:45:09.783912 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624af1b-344d-4501-9dea-b9a6efb00d00 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79239c95306c43f0a1a0b51715440009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:45:09.784542 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624af1b-344d-4501-9dea-b9a6efb00d00 service glance] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:45:09.784827 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624af1b-344d-4501-9dea-b9a6efb00d00 service glance] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:45:09.785103 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624af1b-344d-4501-9dea-b9a6efb00d00 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:45:09.794011 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624af1b-344d-4501-9dea-b9a6efb00d00 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:45:09.795426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624af1b-344d-4501-9dea-b9a6efb00d00 service glance] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:45:09.804769 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 723/1475] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:45:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:45:12.001994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796aefa-cd35-4de4-b8e4-69969c8b5b8f None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:45:12.002573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796aefa-cd35-4de4-b8e4-69969c8b5b8f None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:45:12.002573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796aefa-cd35-4de4-b8e4-69969c8b5b8f None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:45:12.003930 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 753/1476] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:45:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:45:12.009458 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dac64-da1a-4f4e-948a-f0c2f5c4ef7f None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:45:12.009976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dac64-da1a-4f4e-948a-f0c2f5c4ef7f None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:45:12.010080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dac64-da1a-4f4e-948a-f0c2f5c4ef7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:45:12.030399 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-bc2dac64-da1a-4f4e-948a-f0c2f5c4ef7f None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:45:12.032045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-bc2dac64-da1a-4f4e-948a-f0c2f5c4ef7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:45:12.041430 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 724/1477] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:45:12.066139 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796aefa-cd35-4de4-b8e4-69969c8b5b8f None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:45:12.079022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796aefa-cd35-4de4-b8e4-69969c8b5b8f None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:45:12.084001 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36178992-bfa9-44c8-9dea-a058b95a6ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:45:12.084654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36178992-bfa9-44c8-9dea-a058b95a6ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:45:12.084939 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36178992-bfa9-44c8-9dea-a058b95a6ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:45:12.085217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36178992-bfa9-44c8-9dea-a058b95a6ec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:45:12.085990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36178992-bfa9-44c8-9dea-a058b95a6ec3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:45:12.087838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: WARNING py.warnings [None req-36178992-bfa9-44c8-9dea-a058b95a6ec3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 15:45:12.087838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: warnings.warn(msg) Jun 23 15:45:12.087838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: Jun 23 15:45:12.089072 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36178992-bfa9-44c8-9dea-a058b95a6ec3 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:45:12.109786 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 754/1478] 10.222.0.15 () {56 vars in 1108 bytes} [Thu Jun 23 15:45:12 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:45:14.197906 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f09c9d-781f-4f37-a20b-9aab498283e6 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:45:14.198508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f09c9d-781f-4f37-a20b-9aab498283e6 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:45:14.198508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f09c9d-781f-4f37-a20b-9aab498283e6 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:45:14.199839 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 725/1479] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:45:14.205207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b4305-a149-450b-a204-8dcd905d4778 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:45:14.205685 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b4305-a149-450b-a204-8dcd905d4778 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:45:14.205794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b4305-a149-450b-a204-8dcd905d4778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:45:14.224212 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-de4b4305-a149-450b-a204-8dcd905d4778 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:45:14.225447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-de4b4305-a149-450b-a204-8dcd905d4778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:45:14.233181 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 755/1480] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:45:14.276699 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f09c9d-781f-4f37-a20b-9aab498283e6 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:45:14.291141 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f09c9d-781f-4f37-a20b-9aab498283e6 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:45:14.296513 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249475b-4926-4957-be4c-d17a2d9dd7b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:45:14.297145 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249475b-4926-4957-be4c-d17a2d9dd7b2 service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:45:14.297427 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249475b-4926-4957-be4c-d17a2d9dd7b2 service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:45:14.297703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249475b-4926-4957-be4c-d17a2d9dd7b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:45:14.306409 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249475b-4926-4957-be4c-d17a2d9dd7b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:45:14.307962 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249475b-4926-4957-be4c-d17a2d9dd7b2 service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:45:14.317837 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 726/1481] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:45:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:45:16.605264 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198af949-192f-472a-8886-d991687ff193 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:45:16.605899 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198af949-192f-472a-8886-d991687ff193 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:45:16.605899 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198af949-192f-472a-8886-d991687ff193 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:45:16.607428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 756/1482] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:45:16.613772 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf45d7-a25c-4af9-b9ad-796a29be6937 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:45:16.614418 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf45d7-a25c-4af9-b9ad-796a29be6937 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:45:16.614418 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf45d7-a25c-4af9-b9ad-796a29be6937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:45:16.633279 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-fbdf45d7-a25c-4af9-b9ad-796a29be6937 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:45:16.634585 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-fbdf45d7-a25c-4af9-b9ad-796a29be6937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:45:16.643378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 727/1483] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:45:16.681735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198af949-192f-472a-8886-d991687ff193 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:45:16.693831 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198af949-192f-472a-8886-d991687ff193 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:45:16.697512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c810a4-270c-4c99-9da3-911705e12e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:45:16.698254 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c810a4-270c-4c99-9da3-911705e12e14 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:45:16.698575 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c810a4-270c-4c99-9da3-911705e12e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:45:16.698891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c810a4-270c-4c99-9da3-911705e12e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:45:16.712561 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c810a4-270c-4c99-9da3-911705e12e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:45:16.714113 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c810a4-270c-4c99-9da3-911705e12e14 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:45:16.728045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 757/1484] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:45:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:45:19.094430 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7e8f7-f7cf-4d0d-8726-5fd599ceab01 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:45:19.095054 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7e8f7-f7cf-4d0d-8726-5fd599ceab01 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:45:19.095054 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7e8f7-f7cf-4d0d-8726-5fd599ceab01 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:45:19.096949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 728/1485] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:45:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:45:19.102869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86efd81-f3ea-4c59-b4fe-45465e9c4892 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:45:19.103410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86efd81-f3ea-4c59-b4fe-45465e9c4892 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:45:19.103410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86efd81-f3ea-4c59-b4fe-45465e9c4892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:45:19.123237 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-f86efd81-f3ea-4c59-b4fe-45465e9c4892 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:45:19.124490 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-f86efd81-f3ea-4c59-b4fe-45465e9c4892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:45:19.133135 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 758/1486] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:45:19.175212 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7e8f7-f7cf-4d0d-8726-5fd599ceab01 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:45:19.186544 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7e8f7-f7cf-4d0d-8726-5fd599ceab01 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:45:19.190861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c07f2a-acaa-4202-aeaa-0d9c33769cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:45:19.191522 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c07f2a-acaa-4202-aeaa-0d9c33769cdf service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:45:19.191809 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c07f2a-acaa-4202-aeaa-0d9c33769cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:45:19.192092 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c07f2a-acaa-4202-aeaa-0d9c33769cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:45:19.205820 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c07f2a-acaa-4202-aeaa-0d9c33769cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:45:19.208037 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c07f2a-acaa-4202-aeaa-0d9c33769cdf service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:45:19.219843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 729/1487] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:45:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:45:21.429209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4214a2b-0aba-4973-a8c0-9ea162dea786 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:45:21.429756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4214a2b-0aba-4973-a8c0-9ea162dea786 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:45:21.429756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4214a2b-0aba-4973-a8c0-9ea162dea786 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:45:21.431167 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 759/1488] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:45:21.436416 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d502f-7fb4-4001-b400-9600096c2727 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:45:21.436891 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d502f-7fb4-4001-b400-9600096c2727 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:45:21.436998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d502f-7fb4-4001-b400-9600096c2727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:45:21.455508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-dd1d502f-7fb4-4001-b400-9600096c2727 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:45:21.456716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-dd1d502f-7fb4-4001-b400-9600096c2727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:45:21.464564 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 730/1489] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:45:21.504677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4214a2b-0aba-4973-a8c0-9ea162dea786 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:45:21.515318 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4214a2b-0aba-4973-a8c0-9ea162dea786 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:45:21.519349 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c88b17-8e80-46b1-918c-6440cada6e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:45:21.519991 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c88b17-8e80-46b1-918c-6440cada6e62 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:45:21.520282 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c88b17-8e80-46b1-918c-6440cada6e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:45:21.520559 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c88b17-8e80-46b1-918c-6440cada6e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:45:21.529707 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c88b17-8e80-46b1-918c-6440cada6e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:45:21.531163 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c88b17-8e80-46b1-918c-6440cada6e62 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:45:21.541619 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 760/1490] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:45:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:45:23.896658 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511d98b-9d17-4bd3-8d7f-d53c4f0e9c3d None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:45:23.897208 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511d98b-9d17-4bd3-8d7f-d53c4f0e9c3d None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:45:23.897208 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511d98b-9d17-4bd3-8d7f-d53c4f0e9c3d None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:45:23.898523 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 731/1491] 10.222.0.15 () {54 vars in 926 bytes} [Thu Jun 23 15:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:45:23.904040 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ddbff-9085-4b86-8ca9-85cd1e22aaed None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:45:23.904545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ddbff-9085-4b86-8ca9-85cd1e22aaed None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:45:23.904682 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ddbff-9085-4b86-8ca9-85cd1e22aaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:45:23.926477 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-bb6ddbff-9085-4b86-8ca9-85cd1e22aaed None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:45:23.927676 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-bb6ddbff-9085-4b86-8ca9-85cd1e22aaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:45:23.935491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 761/1492] 10.222.0.15 () {58 vars in 1023 bytes} [Thu Jun 23 15:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:45:23.975413 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511d98b-9d17-4bd3-8d7f-d53c4f0e9c3d None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:45:23.986619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511d98b-9d17-4bd3-8d7f-d53c4f0e9c3d None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:45:23.990297 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd8e5f-c848-4fba-a12f-153144ac9fee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:45:23.990944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd8e5f-c848-4fba-a12f-153144ac9fee service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:45:23.991232 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd8e5f-c848-4fba-a12f-153144ac9fee service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:45:23.991514 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd8e5f-c848-4fba-a12f-153144ac9fee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:45:24.000892 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd8e5f-c848-4fba-a12f-153144ac9fee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:45:24.002461 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd8e5f-c848-4fba-a12f-153144ac9fee service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:45:24.012036 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 732/1493] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:45:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:45:33.921137 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=33 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:45:34.007807 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=33 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:47:02.281130 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5628e-007d-4f4a-9d5b-bd2baa801b53 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:47:02.282096 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5628e-007d-4f4a-9d5b-bd2baa801b53 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:47:02.282096 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5628e-007d-4f4a-9d5b-bd2baa801b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:47:02.301412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-19d5628e-007d-4f4a-9d5b-bd2baa801b53 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:47:02.302700 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-19d5628e-007d-4f4a-9d5b-bd2baa801b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:47:02.311124 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 762/1494] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:47:02.321090 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4abcf-1011-460c-bd46-d0f3ce9353d4 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:47:02.321718 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4abcf-1011-460c-bd46-d0f3ce9353d4 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:47:02.321718 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4abcf-1011-460c-bd46-d0f3ce9353d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:47:02.341214 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-dbe4abcf-1011-460c-bd46-d0f3ce9353d4 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:47:02.343210 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-dbe4abcf-1011-460c-bd46-d0f3ce9353d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:47:02.352198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 733/1495] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:47:02.357075 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5628e-007d-4f4a-9d5b-bd2baa801b53 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:47:02.370459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5628e-007d-4f4a-9d5b-bd2baa801b53 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:47:02.375547 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4554af-e8dc-4d09-99fc-4d2a403cfa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:47:02.376245 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4554af-e8dc-4d09-99fc-4d2a403cfa26 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:47:02.376528 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4554af-e8dc-4d09-99fc-4d2a403cfa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:47:02.376803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4554af-e8dc-4d09-99fc-4d2a403cfa26 admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:47:02.377559 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4554af-e8dc-4d09-99fc-4d2a403cfa26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:47:02.377904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4554af-e8dc-4d09-99fc-4d2a403cfa26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:47:02.378965 dv-cinder-835384-9-smb devstack@keystone.service[91828]: WARNING py.warnings [None req-ae4554af-e8dc-4d09-99fc-4d2a403cfa26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 15:47:02.378965 dv-cinder-835384-9-smb devstack@keystone.service[91828]: warnings.warn(msg) Jun 23 15:47:02.378965 dv-cinder-835384-9-smb devstack@keystone.service[91828]: Jun 23 15:47:02.379873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4554af-e8dc-4d09-99fc-4d2a403cfa26 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:47:02.393476 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 763/1496] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:47:02.402902 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4abcf-1011-460c-bd46-d0f3ce9353d4 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:47:02.420072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4abcf-1011-460c-bd46-d0f3ce9353d4 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:47:02.427834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d6a68-9750-49d2-ab3a-ec879a8c7372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:47:02.428993 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d6a68-9750-49d2-ab3a-ec879a8c7372 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:47:02.429474 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d6a68-9750-49d2-ab3a-ec879a8c7372 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:47:02.430019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d6a68-9750-49d2-ab3a-ec879a8c7372 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:47:02.431316 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d6a68-9750-49d2-ab3a-ec879a8c7372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:47:02.434728 dv-cinder-835384-9-smb devstack@keystone.service[91827]: WARNING py.warnings [None req-179d6a68-9750-49d2-ab3a-ec879a8c7372 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 15:47:02.434728 dv-cinder-835384-9-smb devstack@keystone.service[91827]: warnings.warn(msg) Jun 23 15:47:02.434728 dv-cinder-835384-9-smb devstack@keystone.service[91827]: Jun 23 15:47:02.437084 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d6a68-9750-49d2-ab3a-ec879a8c7372 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:47:02.492343 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 734/1497] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:47:02 2022] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:47:02.497085 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4554af-e8dc-4d09-99fc-4d2a403cfa26 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:47:02.508679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4554af-e8dc-4d09-99fc-4d2a403cfa26 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:47:02.571634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32add58c-0eee-4ded-beb5-fbaa75c97531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:47:02.572331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32add58c-0eee-4ded-beb5-fbaa75c97531 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:47:02.572621 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32add58c-0eee-4ded-beb5-fbaa75c97531 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:47:02.572904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32add58c-0eee-4ded-beb5-fbaa75c97531 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:47:02.573623 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32add58c-0eee-4ded-beb5-fbaa75c97531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:47:02.574708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: WARNING py.warnings [None req-32add58c-0eee-4ded-beb5-fbaa75c97531 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 15:47:02.574708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: warnings.warn(msg) Jun 23 15:47:02.574708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: Jun 23 15:47:02.575916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32add58c-0eee-4ded-beb5-fbaa75c97531 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:47:02.598738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 764/1498] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:47:02 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:47:02.604546 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d6a68-9750-49d2-ab3a-ec879a8c7372 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:47:02.615441 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d6a68-9750-49d2-ab3a-ec879a8c7372 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:47:02.620277 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b75a1e-110a-4c1f-a0d2-a8ef50b947f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:47:02.620973 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b75a1e-110a-4c1f-a0d2-a8ef50b947f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:47:02.621277 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b75a1e-110a-4c1f-a0d2-a8ef50b947f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:47:02.621539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b75a1e-110a-4c1f-a0d2-a8ef50b947f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:47:02.622308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b75a1e-110a-4c1f-a0d2-a8ef50b947f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:47:02.623875 dv-cinder-835384-9-smb devstack@keystone.service[91827]: WARNING py.warnings [None req-78b75a1e-110a-4c1f-a0d2-a8ef50b947f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 15:47:02.623875 dv-cinder-835384-9-smb devstack@keystone.service[91827]: warnings.warn(msg) Jun 23 15:47:02.623875 dv-cinder-835384-9-smb devstack@keystone.service[91827]: Jun 23 15:47:02.624779 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b75a1e-110a-4c1f-a0d2-a8ef50b947f4 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:47:02.640114 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 735/1499] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 15:47:02.644452 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32add58c-0eee-4ded-beb5-fbaa75c97531 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:47:02.655114 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32add58c-0eee-4ded-beb5-fbaa75c97531 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:47:02.660519 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9048e-f27f-45b8-9190-8ac3605d2d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:47:02.661212 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9048e-f27f-45b8-9190-8ac3605d2d69 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:47:02.661540 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9048e-f27f-45b8-9190-8ac3605d2d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:47:02.661819 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9048e-f27f-45b8-9190-8ac3605d2d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:47:02.662602 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9048e-f27f-45b8-9190-8ac3605d2d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:47:02.663671 dv-cinder-835384-9-smb devstack@keystone.service[91828]: WARNING py.warnings [None req-30e9048e-f27f-45b8-9190-8ac3605d2d69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 15:47:02.663671 dv-cinder-835384-9-smb devstack@keystone.service[91828]: warnings.warn(msg) Jun 23 15:47:02.663671 dv-cinder-835384-9-smb devstack@keystone.service[91828]: Jun 23 15:47:02.664712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9048e-f27f-45b8-9190-8ac3605d2d69 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:47:02.688891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 765/1500] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:47:02.693281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b75a1e-110a-4c1f-a0d2-a8ef50b947f4 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:47:02.704548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b75a1e-110a-4c1f-a0d2-a8ef50b947f4 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:47:02.709954 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa2e56-78bb-4848-8816-801d79bf93cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:47:02.710916 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa2e56-78bb-4848-8816-801d79bf93cc admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:47:02.711243 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa2e56-78bb-4848-8816-801d79bf93cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:47:02.711569 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa2e56-78bb-4848-8816-801d79bf93cc admin admin] PATH_INFO: `/v3/projects/0e6c8bc1d4714ec09e2c86911dee1aad/users/ab2bde4e0a694c0c9c4a2ada932ea559/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:47:02.728528 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa2e56-78bb-4848-8816-801d79bf93cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e6c8bc1d4714ec09e2c86911dee1aad, user_id=ab2bde4e0a694c0c9c4a2ada932ea559, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:47:02.729584 dv-cinder-835384-9-smb devstack@keystone.service[91827]: WARNING py.warnings [None req-09fa2e56-78bb-4848-8816-801d79bf93cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 15:47:02.729584 dv-cinder-835384-9-smb devstack@keystone.service[91827]: warnings.warn(msg) Jun 23 15:47:02.729584 dv-cinder-835384-9-smb devstack@keystone.service[91827]: Jun 23 15:47:02.731568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa2e56-78bb-4848-8816-801d79bf93cc admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:47:02.747015 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 736/1501] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:47:02 2022] PUT /identity/v3/projects/0e6c8bc1d4714ec09e2c86911dee1aad/users/ab2bde4e0a694c0c9c4a2ada932ea559/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:47:02.759067 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ae54a-8e32-4a4b-8c8e-cd316c447beb None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:47:02.759393 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ae54a-8e32-4a4b-8c8e-cd316c447beb None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:47:02.759640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ae54a-8e32-4a4b-8c8e-cd316c447beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:47:02.802902 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-8e9ae54a-8e32-4a4b-8c8e-cd316c447beb None None] MFA Rules not processed for user `ab2bde4e0a694c0c9c4a2ada932ea559`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:47:02.804912 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-8e9ae54a-8e32-4a4b-8c8e-cd316c447beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:47:02.917371 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 766/1502] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:47:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:47:02.931193 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf47d9-c94b-410e-a879-ba0017e336d9 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:47:02.931600 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf47d9-c94b-410e-a879-ba0017e336d9 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:47:02.931930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf47d9-c94b-410e-a879-ba0017e336d9 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:47:02.933421 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 737/1503] 10.222.0.15 () {54 vars in 963 bytes} [Thu Jun 23 15:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:47:02.939261 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59a9c-ed1e-4a71-8947-9ba24b901ffe None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:47:02.939593 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59a9c-ed1e-4a71-8947-9ba24b901ffe None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:47:02.939913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59a9c-ed1e-4a71-8947-9ba24b901ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:47:02.959886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-d7a59a9c-ed1e-4a71-8947-9ba24b901ffe None None] MFA Rules not processed for user `b524afb3b4b24025ad8bef85aa64bd91`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:47:02.961116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-d7a59a9c-ed1e-4a71-8947-9ba24b901ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:47:03.008889 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:47:03.020123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 767/1504] 10.222.0.15 () {58 vars in 1060 bytes} [Thu Jun 23 15:47:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:47:03.028248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf47d9-c94b-410e-a879-ba0017e336d9 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:47:03.040616 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf47d9-c94b-410e-a879-ba0017e336d9 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:47:03.044456 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d9a86-8a9c-485b-9836-f6a3215db0b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:47:03.045115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d9a86-8a9c-485b-9836-f6a3215db0b2 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:47:03.045401 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d9a86-8a9c-485b-9836-f6a3215db0b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:47:03.045681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d9a86-8a9c-485b-9836-f6a3215db0b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:47:03.055426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d9a86-8a9c-485b-9836-f6a3215db0b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:47:03.056907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d9a86-8a9c-485b-9836-f6a3215db0b2 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:47:03.067344 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 738/1505] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:47:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:47:03.114586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275f2d8-31ee-4c1d-b55b-f30c245f48e2 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:47:03.115001 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275f2d8-31ee-4c1d-b55b-f30c245f48e2 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:47:03.115390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275f2d8-31ee-4c1d-b55b-f30c245f48e2 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:47:03.116805 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 768/1506] 10.222.0.15 () {52 vars in 829 bytes} [Thu Jun 23 15:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:47:03.121048 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d9a86-8a9c-485b-9836-f6a3215db0b2 service cinder] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:47:03.186913 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d9a86-8a9c-485b-9836-f6a3215db0b2 service cinder] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:47:03.191523 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43504b-a801-4195-9e9d-bc3879e550bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:47:03.192416 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43504b-a801-4195-9e9d-bc3879e550bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:47:03.192704 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43504b-a801-4195-9e9d-bc3879e550bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:47:03.192984 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43504b-a801-4195-9e9d-bc3879e550bb admin admin] PATH_INFO: `/v3/users/ab2bde4e0a694c0c9c4a2ada932ea559` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:47:03.194229 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43504b-a801-4195-9e9d-bc3879e550bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab2bde4e0a694c0c9c4a2ada932ea559)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:47:03.195257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: WARNING py.warnings [None req-7b43504b-a801-4195-9e9d-bc3879e550bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 15:47:03.195257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: warnings.warn(msg) Jun 23 15:47:03.195257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: Jun 23 15:47:03.196473 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43504b-a801-4195-9e9d-bc3879e550bb admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:47:03.271019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-7b43504b-a801-4195-9e9d-bc3879e550bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab2bde4e0a694c0c9c4a2ada932ea559'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:47:03.286327 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-7b43504b-a801-4195-9e9d-bc3879e550bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab2bde4e0a694c0c9c4a2ada932ea559'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:47:03.287257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-7b43504b-a801-4195-9e9d-bc3879e550bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab2bde4e0a694c0c9c4a2ada932ea559'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:47:03.287964 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-7b43504b-a801-4195-9e9d-bc3879e550bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab2bde4e0a694c0c9c4a2ada932ea559'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:47:03.308430 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-7b43504b-a801-4195-9e9d-bc3879e550bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab2bde4e0a694c0c9c4a2ada932ea559'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:47:03.313492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:47:03.329830 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 739/1507] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:47:03 2022] DELETE /identity/v3/users/ab2bde4e0a694c0c9c4a2ada932ea559 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:47:03.335095 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed220d-e264-4fbe-bdad-3bbddf81067b None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:47:03.335812 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed220d-e264-4fbe-bdad-3bbddf81067b None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:47:03.335812 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed220d-e264-4fbe-bdad-3bbddf81067b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:47:03.355214 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-d9ed220d-e264-4fbe-bdad-3bbddf81067b None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:47:03.356497 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-d9ed220d-e264-4fbe-bdad-3bbddf81067b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:47:03.423985 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 769/1508] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:47:03.434421 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43504b-a801-4195-9e9d-bc3879e550bb admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:47:03.436478 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-7b43504b-a801-4195-9e9d-bc3879e550bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:47:03.502319 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43504b-a801-4195-9e9d-bc3879e550bb admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:47:03.506262 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b748a83-ffa4-41fc-8724-53ac399084da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:47:03.506940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b748a83-ffa4-41fc-8724-53ac399084da service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:47:03.507226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b748a83-ffa4-41fc-8724-53ac399084da service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:47:03.507501 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b748a83-ffa4-41fc-8724-53ac399084da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:47:03.518514 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b748a83-ffa4-41fc-8724-53ac399084da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:47:03.519973 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b748a83-ffa4-41fc-8724-53ac399084da service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:47:03.530936 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 740/1509] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:47:03.896169 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed220d-e264-4fbe-bdad-3bbddf81067b None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:47:03.898507 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-d9ed220d-e264-4fbe-bdad-3bbddf81067b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:47:03.924371 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed220d-e264-4fbe-bdad-3bbddf81067b None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:47:03.929492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8edf37-2d82-413f-ad5a-c537781984b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:47:03.930429 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8edf37-2d82-413f-ad5a-c537781984b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:47:03.930714 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8edf37-2d82-413f-ad5a-c537781984b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:47:03.930997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8edf37-2d82-413f-ad5a-c537781984b2 admin admin] PATH_INFO: `/v3/projects/0e6c8bc1d4714ec09e2c86911dee1aad` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:47:03.932491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8edf37-2d82-413f-ad5a-c537781984b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e6c8bc1d4714ec09e2c86911dee1aad)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:47:03.933642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: WARNING py.warnings [None req-4e8edf37-2d82-413f-ad5a-c537781984b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 15:47:03.933642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: warnings.warn(msg) Jun 23 15:47:03.933642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: Jun 23 15:47:03.934805 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8edf37-2d82-413f-ad5a-c537781984b2 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:47:04.030263 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-4e8edf37-2d82-413f-ad5a-c537781984b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e6c8bc1d4714ec09e2c86911dee1aad', 'request_id': 'req-4e8edf37-2d82-413f-ad5a-c537781984b2'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:47:04.044931 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-4e8edf37-2d82-413f-ad5a-c537781984b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e6c8bc1d4714ec09e2c86911dee1aad', 'request_id': 'req-4e8edf37-2d82-413f-ad5a-c537781984b2'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:47:04.056908 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-4e8edf37-2d82-413f-ad5a-c537781984b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e6c8bc1d4714ec09e2c86911dee1aad', 'request_id': 'req-4e8edf37-2d82-413f-ad5a-c537781984b2'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:47:04.069088 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-4e8edf37-2d82-413f-ad5a-c537781984b2 admin admin] The token cache is being invalidate because project 0e6c8bc1d4714ec09e2c86911dee1aad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:47:04.069386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-4e8edf37-2d82-413f-ad5a-c537781984b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:47:04.070117 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-4e8edf37-2d82-413f-ad5a-c537781984b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:47:04.071845 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 770/1510] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:47:03 2022] DELETE /identity/v3/projects/0e6c8bc1d4714ec09e2c86911dee1aad => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:47:13.525875 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:47:14.065754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:48:53.505685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05361326-5df4-4527-9ca2-5e3fc3b3b70b None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:48:53.506368 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05361326-5df4-4527-9ca2-5e3fc3b3b70b None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:48:53.506368 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05361326-5df4-4527-9ca2-5e3fc3b3b70b None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:48:53.507677 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 741/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 15:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:48:53.513883 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf48d15-873b-445b-8876-f0ca23715487 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:48:53.514453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf48d15-873b-445b-8876-f0ca23715487 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:48:53.514579 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf48d15-873b-445b-8876-f0ca23715487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:48:53.546378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-5cf48d15-873b-445b-8876-f0ca23715487 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:48:53.548140 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5cf48d15-873b-445b-8876-f0ca23715487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:48:53.613747 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 771/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 15:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:48:53.773832 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05361326-5df4-4527-9ca2-5e3fc3b3b70b None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:48:53.777132 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-05361326-5df4-4527-9ca2-5e3fc3b3b70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:48:53.862002 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05361326-5df4-4527-9ca2-5e3fc3b3b70b None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:48:53.867529 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5827434a-6ef3-4511-b792-42240d28eff2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:48:53.868195 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827434a-6ef3-4511-b792-42240d28eff2 service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:48:53.868479 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827434a-6ef3-4511-b792-42240d28eff2 service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:48:53.868756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5827434a-6ef3-4511-b792-42240d28eff2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:48:53.879997 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827434a-6ef3-4511-b792-42240d28eff2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:48:53.881623 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5827434a-6ef3-4511-b792-42240d28eff2 service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:48:53.896411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 742/1513] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:48:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:48:54.765801 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0c7fc-3f8d-4010-bbed-8ac2d922b31d None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:48:54.766392 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0c7fc-3f8d-4010-bbed-8ac2d922b31d None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:48:54.766528 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0c7fc-3f8d-4010-bbed-8ac2d922b31d None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:48:54.768126 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 772/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 15:48:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:48:54.773651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d01de1-2ec2-4ada-aba4-3e10d1c92a84 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:48:54.774422 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d01de1-2ec2-4ada-aba4-3e10d1c92a84 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:48:54.774422 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d01de1-2ec2-4ada-aba4-3e10d1c92a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:48:54.793343 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-08d01de1-2ec2-4ada-aba4-3e10d1c92a84 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:48:54.794581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-08d01de1-2ec2-4ada-aba4-3e10d1c92a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:48:54.802397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 743/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 15:48:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:48:54.958746 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0c7fc-3f8d-4010-bbed-8ac2d922b31d None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:48:54.973450 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc0c7fc-3f8d-4010-bbed-8ac2d922b31d None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:48:54.979050 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36610c6a-7bcc-4d76-ac4f-a4a96ba4e33b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:48:54.980227 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36610c6a-7bcc-4d76-ac4f-a4a96ba4e33b service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:48:54.980506 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36610c6a-7bcc-4d76-ac4f-a4a96ba4e33b service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:48:54.980778 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36610c6a-7bcc-4d76-ac4f-a4a96ba4e33b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:48:54.990742 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36610c6a-7bcc-4d76-ac4f-a4a96ba4e33b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:48:54.993535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36610c6a-7bcc-4d76-ac4f-a4a96ba4e33b service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:48:55.011793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 773/1516] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:48:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:48:55.171791 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645f79f-42ea-4d28-a249-fc154ef40bfb None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:48:55.171997 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645f79f-42ea-4d28-a249-fc154ef40bfb None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:48:55.172277 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645f79f-42ea-4d28-a249-fc154ef40bfb None None] PATH_INFO: `/v3` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:48:55.173650 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 744/1517] 10.222.0.33 () {54 vars in 925 bytes} [Thu Jun 23 15:48:55 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:48:55.180814 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf32f14-99c7-4f3e-a06c-b1cdd3804293 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:48:55.181100 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf32f14-99c7-4f3e-a06c-b1cdd3804293 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:48:55.181380 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf32f14-99c7-4f3e-a06c-b1cdd3804293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:48:55.199518 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-eaf32f14-99c7-4f3e-a06c-b1cdd3804293 None None] MFA Rules not processed for user `9300c3a803e94f9a93442f551fc9646f`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:48:55.200746 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-eaf32f14-99c7-4f3e-a06c-b1cdd3804293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:48:55.264697 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 774/1518] 10.222.0.33 () {58 vars in 1015 bytes} [Thu Jun 23 15:48:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:49:04.319058 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a04d3-12f7-44b1-bdc6-a156a431de27 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:49:04.319612 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a04d3-12f7-44b1-bdc6-a156a431de27 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:49:04.319612 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a04d3-12f7-44b1-bdc6-a156a431de27 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:49:04.320891 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 745/1519] 10.222.0.15 () {54 vars in 960 bytes} [Thu Jun 23 15:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:49:04.326901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabad58-8c9c-4453-9b19-3d797fe0c38a None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:49:04.327372 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabad58-8c9c-4453-9b19-3d797fe0c38a None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:49:04.327479 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eabad58-8c9c-4453-9b19-3d797fe0c38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:49:04.345622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-5eabad58-8c9c-4453-9b19-3d797fe0c38a None None] MFA Rules not processed for user `9300c3a803e94f9a93442f551fc9646f`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:49:04.346888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5eabad58-8c9c-4453-9b19-3d797fe0c38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:49:04.355329 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 775/1520] 10.222.0.15 () {58 vars in 1057 bytes} [Thu Jun 23 15:49:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:49:04.363009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a04d3-12f7-44b1-bdc6-a156a431de27 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:49:04.377250 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a04d3-12f7-44b1-bdc6-a156a431de27 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:49:04.382264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbb444-f64e-4d8f-ba15-c1ae3926c1cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9300c3a803e94f9a93442f551fc9646f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:49:04.382906 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbb444-f64e-4d8f-ba15-c1ae3926c1cf service placement] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:49:04.383186 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbb444-f64e-4d8f-ba15-c1ae3926c1cf service placement] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:49:04.383461 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbb444-f64e-4d8f-ba15-c1ae3926c1cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:49:04.392508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bbb444-f64e-4d8f-ba15-c1ae3926c1cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:49:04.394115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bbb444-f64e-4d8f-ba15-c1ae3926c1cf service placement] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:49:04.403721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 746/1521] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:49:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:49:06.282131 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff031e7-aa9f-4522-a5b4-74595be1f61f None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:49:06.282796 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff031e7-aa9f-4522-a5b4-74595be1f61f None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:49:06.282796 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff031e7-aa9f-4522-a5b4-74595be1f61f None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:49:06.284064 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 776/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 15:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:49:06.288899 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501e345-63a9-46ae-8282-99d33b67dac2 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:49:06.289374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501e345-63a9-46ae-8282-99d33b67dac2 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:49:06.289484 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501e345-63a9-46ae-8282-99d33b67dac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:49:06.307880 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-c501e345-63a9-46ae-8282-99d33b67dac2 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:49:06.309077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-c501e345-63a9-46ae-8282-99d33b67dac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:49:06.316933 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 747/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 15:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:49:06.471315 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff031e7-aa9f-4522-a5b4-74595be1f61f None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:49:06.486567 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff031e7-aa9f-4522-a5b4-74595be1f61f None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:49:06.491902 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d65085e-5ddd-4503-a7c1-e710d0541c34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:49:06.492535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65085e-5ddd-4503-a7c1-e710d0541c34 service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:49:06.492820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65085e-5ddd-4503-a7c1-e710d0541c34 service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:49:06.493097 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d65085e-5ddd-4503-a7c1-e710d0541c34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:49:06.501680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65085e-5ddd-4503-a7c1-e710d0541c34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:49:06.503298 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d65085e-5ddd-4503-a7c1-e710d0541c34 service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:49:06.513590 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 777/1524] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:49:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:49:07.351387 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25967a-d7a6-481d-b733-557fa27451fe None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:49:07.351957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25967a-d7a6-481d-b733-557fa27451fe None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:49:07.351957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25967a-d7a6-481d-b733-557fa27451fe None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:49:07.353455 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 748/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 15:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:49:07.358599 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79356497-1063-4b57-acc5-06721cb4a6c0 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:49:07.359060 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79356497-1063-4b57-acc5-06721cb4a6c0 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:49:07.359162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79356497-1063-4b57-acc5-06721cb4a6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:49:07.378534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-79356497-1063-4b57-acc5-06721cb4a6c0 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:49:07.379767 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-79356497-1063-4b57-acc5-06721cb4a6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:49:07.388177 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 778/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 15:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:49:07.540432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25967a-d7a6-481d-b733-557fa27451fe None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:49:07.556175 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25967a-d7a6-481d-b733-557fa27451fe None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:49:07.563405 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9886f1e-ede4-4dc5-8fa4-66ce51eabc55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:49:07.564074 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9886f1e-ede4-4dc5-8fa4-66ce51eabc55 service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:49:07.564358 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9886f1e-ede4-4dc5-8fa4-66ce51eabc55 service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:49:07.564633 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9886f1e-ede4-4dc5-8fa4-66ce51eabc55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:49:07.573756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9886f1e-ede4-4dc5-8fa4-66ce51eabc55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:49:07.575397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9886f1e-ede4-4dc5-8fa4-66ce51eabc55 service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:49:07.586225 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 749/1527] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:49:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:49:11.526125 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79851a10-652f-4b89-b12b-3b0516c63150 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:49:11.526687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79851a10-652f-4b89-b12b-3b0516c63150 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:49:11.526687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79851a10-652f-4b89-b12b-3b0516c63150 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:49:11.528048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 779/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 15:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:49:11.533681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2064cd0-77ea-4dc7-92cf-866d1db340b5 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:49:11.534179 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2064cd0-77ea-4dc7-92cf-866d1db340b5 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:49:11.534292 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2064cd0-77ea-4dc7-92cf-866d1db340b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:49:11.552337 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-d2064cd0-77ea-4dc7-92cf-866d1db340b5 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:49:11.553534 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-d2064cd0-77ea-4dc7-92cf-866d1db340b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:49:11.563710 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 750/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 15:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:49:11.601121 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79851a10-652f-4b89-b12b-3b0516c63150 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:49:11.602852 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-79851a10-652f-4b89-b12b-3b0516c63150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:49:11.661104 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79851a10-652f-4b89-b12b-3b0516c63150 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:49:11.664792 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b73cf1-208e-4a7f-a9bf-6b1223ec33dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:49:11.665457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b73cf1-208e-4a7f-a9bf-6b1223ec33dc service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:49:11.665742 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b73cf1-208e-4a7f-a9bf-6b1223ec33dc service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:49:11.666051 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b73cf1-208e-4a7f-a9bf-6b1223ec33dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:49:11.676320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b73cf1-208e-4a7f-a9bf-6b1223ec33dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:49:11.677797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b73cf1-208e-4a7f-a9bf-6b1223ec33dc service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:49:11.683360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:49:11.688797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 780/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:49:13.722100 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d32ec-288b-4b13-8bc9-951d0aba56b6 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:49:13.722664 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d32ec-288b-4b13-8bc9-951d0aba56b6 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:49:13.722664 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d32ec-288b-4b13-8bc9-951d0aba56b6 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:49:13.724040 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 751/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 15:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:49:13.729674 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b959bdf-dc8a-4e5b-bf47-8519b32a01b1 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:49:13.730107 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b959bdf-dc8a-4e5b-bf47-8519b32a01b1 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:49:13.730350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b959bdf-dc8a-4e5b-bf47-8519b32a01b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:49:13.748688 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-3b959bdf-dc8a-4e5b-bf47-8519b32a01b1 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:49:13.749924 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-3b959bdf-dc8a-4e5b-bf47-8519b32a01b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:49:13.757654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 781/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 15:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:49:13.794798 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d32ec-288b-4b13-8bc9-951d0aba56b6 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:49:13.796517 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-432d32ec-288b-4b13-8bc9-951d0aba56b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:49:13.809351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d32ec-288b-4b13-8bc9-951d0aba56b6 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:49:13.812901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79e311-fbbb-43c4-9fdc-cd175c27b5e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:49:13.813540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79e311-fbbb-43c4-9fdc-cd175c27b5e4 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:49:13.813823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79e311-fbbb-43c4-9fdc-cd175c27b5e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:49:13.814132 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79e311-fbbb-43c4-9fdc-cd175c27b5e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:49:13.823628 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79e311-fbbb-43c4-9fdc-cd175c27b5e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:49:13.824990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79e311-fbbb-43c4-9fdc-cd175c27b5e4 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:49:13.834331 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 752/1533] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:49:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:49:17.372497 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dad8cc-7272-4687-8448-3488bb78f8d8 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:49:17.373047 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dad8cc-7272-4687-8448-3488bb78f8d8 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:49:17.373047 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dad8cc-7272-4687-8448-3488bb78f8d8 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:49:17.374466 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 782/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 15:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:49:17.379585 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2461c-b1ba-4b10-b6e0-4f5412d7cd02 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:49:17.380003 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2461c-b1ba-4b10-b6e0-4f5412d7cd02 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:49:17.380191 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2461c-b1ba-4b10-b6e0-4f5412d7cd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:49:17.397960 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-add2461c-b1ba-4b10-b6e0-4f5412d7cd02 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:49:17.399163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-add2461c-b1ba-4b10-b6e0-4f5412d7cd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:49:17.407286 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 753/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 15:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:49:17.718421 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dad8cc-7272-4687-8448-3488bb78f8d8 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:49:17.720093 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-d8dad8cc-7272-4687-8448-3488bb78f8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:49:17.777788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dad8cc-7272-4687-8448-3488bb78f8d8 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:49:17.781405 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2b6b2-d374-444f-8e8d-ecbc0e03e865 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:49:17.782344 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2b6b2-d374-444f-8e8d-ecbc0e03e865 service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:49:17.782631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2b6b2-d374-444f-8e8d-ecbc0e03e865 service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:49:17.782918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2b6b2-d374-444f-8e8d-ecbc0e03e865 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:49:17.792674 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2b6b2-d374-444f-8e8d-ecbc0e03e865 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:49:17.794142 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2b6b2-d374-444f-8e8d-ecbc0e03e865 service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:49:17.803688 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 783/1536] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:49:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:49:19.893489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31a59f-f097-4ff1-a19d-63720505fd93 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:49:19.894088 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31a59f-f097-4ff1-a19d-63720505fd93 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:49:19.894088 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31a59f-f097-4ff1-a19d-63720505fd93 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:49:19.895378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 754/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 15:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:49:19.900591 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57aa704-6583-47ae-b390-b99e4d955518 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:49:19.901048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57aa704-6583-47ae-b390-b99e4d955518 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:49:19.901154 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57aa704-6583-47ae-b390-b99e4d955518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:49:19.920892 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-c57aa704-6583-47ae-b390-b99e4d955518 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:49:19.922149 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-c57aa704-6583-47ae-b390-b99e4d955518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:49:19.929963 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 784/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 15:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:49:20.235748 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31a59f-f097-4ff1-a19d-63720505fd93 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:49:20.237422 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-6f31a59f-f097-4ff1-a19d-63720505fd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:49:20.250820 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31a59f-f097-4ff1-a19d-63720505fd93 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:49:20.254338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55468f3-d44d-4019-b4f7-cc3adccfa6b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:49:20.254973 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55468f3-d44d-4019-b4f7-cc3adccfa6b9 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:49:20.255257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55468f3-d44d-4019-b4f7-cc3adccfa6b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:49:20.255534 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55468f3-d44d-4019-b4f7-cc3adccfa6b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:49:20.264467 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55468f3-d44d-4019-b4f7-cc3adccfa6b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:49:20.265905 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55468f3-d44d-4019-b4f7-cc3adccfa6b9 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:49:20.275225 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 755/1539] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:49:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:49:29.914075 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=32 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:49:30.271197 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=70 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:00.065442 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0437b-cfc0-4376-b51d-f5734fcdabdd None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:00.082125 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0437b-cfc0-4376-b51d-f5734fcdabdd None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:00.082125 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0437b-cfc0-4376-b51d-f5734fcdabdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:00.095884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-86e0437b-cfc0-4376-b51d-f5734fcdabdd None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:00.097789 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-86e0437b-cfc0-4376-b51d-f5734fcdabdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:00.112938 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 785/1540] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:00.123357 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce61101-a9f8-4b39-b3f9-2a0739a37889 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:00.124366 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce61101-a9f8-4b39-b3f9-2a0739a37889 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:00.124366 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce61101-a9f8-4b39-b3f9-2a0739a37889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:00.162847 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-1ce61101-a9f8-4b39-b3f9-2a0739a37889 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:00.164132 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-1ce61101-a9f8-4b39-b3f9-2a0739a37889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:00.177412 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 756/1541] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:00.182585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0437b-cfc0-4376-b51d-f5734fcdabdd None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:00.198505 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0437b-cfc0-4376-b51d-f5734fcdabdd None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:00.209725 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180adb84-28d7-47fa-b4a3-16005a1055e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:00.211115 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180adb84-28d7-47fa-b4a3-16005a1055e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:00.211400 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180adb84-28d7-47fa-b4a3-16005a1055e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:00.211675 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180adb84-28d7-47fa-b4a3-16005a1055e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:00.212423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180adb84-28d7-47fa-b4a3-16005a1055e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:51:00.212732 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180adb84-28d7-47fa-b4a3-16005a1055e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:00.214463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180adb84-28d7-47fa-b4a3-16005a1055e6 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:00.242273 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 786/1542] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:51:00.251140 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce61101-a9f8-4b39-b3f9-2a0739a37889 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:00.269555 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce61101-a9f8-4b39-b3f9-2a0739a37889 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:00.279370 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80019455-ba82-4166-89a6-deaaa8d3a759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:00.280519 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80019455-ba82-4166-89a6-deaaa8d3a759 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:00.281231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80019455-ba82-4166-89a6-deaaa8d3a759 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:00.282077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80019455-ba82-4166-89a6-deaaa8d3a759 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:00.283107 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80019455-ba82-4166-89a6-deaaa8d3a759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:00.285735 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80019455-ba82-4166-89a6-deaaa8d3a759 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:00.331474 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 757/1543] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:00 2022] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:00.335654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180adb84-28d7-47fa-b4a3-16005a1055e6 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:00.367160 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180adb84-28d7-47fa-b4a3-16005a1055e6 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:00.501103 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c051802-14bc-4b70-ac76-8a13213c8b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:00.502061 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c051802-14bc-4b70-ac76-8a13213c8b70 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:00.502447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c051802-14bc-4b70-ac76-8a13213c8b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:00.502975 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c051802-14bc-4b70-ac76-8a13213c8b70 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:00.503805 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c051802-14bc-4b70-ac76-8a13213c8b70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:00.506342 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c051802-14bc-4b70-ac76-8a13213c8b70 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:00.542570 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 787/1544] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:00 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:00.548512 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80019455-ba82-4166-89a6-deaaa8d3a759 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:00.577026 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80019455-ba82-4166-89a6-deaaa8d3a759 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:00.587408 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef3850-7a82-4d33-afc5-911a2d30e2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:00.588705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef3850-7a82-4d33-afc5-911a2d30e2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:00.589309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef3850-7a82-4d33-afc5-911a2d30e2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:00.589826 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef3850-7a82-4d33-afc5-911a2d30e2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:00.590921 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef3850-7a82-4d33-afc5-911a2d30e2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:00.592954 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef3850-7a82-4d33-afc5-911a2d30e2c3 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:00.605997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bda2a8-ecae-4e74-b75d-08ca94788667 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:00.606346 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bda2a8-ecae-4e74-b75d-08ca94788667 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:00.606578 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bda2a8-ecae-4e74-b75d-08ca94788667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:00.610952 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 758/1545] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:00.618520 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef3850-7a82-4d33-afc5-911a2d30e2c3 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:00.631639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef3850-7a82-4d33-afc5-911a2d30e2c3 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:00.643540 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-70bda2a8-ecae-4e74-b75d-08ca94788667 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:00.644845 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-70bda2a8-ecae-4e74-b75d-08ca94788667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:00.646951 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0870db-dc74-4347-8816-9e21ea619f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:00.648684 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0870db-dc74-4347-8816-9e21ea619f1a admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:00.649191 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0870db-dc74-4347-8816-9e21ea619f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:00.649724 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0870db-dc74-4347-8816-9e21ea619f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:00.650705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0870db-dc74-4347-8816-9e21ea619f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:00.652697 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0870db-dc74-4347-8816-9e21ea619f1a admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:00.668674 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 788/1546] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:51:00.673359 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 759/1547] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:00.678934 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bda2a8-ecae-4e74-b75d-08ca94788667 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:00.679933 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d71d3e-e1cd-4391-83e7-7d42ac1acfe5 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:00.680476 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d71d3e-e1cd-4391-83e7-7d42ac1acfe5 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:00.680983 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d71d3e-e1cd-4391-83e7-7d42ac1acfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:00.696521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bda2a8-ecae-4e74-b75d-08ca94788667 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:00.715552 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269a6fb-9be7-4b05-8f2e-f9e1eaf1aed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:00.716705 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269a6fb-9be7-4b05-8f2e-f9e1eaf1aed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:00.716981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269a6fb-9be7-4b05-8f2e-f9e1eaf1aed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:00.717257 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5269a6fb-9be7-4b05-8f2e-f9e1eaf1aed5 admin admin] PATH_INFO: `/v3/projects/621bfa2a49434ddcb0f6b3f5bdbc4ae3/users/fa813b65a2b141ffa2359e5f0b0ae4c0/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:00.717795 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-d1d71d3e-e1cd-4391-83e7-7d42ac1acfe5 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:00.719337 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-d1d71d3e-e1cd-4391-83e7-7d42ac1acfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:00.736259 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 760/1548] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:00.738027 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbe7ed-5dd9-431b-8a6a-e948a0e18a09 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:00.738559 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbe7ed-5dd9-431b-8a6a-e948a0e18a09 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:00.739102 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbe7ed-5dd9-431b-8a6a-e948a0e18a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:00.751034 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269a6fb-9be7-4b05-8f2e-f9e1eaf1aed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=621bfa2a49434ddcb0f6b3f5bdbc4ae3, user_id=fa813b65a2b141ffa2359e5f0b0ae4c0, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:00.752912 dv-cinder-835384-9-smb devstack@keystone.service[91828]: WARNING py.warnings [None req-5269a6fb-9be7-4b05-8f2e-f9e1eaf1aed5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 15:51:00.752912 dv-cinder-835384-9-smb devstack@keystone.service[91828]: warnings.warn(msg) Jun 23 15:51:00.752912 dv-cinder-835384-9-smb devstack@keystone.service[91828]: Jun 23 15:51:00.754288 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5269a6fb-9be7-4b05-8f2e-f9e1eaf1aed5 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:00.781128 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 789/1549] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:00 2022] PUT /identity/v3/projects/621bfa2a49434ddcb0f6b3f5bdbc4ae3/users/fa813b65a2b141ffa2359e5f0b0ae4c0/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:00.782442 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269a6fb-9be7-4b05-8f2e-f9e1eaf1aed5 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:00.785616 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-bddbe7ed-5dd9-431b-8a6a-e948a0e18a09 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:00.787531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-bddbe7ed-5dd9-431b-8a6a-e948a0e18a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:00.900231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5269a6fb-9be7-4b05-8f2e-f9e1eaf1aed5 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:00.914046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc057a-00d9-476d-aaa7-3bdf29a3853b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:00.914765 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc057a-00d9-476d-aaa7-3bdf29a3853b admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:00.915076 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc057a-00d9-476d-aaa7-3bdf29a3853b admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:00.915376 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc057a-00d9-476d-aaa7-3bdf29a3853b admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:00.916321 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc057a-00d9-476d-aaa7-3bdf29a3853b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:51:00.916673 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc057a-00d9-476d-aaa7-3bdf29a3853b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:00.918405 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc057a-00d9-476d-aaa7-3bdf29a3853b admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:00.938878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 761/1550] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:00.939584 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 790/1551] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:51:00.940952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a412bb5-0b7e-4131-aa45-546a29491213 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:00.941271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a412bb5-0b7e-4131-aa45-546a29491213 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:00.941566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a412bb5-0b7e-4131-aa45-546a29491213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:00.942019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51f716-4738-43ca-b08b-9fd4d64e573a None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:00.942625 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51f716-4738-43ca-b08b-9fd4d64e573a None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:00.943118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51f716-4738-43ca-b08b-9fd4d64e573a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:00.968265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-2a412bb5-0b7e-4131-aa45-546a29491213 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:00.970023 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-2a412bb5-0b7e-4131-aa45-546a29491213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:00.970700 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-6b51f716-4738-43ca-b08b-9fd4d64e573a None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:00.972500 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-6b51f716-4738-43ca-b08b-9fd4d64e573a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:00.979264 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 791/1552] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:00.980951 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e25626-1726-4bf3-ae6a-ec779e1b7e08 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:00.981548 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e25626-1726-4bf3-ae6a-ec779e1b7e08 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:00.982099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e25626-1726-4bf3-ae6a-ec779e1b7e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:00.990475 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 762/1553] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:00.992521 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a151780-e4c8-4e65-9fd3-ead98442570c None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:00.993093 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a151780-e4c8-4e65-9fd3-ead98442570c None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:00.993900 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a151780-e4c8-4e65-9fd3-ead98442570c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:01.006553 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-12e25626-1726-4bf3-ae6a-ec779e1b7e08 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:01.008905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-12e25626-1726-4bf3-ae6a-ec779e1b7e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:01.017099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-8a151780-e4c8-4e65-9fd3-ead98442570c None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:01.017333 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 792/1554] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:01.018381 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e25626-1726-4bf3-ae6a-ec779e1b7e08 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:01.019408 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-8a151780-e4c8-4e65-9fd3-ead98442570c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:01.029928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e25626-1726-4bf3-ae6a-ec779e1b7e08 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:01.031048 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 763/1555] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:01.032695 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1f45c-d477-4dd9-abfd-9b929d491bde None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:01.032988 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1f45c-d477-4dd9-abfd-9b929d491bde None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:01.033269 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1f45c-d477-4dd9-abfd-9b929d491bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:01.036267 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d3dbc-0e45-4772-89ff-b840c75fd341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:01.036954 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d3dbc-0e45-4772-89ff-b840c75fd341 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:01.037240 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d3dbc-0e45-4772-89ff-b840c75fd341 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:01.038284 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d3dbc-0e45-4772-89ff-b840c75fd341 admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:01.039346 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d3dbc-0e45-4772-89ff-b840c75fd341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:01.040716 dv-cinder-835384-9-smb devstack@keystone.service[91828]: WARNING py.warnings [None req-f22d3dbc-0e45-4772-89ff-b840c75fd341 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 15:51:01.040716 dv-cinder-835384-9-smb devstack@keystone.service[91828]: warnings.warn(msg) Jun 23 15:51:01.040716 dv-cinder-835384-9-smb devstack@keystone.service[91828]: Jun 23 15:51:01.042390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d3dbc-0e45-4772-89ff-b840c75fd341 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:01.053526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-0af1f45c-d477-4dd9-abfd-9b929d491bde None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:01.056164 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-0af1f45c-d477-4dd9-abfd-9b929d491bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:01.072011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:01.072744 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 764/1556] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:01.073611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2aeb5-f3b4-4238-8d78-f0bb240aa921 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:01.073999 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2aeb5-f3b4-4238-8d78-f0bb240aa921 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:01.074289 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f2aeb5-f3b4-4238-8d78-f0bb240aa921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:01.088538 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 793/1557] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:01 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:01.088538 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d3dbc-0e45-4772-89ff-b840c75fd341 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:01.095100 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-77f2aeb5-f3b4-4238-8d78-f0bb240aa921 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:01.096300 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-77f2aeb5-f3b4-4238-8d78-f0bb240aa921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:01.153490 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d3dbc-0e45-4772-89ff-b840c75fd341 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:01.157697 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672c684-242c-4490-8728-86b6e0664228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:01.158391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672c684-242c-4490-8728-86b6e0664228 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:01.158678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672c684-242c-4490-8728-86b6e0664228 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:01.158960 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672c684-242c-4490-8728-86b6e0664228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:01.163245 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 765/1558] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:01.164805 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acebde8-ca9f-4873-8c13-7ba4e4f306ae None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:01.165239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acebde8-ca9f-4873-8c13-7ba4e4f306ae None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:01.165437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acebde8-ca9f-4873-8c13-7ba4e4f306ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:01.169785 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672c684-242c-4490-8728-86b6e0664228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:01.171312 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672c684-242c-4490-8728-86b6e0664228 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:01.183647 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 794/1559] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:01.184762 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f7a4f-82bd-4683-a77d-262e500c3563 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:01.185060 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f7a4f-82bd-4683-a77d-262e500c3563 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:01.185177 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-6acebde8-ca9f-4873-8c13-7ba4e4f306ae None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:01.185349 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f7a4f-82bd-4683-a77d-262e500c3563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:01.186392 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-6acebde8-ca9f-4873-8c13-7ba4e4f306ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:01.200267 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 766/1560] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:01.200267 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484feb99-a9e6-4ac6-acad-2df70f79d396 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:01.200267 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484feb99-a9e6-4ac6-acad-2df70f79d396 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:01.200267 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484feb99-a9e6-4ac6-acad-2df70f79d396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:01.206910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-a46f7a4f-82bd-4683-a77d-262e500c3563 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:01.208261 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-a46f7a4f-82bd-4683-a77d-262e500c3563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:01.217506 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-484feb99-a9e6-4ac6-acad-2df70f79d396 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:01.218322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 795/1561] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:01.218773 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-484feb99-a9e6-4ac6-acad-2df70f79d396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:01.221312 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9230f9-c59e-4583-a939-ceb97d10756a None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:01.221719 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9230f9-c59e-4583-a939-ceb97d10756a None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:01.222313 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9230f9-c59e-4583-a939-ceb97d10756a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:01.233831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 767/1562] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:01.238283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484feb99-a9e6-4ac6-acad-2df70f79d396 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:01.250479 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484feb99-a9e6-4ac6-acad-2df70f79d396 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:01.252499 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-ef9230f9-c59e-4583-a939-ceb97d10756a None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:01.253824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ef9230f9-c59e-4583-a939-ceb97d10756a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:01.255443 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7bde7-62d4-4d3b-965f-a6bad10a88e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:01.256198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7bde7-62d4-4d3b-965f-a6bad10a88e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:01.256498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7bde7-62d4-4d3b-965f-a6bad10a88e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:01.257031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7bde7-62d4-4d3b-965f-a6bad10a88e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:01.258148 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7bde7-62d4-4d3b-965f-a6bad10a88e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:51:01.258523 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7bde7-62d4-4d3b-965f-a6bad10a88e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:01.259493 dv-cinder-835384-9-smb devstack@keystone.service[91827]: WARNING py.warnings [None req-05d7bde7-62d4-4d3b-965f-a6bad10a88e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 15:51:01.259493 dv-cinder-835384-9-smb devstack@keystone.service[91827]: warnings.warn(msg) Jun 23 15:51:01.259493 dv-cinder-835384-9-smb devstack@keystone.service[91827]: Jun 23 15:51:01.260405 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7bde7-62d4-4d3b-965f-a6bad10a88e7 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:01.270254 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 796/1563] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:01.270254 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9230f9-c59e-4583-a939-ceb97d10756a None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:01.270745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:01.278965 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 768/1564] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:51:01.282814 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23139ef-e0f8-4128-bdb8-bce8f6d2388b None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:01.283210 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23139ef-e0f8-4128-bdb8-bce8f6d2388b None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:01.283721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23139ef-e0f8-4128-bdb8-bce8f6d2388b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:01.293587 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9230f9-c59e-4583-a939-ceb97d10756a None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:01.304208 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e771f2e-be96-477f-9294-5e6e64090499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:01.305798 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e771f2e-be96-477f-9294-5e6e64090499 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:01.306144 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-d23139ef-e0f8-4128-bdb8-bce8f6d2388b None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:01.306565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e771f2e-be96-477f-9294-5e6e64090499 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:01.307296 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e771f2e-be96-477f-9294-5e6e64090499 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:01.307693 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-d23139ef-e0f8-4128-bdb8-bce8f6d2388b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:01.309517 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e771f2e-be96-477f-9294-5e6e64090499 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:01.313194 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e771f2e-be96-477f-9294-5e6e64090499 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:01.319025 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 769/1565] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:01.320546 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23139ef-e0f8-4128-bdb8-bce8f6d2388b None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:01.332982 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23139ef-e0f8-4128-bdb8-bce8f6d2388b None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:01.339292 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc832d-9324-4de6-97f0-6500b59b92f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:01.340435 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc832d-9324-4de6-97f0-6500b59b92f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:01.340813 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc832d-9324-4de6-97f0-6500b59b92f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:01.341275 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc832d-9324-4de6-97f0-6500b59b92f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:01.342208 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc832d-9324-4de6-97f0-6500b59b92f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:51:01.342603 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc832d-9324-4de6-97f0-6500b59b92f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:01.344310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc832d-9324-4de6-97f0-6500b59b92f5 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:01.353473 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 797/1566] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:01 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:01.356484 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90effd9f-befd-4b5a-9f96-2435ee8ffd30 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:01.356995 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90effd9f-befd-4b5a-9f96-2435ee8ffd30 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:01.357521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90effd9f-befd-4b5a-9f96-2435ee8ffd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:01.367216 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 770/1567] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:51:01.367216 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc832d-9324-4de6-97f0-6500b59b92f5 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:01.385714 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc832d-9324-4de6-97f0-6500b59b92f5 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:01.395527 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34de137-222c-4c53-9874-37c987ae693b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:01.397055 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34de137-222c-4c53-9874-37c987ae693b admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:01.397180 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-90effd9f-befd-4b5a-9f96-2435ee8ffd30 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:01.397621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34de137-222c-4c53-9874-37c987ae693b admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:01.398285 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34de137-222c-4c53-9874-37c987ae693b admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:01.399285 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-90effd9f-befd-4b5a-9f96-2435ee8ffd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:01.399638 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34de137-222c-4c53-9874-37c987ae693b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:51:01.400283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34de137-222c-4c53-9874-37c987ae693b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:01.403354 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34de137-222c-4c53-9874-37c987ae693b admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:01.413999 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 798/1568] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:01.415253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90effd9f-befd-4b5a-9f96-2435ee8ffd30 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:01.429925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 771/1569] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:51:01.429925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34de137-222c-4c53-9874-37c987ae693b admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:01.437770 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90effd9f-befd-4b5a-9f96-2435ee8ffd30 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:01.446734 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7945455-30a7-4eec-9aa6-6535e964abc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:01.447320 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34de137-222c-4c53-9874-37c987ae693b admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:01.447588 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7945455-30a7-4eec-9aa6-6535e964abc5 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:01.447930 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7945455-30a7-4eec-9aa6-6535e964abc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:01.448325 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7945455-30a7-4eec-9aa6-6535e964abc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:01.449601 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7945455-30a7-4eec-9aa6-6535e964abc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:51:01.449889 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7945455-30a7-4eec-9aa6-6535e964abc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:01.451664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7945455-30a7-4eec-9aa6-6535e964abc5 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:01.453961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7390d68-24a4-4112-8cb0-50bb1d7c6e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:01.454776 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7390d68-24a4-4112-8cb0-50bb1d7c6e90 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:01.455859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7390d68-24a4-4112-8cb0-50bb1d7c6e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:01.456271 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7390d68-24a4-4112-8cb0-50bb1d7c6e90 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:01.457927 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7390d68-24a4-4112-8cb0-50bb1d7c6e90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:01.460124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7390d68-24a4-4112-8cb0-50bb1d7c6e90 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:01.467232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 799/1570] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:51:01.467969 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7945455-30a7-4eec-9aa6-6535e964abc5 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:01.479232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7945455-30a7-4eec-9aa6-6535e964abc5 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:01.485257 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417db0f-15c0-4342-9525-7bc03661ba48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:01.485257 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417db0f-15c0-4342-9525-7bc03661ba48 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:01.485621 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417db0f-15c0-4342-9525-7bc03661ba48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:01.486561 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417db0f-15c0-4342-9525-7bc03661ba48 admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:01.487031 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417db0f-15c0-4342-9525-7bc03661ba48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:51:01.487334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417db0f-15c0-4342-9525-7bc03661ba48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:01.488995 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417db0f-15c0-4342-9525-7bc03661ba48 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:01.505145 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 800/1571] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:51:01.505837 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417db0f-15c0-4342-9525-7bc03661ba48 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:01.514337 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 772/1572] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:01 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:01.514337 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7390d68-24a4-4112-8cb0-50bb1d7c6e90 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:01.524293 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417db0f-15c0-4342-9525-7bc03661ba48 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:01.600226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7390d68-24a4-4112-8cb0-50bb1d7c6e90 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:01.606852 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61105717-0231-4bc1-8d30-d18293ef23fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:01.607602 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61105717-0231-4bc1-8d30-d18293ef23fd admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:01.607894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61105717-0231-4bc1-8d30-d18293ef23fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:01.608176 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61105717-0231-4bc1-8d30-d18293ef23fd admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:01.608989 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61105717-0231-4bc1-8d30-d18293ef23fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:01.611546 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61105717-0231-4bc1-8d30-d18293ef23fd admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:01.614875 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042c30c-afdd-4a65-9ad2-63d4519214aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:01.615884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042c30c-afdd-4a65-9ad2-63d4519214aa admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:01.616852 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042c30c-afdd-4a65-9ad2-63d4519214aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:01.618028 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042c30c-afdd-4a65-9ad2-63d4519214aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:01.619233 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042c30c-afdd-4a65-9ad2-63d4519214aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:01.621759 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042c30c-afdd-4a65-9ad2-63d4519214aa admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:01.641393 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 801/1573] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:01.646102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042c30c-afdd-4a65-9ad2-63d4519214aa admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:01.651579 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 773/1574] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:01 2022] POST /identity/v3/projects => generated 393 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:01.653344 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61105717-0231-4bc1-8d30-d18293ef23fd admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:01.660248 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042c30c-afdd-4a65-9ad2-63d4519214aa admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:01.714172 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:01.760924 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c8cb2-93a8-4807-8fdf-2e3e72c1961a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:01.761968 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c8cb2-93a8-4807-8fdf-2e3e72c1961a admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:01.762349 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c8cb2-93a8-4807-8fdf-2e3e72c1961a admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:01.762730 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c8cb2-93a8-4807-8fdf-2e3e72c1961a admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:01.763594 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c8cb2-93a8-4807-8fdf-2e3e72c1961a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:51:01.763742 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61105717-0231-4bc1-8d30-d18293ef23fd admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:01.764102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c8cb2-93a8-4807-8fdf-2e3e72c1961a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:01.766217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c8cb2-93a8-4807-8fdf-2e3e72c1961a admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:01.768784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c8b10-37f9-497f-9de3-5747e2975b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:01.769630 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c8b10-37f9-497f-9de3-5747e2975b01 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:01.769908 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c8b10-37f9-497f-9de3-5747e2975b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:01.770339 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c8b10-37f9-497f-9de3-5747e2975b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:01.771064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c8b10-37f9-497f-9de3-5747e2975b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:01.773606 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c8b10-37f9-497f-9de3-5747e2975b01 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:01.782998 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 802/1575] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:51:01.783967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c8cb2-93a8-4807-8fdf-2e3e72c1961a admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:01.798863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c8cb2-93a8-4807-8fdf-2e3e72c1961a admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:01.808359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f2dee-eb19-481d-ae21-77ad0962568f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:01.809292 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f2dee-eb19-481d-ae21-77ad0962568f admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:01.809750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 774/1576] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:01 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:01.809904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f2dee-eb19-481d-ae21-77ad0962568f admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:01.810112 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f2dee-eb19-481d-ae21-77ad0962568f admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:01.810628 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c8b10-37f9-497f-9de3-5747e2975b01 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:01.811070 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f2dee-eb19-481d-ae21-77ad0962568f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:01.813572 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115f2dee-eb19-481d-ae21-77ad0962568f admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:01.828267 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:01.852317 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 803/1577] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:01 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:01.852317 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f2dee-eb19-481d-ae21-77ad0962568f admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:01.907012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c8b10-37f9-497f-9de3-5747e2975b01 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:01.940149 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f2dee-eb19-481d-ae21-77ad0962568f admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:01.948834 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856fb154-345c-4b82-89ea-d2b344df2b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:01.949700 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fb154-345c-4b82-89ea-d2b344df2b31 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:01.950040 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fb154-345c-4b82-89ea-d2b344df2b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:01.950324 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fb154-345c-4b82-89ea-d2b344df2b31 admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:01.951040 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856fb154-345c-4b82-89ea-d2b344df2b31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:01.953001 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856fb154-345c-4b82-89ea-d2b344df2b31 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:01.994532 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 804/1578] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:01 2022] POST /identity/v3/projects => generated 405 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:01.995638 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856fb154-345c-4b82-89ea-d2b344df2b31 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:02.001610 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515616f3-15dc-452f-bb84-9e266065b189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:02.002556 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515616f3-15dc-452f-bb84-9e266065b189 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:02.003193 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515616f3-15dc-452f-bb84-9e266065b189 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:02.003375 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515616f3-15dc-452f-bb84-9e266065b189 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:02.004254 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515616f3-15dc-452f-bb84-9e266065b189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:02.006244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: WARNING py.warnings [None req-515616f3-15dc-452f-bb84-9e266065b189 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 15:51:02.006244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: warnings.warn(msg) Jun 23 15:51:02.006244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: Jun 23 15:51:02.007906 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515616f3-15dc-452f-bb84-9e266065b189 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:02.043445 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 775/1579] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:01 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:02.044225 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515616f3-15dc-452f-bb84-9e266065b189 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:02.058336 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515616f3-15dc-452f-bb84-9e266065b189 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:02.102680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856fb154-345c-4b82-89ea-d2b344df2b31 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:02.108360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715b41b-3d86-4974-ae36-95ff2c218477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:02.109299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715b41b-3d86-4974-ae36-95ff2c218477 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:02.110565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715b41b-3d86-4974-ae36-95ff2c218477 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:02.111141 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6715b41b-3d86-4974-ae36-95ff2c218477 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:02.112134 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715b41b-3d86-4974-ae36-95ff2c218477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:02.114401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6715b41b-3d86-4974-ae36-95ff2c218477 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:02.134137 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 805/1580] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:02.134977 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715b41b-3d86-4974-ae36-95ff2c218477 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:02.146596 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6715b41b-3d86-4974-ae36-95ff2c218477 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:02.153130 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2f2a0-2f0e-453e-af4a-feb0b2ce109d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:02.154151 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2f2a0-2f0e-453e-af4a-feb0b2ce109d admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:02.154578 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2f2a0-2f0e-453e-af4a-feb0b2ce109d admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:02.154870 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2f2a0-2f0e-453e-af4a-feb0b2ce109d admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:02.155575 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2f2a0-2f0e-453e-af4a-feb0b2ce109d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:02.157838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2f2a0-2f0e-453e-af4a-feb0b2ce109d admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:02.164723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b361f79-34f1-49c0-80a3-de839af4c7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:02.165538 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b361f79-34f1-49c0-80a3-de839af4c7b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:02.166173 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b361f79-34f1-49c0-80a3-de839af4c7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:02.166624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b361f79-34f1-49c0-80a3-de839af4c7b1 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:02.167427 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b361f79-34f1-49c0-80a3-de839af4c7b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:02.170057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b361f79-34f1-49c0-80a3-de839af4c7b1 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:02.198275 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 806/1581] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:02 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:02.199205 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2f2a0-2f0e-453e-af4a-feb0b2ce109d admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:02.202018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 776/1582] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:02 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:02.202923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b361f79-34f1-49c0-80a3-de839af4c7b1 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:02.206681 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:02.220397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b361f79-34f1-49c0-80a3-de839af4c7b1 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:02.275677 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:02.294642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2f2a0-2f0e-453e-af4a-feb0b2ce109d admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:02.299979 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef07b6-35b2-45b0-9cea-d4c9b59f6dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:02.300340 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958a442-ad7b-48b3-a183-a51fb0eee972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:02.301319 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958a442-ad7b-48b3-a183-a51fb0eee972 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:02.301453 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef07b6-35b2-45b0-9cea-d4c9b59f6dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:02.301651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef07b6-35b2-45b0-9cea-d4c9b59f6dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:02.301911 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958a442-ad7b-48b3-a183-a51fb0eee972 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:02.302111 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdef07b6-35b2-45b0-9cea-d4c9b59f6dc0 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:02.302377 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958a442-ad7b-48b3-a183-a51fb0eee972 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:02.303159 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef07b6-35b2-45b0-9cea-d4c9b59f6dc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:02.303280 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958a442-ad7b-48b3-a183-a51fb0eee972 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:02.305544 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958a442-ad7b-48b3-a183-a51fb0eee972 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:02.305684 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdef07b6-35b2-45b0-9cea-d4c9b59f6dc0 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:02.333386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 807/1583] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:02 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:02.334614 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958a442-ad7b-48b3-a183-a51fb0eee972 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:02.349540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 777/1584] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:02 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:02.349540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef07b6-35b2-45b0-9cea-d4c9b59f6dc0 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:02.350120 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958a442-ad7b-48b3-a183-a51fb0eee972 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:02.354100 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95041cbe-b938-46aa-af0a-a5fe11846758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:02.355002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95041cbe-b938-46aa-af0a-a5fe11846758 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:02.355434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95041cbe-b938-46aa-af0a-a5fe11846758 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:02.355815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95041cbe-b938-46aa-af0a-a5fe11846758 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:02.356620 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95041cbe-b938-46aa-af0a-a5fe11846758 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:02.358862 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95041cbe-b938-46aa-af0a-a5fe11846758 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:02.364389 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdef07b6-35b2-45b0-9cea-d4c9b59f6dc0 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:02.374967 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517651ad-cef9-4922-a3a0-f14a3c243ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:02.377061 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517651ad-cef9-4922-a3a0-f14a3c243ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:02.377559 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517651ad-cef9-4922-a3a0-f14a3c243ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:02.378845 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517651ad-cef9-4922-a3a0-f14a3c243ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:02.380106 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517651ad-cef9-4922-a3a0-f14a3c243ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:02.382945 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517651ad-cef9-4922-a3a0-f14a3c243ac1 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:02.385423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 808/1585] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:02 2022] POST /identity/v3/users => generated 303 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:02.386393 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95041cbe-b938-46aa-af0a-a5fe11846758 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:02.398645 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 778/1586] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:02.399850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517651ad-cef9-4922-a3a0-f14a3c243ac1 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:02.400918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95041cbe-b938-46aa-af0a-a5fe11846758 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:02.406333 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5351ddb-7dfd-4a50-a20b-2cd665ce05aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:02.407640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5351ddb-7dfd-4a50-a20b-2cd665ce05aa admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:02.408018 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5351ddb-7dfd-4a50-a20b-2cd665ce05aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:02.408379 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5351ddb-7dfd-4a50-a20b-2cd665ce05aa admin admin] PATH_INFO: `/v3/projects/e17ad5c9ec6f48639498f434c3c399cf/users/44a87003378542c19e5e094bc6979f14/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:02.415122 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517651ad-cef9-4922-a3a0-f14a3c243ac1 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:02.423615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec927c9-26ea-4e41-a921-cea652a9a21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:02.424779 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec927c9-26ea-4e41-a921-cea652a9a21f admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:02.425224 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec927c9-26ea-4e41-a921-cea652a9a21f admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:02.425667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec927c9-26ea-4e41-a921-cea652a9a21f admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:02.426598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec927c9-26ea-4e41-a921-cea652a9a21f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:02.427197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5351ddb-7dfd-4a50-a20b-2cd665ce05aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e17ad5c9ec6f48639498f434c3c399cf, user_id=44a87003378542c19e5e094bc6979f14, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:02.429650 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec927c9-26ea-4e41-a921-cea652a9a21f admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:02.430946 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5351ddb-7dfd-4a50-a20b-2cd665ce05aa admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:02.449254 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 809/1587] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:02 2022] PUT /identity/v3/projects/e17ad5c9ec6f48639498f434c3c399cf/users/44a87003378542c19e5e094bc6979f14/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:02.450362 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5351ddb-7dfd-4a50-a20b-2cd665ce05aa admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:02.458908 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 779/1588] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:02 2022] POST /identity/v3/users => generated 294 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:02.460214 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec927c9-26ea-4e41-a921-cea652a9a21f admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:02.471939 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec927c9-26ea-4e41-a921-cea652a9a21f admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:02.542697 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5351ddb-7dfd-4a50-a20b-2cd665ce05aa admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:02.550462 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee861f-8233-483a-9e05-fb86805a1263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:02.551282 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee861f-8233-483a-9e05-fb86805a1263 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:02.551669 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee861f-8233-483a-9e05-fb86805a1263 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:02.552049 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee861f-8233-483a-9e05-fb86805a1263 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:02.552878 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee861f-8233-483a-9e05-fb86805a1263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:02.554679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee861f-8233-483a-9e05-fb86805a1263 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:02.557977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fa73b-1444-443a-a56d-f3f28402bdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:02.559061 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fa73b-1444-443a-a56d-f3f28402bdb3 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:02.559499 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fa73b-1444-443a-a56d-f3f28402bdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:02.559948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fa73b-1444-443a-a56d-f3f28402bdb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:02.560840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fa73b-1444-443a-a56d-f3f28402bdb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:02.566703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4fa73b-1444-443a-a56d-f3f28402bdb3 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:02.572015 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 810/1589] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:02.572015 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee861f-8233-483a-9e05-fb86805a1263 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:02.582425 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee861f-8233-483a-9e05-fb86805a1263 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:02.585495 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 780/1590] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:02.589047 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fa73b-1444-443a-a56d-f3f28402bdb3 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:02.589463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c6c45-b53a-48d4-8fd2-29b05465726b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:02.590402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c6c45-b53a-48d4-8fd2-29b05465726b admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:02.590783 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c6c45-b53a-48d4-8fd2-29b05465726b admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:02.591155 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c6c45-b53a-48d4-8fd2-29b05465726b admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:02.592172 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c6c45-b53a-48d4-8fd2-29b05465726b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:02.594587 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c6c45-b53a-48d4-8fd2-29b05465726b admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:02.602373 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4fa73b-1444-443a-a56d-f3f28402bdb3 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:02.607955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ee46f-3586-45c4-8ef5-75abdd4f7684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:02.608149 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ee46f-3586-45c4-8ef5-75abdd4f7684 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:02.608447 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ee46f-3586-45c4-8ef5-75abdd4f7684 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:02.608737 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ee46f-3586-45c4-8ef5-75abdd4f7684 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:02.609562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ee46f-3586-45c4-8ef5-75abdd4f7684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:02.613451 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ee46f-3586-45c4-8ef5-75abdd4f7684 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:02.614433 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 811/1591] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:02.616639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c6c45-b53a-48d4-8fd2-29b05465726b admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:02.625710 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 781/1592] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:02.625710 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a4035-9067-4735-896d-6a6e1d73e296 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:02.625710 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a4035-9067-4735-896d-6a6e1d73e296 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:02.626543 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a4035-9067-4735-896d-6a6e1d73e296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:02.634087 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c6c45-b53a-48d4-8fd2-29b05465726b admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:02.640523 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f57f3-1161-466e-8548-f07e15b52ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:02.641387 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f57f3-1161-466e-8548-f07e15b52ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:02.641835 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f57f3-1161-466e-8548-f07e15b52ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:02.642316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f57f3-1161-466e-8548-f07e15b52ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:02.643400 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f57f3-1161-466e-8548-f07e15b52ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:02.649314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f57f3-1161-466e-8548-f07e15b52ed3 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:02.660991 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-1a6a4035-9067-4735-896d-6a6e1d73e296 None None] MFA Rules not processed for user `44a87003378542c19e5e094bc6979f14`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:02.662280 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-1a6a4035-9067-4735-896d-6a6e1d73e296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:02.664518 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 812/1593] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:02.665661 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f57f3-1161-466e-8548-f07e15b52ed3 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:02.680395 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f57f3-1161-466e-8548-f07e15b52ed3 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:02.686657 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82887c8b-a6b9-4299-b461-3917e2040f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:02.689891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82887c8b-a6b9-4299-b461-3917e2040f89 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:02.689891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82887c8b-a6b9-4299-b461-3917e2040f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:02.689891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82887c8b-a6b9-4299-b461-3917e2040f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:02.689891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82887c8b-a6b9-4299-b461-3917e2040f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:02.691082 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82887c8b-a6b9-4299-b461-3917e2040f89 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:02.705337 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 813/1594] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:02.705742 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82887c8b-a6b9-4299-b461-3917e2040f89 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:02.718631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82887c8b-a6b9-4299-b461-3917e2040f89 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:02.725149 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186d9ac-bc12-4a11-a86b-6a404a624205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:02.727830 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186d9ac-bc12-4a11-a86b-6a404a624205 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:02.728464 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186d9ac-bc12-4a11-a86b-6a404a624205 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:02.728875 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186d9ac-bc12-4a11-a86b-6a404a624205 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:02.729992 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186d9ac-bc12-4a11-a86b-6a404a624205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:02.734702 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186d9ac-bc12-4a11-a86b-6a404a624205 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:02.754379 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 814/1595] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:02.755522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186d9ac-bc12-4a11-a86b-6a404a624205 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:02.763431 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:02.768078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186d9ac-bc12-4a11-a86b-6a404a624205 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:02.778070 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e49bd-1cb9-4778-bb71-95ba54d48f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:02.778788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e49bd-1cb9-4778-bb71-95ba54d48f71 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:02.779087 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e49bd-1cb9-4778-bb71-95ba54d48f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:02.779418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e49bd-1cb9-4778-bb71-95ba54d48f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:02.780175 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e49bd-1cb9-4778-bb71-95ba54d48f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:02.782537 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e49bd-1cb9-4778-bb71-95ba54d48f71 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:02.782702 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 782/1596] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:02.783733 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a4035-9067-4735-896d-6a6e1d73e296 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:02.809695 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a4035-9067-4735-896d-6a6e1d73e296 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:02.818190 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 815/1597] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:02.818190 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e49bd-1cb9-4778-bb71-95ba54d48f71 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:02.818475 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6b7f8-18eb-4a79-9b31-01cecdcf8055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:02.818763 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6b7f8-18eb-4a79-9b31-01cecdcf8055 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:02.819063 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6b7f8-18eb-4a79-9b31-01cecdcf8055 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:02.819581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6b7f8-18eb-4a79-9b31-01cecdcf8055 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:02.820620 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6b7f8-18eb-4a79-9b31-01cecdcf8055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:02.827871 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6b7f8-18eb-4a79-9b31-01cecdcf8055 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:02.843206 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e49bd-1cb9-4778-bb71-95ba54d48f71 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:02.860928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55952a1a-67ba-4de5-9323-d26e05f81799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:02.861805 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55952a1a-67ba-4de5-9323-d26e05f81799 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:02.862251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55952a1a-67ba-4de5-9323-d26e05f81799 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:02.863305 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55952a1a-67ba-4de5-9323-d26e05f81799 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:02.864957 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55952a1a-67ba-4de5-9323-d26e05f81799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:02.866345 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55952a1a-67ba-4de5-9323-d26e05f81799 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:02.867558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 783/1598] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:02.869810 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6b7f8-18eb-4a79-9b31-01cecdcf8055 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:02.881332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:02.885475 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 816/1599] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:02.891854 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55952a1a-67ba-4de5-9323-d26e05f81799 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:02.892024 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6b7f8-18eb-4a79-9b31-01cecdcf8055 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:02.899657 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4edcb-647e-48a2-a79b-8370fdeba082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:02.900566 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4edcb-647e-48a2-a79b-8370fdeba082 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:02.900849 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4edcb-647e-48a2-a79b-8370fdeba082 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:02.901130 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4edcb-647e-48a2-a79b-8370fdeba082 admin admin] PATH_INFO: `/v3/projects/9d132303353d465bacd773c6d905930e/users/2e4b206a548f420ea5d1d56abd2e2092/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:02.903779 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55952a1a-67ba-4de5-9323-d26e05f81799 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:02.914700 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af81a4f-9ced-45b9-bbcc-ade9e74d6d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:02.916973 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af81a4f-9ced-45b9-bbcc-ade9e74d6d6b admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:02.919889 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af81a4f-9ced-45b9-bbcc-ade9e74d6d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:02.919889 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af81a4f-9ced-45b9-bbcc-ade9e74d6d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:02.921355 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af81a4f-9ced-45b9-bbcc-ade9e74d6d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:02.923457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af81a4f-9ced-45b9-bbcc-ade9e74d6d6b admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:02.929966 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4edcb-647e-48a2-a79b-8370fdeba082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d132303353d465bacd773c6d905930e, user_id=2e4b206a548f420ea5d1d56abd2e2092, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:02.937551 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 817/1600] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:02.939302 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af81a4f-9ced-45b9-bbcc-ade9e74d6d6b admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:02.940529 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4edcb-647e-48a2-a79b-8370fdeba082 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:02.952140 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af81a4f-9ced-45b9-bbcc-ade9e74d6d6b admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:02.966150 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 784/1601] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:02 2022] PUT /identity/v3/projects/9d132303353d465bacd773c6d905930e/users/2e4b206a548f420ea5d1d56abd2e2092/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:02.967539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4edcb-647e-48a2-a79b-8370fdeba082 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:03.052429 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640218e5-ebea-4a2a-93e9-68faad6488dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:03.053333 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640218e5-ebea-4a2a-93e9-68faad6488dd admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:03.053628 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640218e5-ebea-4a2a-93e9-68faad6488dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:03.054501 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640218e5-ebea-4a2a-93e9-68faad6488dd admin admin] PATH_INFO: `/v3/projects/033fb50838fe43b0a216ec516bd1b50a/users/7fe974cf493c4545abc70a6745359a66/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:03.061385 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4edcb-647e-48a2-a79b-8370fdeba082 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:03.067521 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15279e9c-de7d-4f69-a82e-7bf88ae98270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:03.068941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15279e9c-de7d-4f69-a82e-7bf88ae98270 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:03.068941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15279e9c-de7d-4f69-a82e-7bf88ae98270 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:03.069179 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15279e9c-de7d-4f69-a82e-7bf88ae98270 admin admin] PATH_INFO: `/v3/projects/825be9e78f5041f18a9f204f9be507f8/users/65a232a57388409091409128d7dbb56f/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:03.074373 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640218e5-ebea-4a2a-93e9-68faad6488dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=033fb50838fe43b0a216ec516bd1b50a, user_id=7fe974cf493c4545abc70a6745359a66, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:03.077635 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640218e5-ebea-4a2a-93e9-68faad6488dd admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:03.092041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15279e9c-de7d-4f69-a82e-7bf88ae98270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=825be9e78f5041f18a9f204f9be507f8, user_id=65a232a57388409091409128d7dbb56f, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:03.094985 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15279e9c-de7d-4f69-a82e-7bf88ae98270 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:03.096512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 818/1602] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:02 2022] PUT /identity/v3/projects/033fb50838fe43b0a216ec516bd1b50a/users/7fe974cf493c4545abc70a6745359a66/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:03.103612 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655667d-43c7-4301-bbd9-7040247c3504 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:03.104285 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655667d-43c7-4301-bbd9-7040247c3504 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:03.104285 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655667d-43c7-4301-bbd9-7040247c3504 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:03.105933 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 819/1603] 10.222.0.15 () {54 vars in 961 bytes} [Thu Jun 23 15:51:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:51:03.106736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655667d-43c7-4301-bbd9-7040247c3504 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:03.114941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 785/1604] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:02 2022] PUT /identity/v3/projects/825be9e78f5041f18a9f204f9be507f8/users/65a232a57388409091409128d7dbb56f/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:03.116083 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15279e9c-de7d-4f69-a82e-7bf88ae98270 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:03.267672 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655667d-43c7-4301-bbd9-7040247c3504 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:03.267672 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa31928-465b-400d-8210-ee282091fb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:03.267672 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa31928-465b-400d-8210-ee282091fb1e admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:03.267672 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa31928-465b-400d-8210-ee282091fb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:03.273423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa31928-465b-400d-8210-ee282091fb1e admin admin] PATH_INFO: `/v3/projects/e106b6118e4047b29bc6793eba400a27/users/baaf74865f9849e49a7ccf2fe7ecb898/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:03.275071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15279e9c-de7d-4f69-a82e-7bf88ae98270 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:03.275071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d89dc-2976-4bd3-8075-8401bbc70d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:03.275071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d89dc-2976-4bd3-8075-8401bbc70d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:03.275071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d89dc-2976-4bd3-8075-8401bbc70d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:03.275756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d89dc-2976-4bd3-8075-8401bbc70d7b admin admin] PATH_INFO: `/v3/projects/cb73fc5019774c3286a327672f243a66/users/5f09573e623f4f8495434e350b816117/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:03.298618 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d89dc-2976-4bd3-8075-8401bbc70d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb73fc5019774c3286a327672f243a66, user_id=5f09573e623f4f8495434e350b816117, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:03.300423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa31928-465b-400d-8210-ee282091fb1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e106b6118e4047b29bc6793eba400a27, user_id=baaf74865f9849e49a7ccf2fe7ecb898, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:03.301960 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d89dc-2976-4bd3-8075-8401bbc70d7b admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:03.305249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa31928-465b-400d-8210-ee282091fb1e admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:03.322737 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 786/1606] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:03 2022] PUT /identity/v3/projects/cb73fc5019774c3286a327672f243a66/users/5f09573e623f4f8495434e350b816117/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:03.324539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d89dc-2976-4bd3-8075-8401bbc70d7b admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:03.336831 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 820/1606] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:03 2022] PUT /identity/v3/projects/e106b6118e4047b29bc6793eba400a27/users/baaf74865f9849e49a7ccf2fe7ecb898/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:03.336831 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df977f0e-24cf-49b2-b337-3702955c1471 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:03.336831 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df977f0e-24cf-49b2-b337-3702955c1471 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:03.336831 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df977f0e-24cf-49b2-b337-3702955c1471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:03.368075 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-df977f0e-24cf-49b2-b337-3702955c1471 None None] MFA Rules not processed for user `2e4b206a548f420ea5d1d56abd2e2092`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:03.369393 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-df977f0e-24cf-49b2-b337-3702955c1471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:03.403210 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:03.403440 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:03.424700 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d89dc-2976-4bd3-8075-8401bbc70d7b admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:03.452686 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 821/1607] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:03.454339 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6816e1-2c17-4872-862c-f5ee35781379 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:03.454780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6816e1-2c17-4872-862c-f5ee35781379 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:03.455073 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6816e1-2c17-4872-862c-f5ee35781379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:03.492338 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-1e6816e1-2c17-4872-862c-f5ee35781379 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:03.494816 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-1e6816e1-2c17-4872-862c-f5ee35781379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:03.514869 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fd906-934b-4e48-9022-8b2708d2b607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:03.516370 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fd906-934b-4e48-9022-8b2708d2b607 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:03.516822 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fd906-934b-4e48-9022-8b2708d2b607 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:03.517252 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fd906-934b-4e48-9022-8b2708d2b607 admin admin] PATH_INFO: `/v3/projects/e05c3ae4e3d246b88fe785ca0b7fa3a4/users/7e678b395d334be399ecb6af37f9987b/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:03.536535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fd906-934b-4e48-9022-8b2708d2b607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e05c3ae4e3d246b88fe785ca0b7fa3a4, user_id=7e678b395d334be399ecb6af37f9987b, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:03.540509 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fd906-934b-4e48-9022-8b2708d2b607 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:03.558436 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 787/1608] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:03 2022] PUT /identity/v3/projects/e05c3ae4e3d246b88fe785ca0b7fa3a4/users/7e678b395d334be399ecb6af37f9987b/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:03.560007 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32c9ea-023e-49f7-bfc1-6c521cb58fd1 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:03.560318 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32c9ea-023e-49f7-bfc1-6c521cb58fd1 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:03.560599 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32c9ea-023e-49f7-bfc1-6c521cb58fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:03.581121 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 822/1609] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:03.583076 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b1528-e3aa-49d8-8177-8259096eabec None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:03.583592 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b1528-e3aa-49d8-8177-8259096eabec None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:03.583710 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-af32c9ea-023e-49f7-bfc1-6c521cb58fd1 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:03.584149 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b1528-e3aa-49d8-8177-8259096eabec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:03.585637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-af32c9ea-023e-49f7-bfc1-6c521cb58fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:03.608127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-c16b1528-e3aa-49d8-8177-8259096eabec None None] MFA Rules not processed for user `d54521ea1dca44c98d6723d0b9fd6468`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:03.609764 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-c16b1528-e3aa-49d8-8177-8259096eabec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:03.658029 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 788/1610] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:03.660099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0d1fa-0727-42af-a3f7-3868207109e9 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:03.660394 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0d1fa-0727-42af-a3f7-3868207109e9 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:03.660676 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0d1fa-0727-42af-a3f7-3868207109e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:03.680060 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-04d0d1fa-0727-42af-a3f7-3868207109e9 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:03.681254 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-04d0d1fa-0727-42af-a3f7-3868207109e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:03.693929 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 789/1611] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:03.693929 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d331d6-c5eb-4b08-a66b-ea13f5137901 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:03.693929 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d331d6-c5eb-4b08-a66b-ea13f5137901 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:03.693929 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d331d6-c5eb-4b08-a66b-ea13f5137901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:03.711607 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 823/1612] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Jun 23 15:51:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:03.712991 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89777bc8-ca5d-44ad-bbdb-f6a8eaeec958 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:03.713288 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89777bc8-ca5d-44ad-bbdb-f6a8eaeec958 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:03.713576 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89777bc8-ca5d-44ad-bbdb-f6a8eaeec958 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:03.715256 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 824/1613] 10.222.0.15 () {54 vars in 961 bytes} [Thu Jun 23 15:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:51:03.720592 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12692e8d-5da8-43d3-a6d6-d36447b022d6 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:03.720892 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12692e8d-5da8-43d3-a6d6-d36447b022d6 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:03.721182 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12692e8d-5da8-43d3-a6d6-d36447b022d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:03.737936 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-77d331d6-c5eb-4b08-a66b-ea13f5137901 None None] MFA Rules not processed for user `5f09573e623f4f8495434e350b816117`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:03.740259 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-77d331d6-c5eb-4b08-a66b-ea13f5137901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:03.740957 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-12692e8d-5da8-43d3-a6d6-d36447b022d6 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:03.742245 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-12692e8d-5da8-43d3-a6d6-d36447b022d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:03.751257 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 825/1614] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:03.752124 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12692e8d-5da8-43d3-a6d6-d36447b022d6 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:03.830004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12692e8d-5da8-43d3-a6d6-d36447b022d6 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:03.835911 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337717c-5cd9-43df-86b5-974056139540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:03.836951 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337717c-5cd9-43df-86b5-974056139540 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:03.837563 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:03.838100 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337717c-5cd9-43df-86b5-974056139540 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:03.838669 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337717c-5cd9-43df-86b5-974056139540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:03.843619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 790/1615] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:03 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:03.844887 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d331d6-c5eb-4b08-a66b-ea13f5137901 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:03.849331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:03.855911 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337717c-5cd9-43df-86b5-974056139540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:03.858431 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337717c-5cd9-43df-86b5-974056139540 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:03.859067 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d331d6-c5eb-4b08-a66b-ea13f5137901 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:03.867731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ccec5e-71cc-4e3d-9ceb-4811d74e7a25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:03.868581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccec5e-71cc-4e3d-9ceb-4811d74e7a25 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:03.868946 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccec5e-71cc-4e3d-9ceb-4811d74e7a25 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:03.869234 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccec5e-71cc-4e3d-9ceb-4811d74e7a25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:03.873628 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 826/1616] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:03.874733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337717c-5cd9-43df-86b5-974056139540 service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:03.889129 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337717c-5cd9-43df-86b5-974056139540 service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:03.894754 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ccec5e-71cc-4e3d-9ceb-4811d74e7a25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:03.896853 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ccec5e-71cc-4e3d-9ceb-4811d74e7a25 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:03.900042 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979bfb3-7b36-408a-8428-cdd1c23c97d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:03.900896 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979bfb3-7b36-408a-8428-cdd1c23c97d1 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:03.903073 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979bfb3-7b36-408a-8428-cdd1c23c97d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:03.903530 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979bfb3-7b36-408a-8428-cdd1c23c97d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:03.915815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979bfb3-7b36-408a-8428-cdd1c23c97d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:03.917554 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979bfb3-7b36-408a-8428-cdd1c23c97d1 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:03.926941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 791/1617] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:03.929228 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef285a7f-a836-4d9d-a523-43cdf1f73893 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:03.930644 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 827/1618] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:03.931036 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef285a7f-a836-4d9d-a523-43cdf1f73893 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:03.931403 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef285a7f-a836-4d9d-a523-43cdf1f73893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:03.931502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979bfb3-7b36-408a-8428-cdd1c23c97d1 service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:03.955973 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979bfb3-7b36-408a-8428-cdd1c23c97d1 service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:03.968156 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e778b-2291-4666-abe0-b52e6e6ab7a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:03.968791 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-ef285a7f-a836-4d9d-a523-43cdf1f73893 None None] MFA Rules not processed for user `d54521ea1dca44c98d6723d0b9fd6468`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:03.969152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e778b-2291-4666-abe0-b52e6e6ab7a4 service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:03.969152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e778b-2291-4666-abe0-b52e6e6ab7a4 service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:03.969403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e778b-2291-4666-abe0-b52e6e6ab7a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:03.970359 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-ef285a7f-a836-4d9d-a523-43cdf1f73893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:03.983466 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 792/1619] 10.222.0.15 () {58 vars in 1058 bytes} [Thu Jun 23 15:51:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:03.998607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef285a7f-a836-4d9d-a523-43cdf1f73893 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:04.019084 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef285a7f-a836-4d9d-a523-43cdf1f73893 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:04.030018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38778602-fc6f-464d-8879-dd2469e2cf4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:04.030715 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38778602-fc6f-464d-8879-dd2469e2cf4b service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:04.032270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38778602-fc6f-464d-8879-dd2469e2cf4b service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:04.032567 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38778602-fc6f-464d-8879-dd2469e2cf4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:04.064810 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38778602-fc6f-464d-8879-dd2469e2cf4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:04.066316 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38778602-fc6f-464d-8879-dd2469e2cf4b service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:04.070661 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e778b-2291-4666-abe0-b52e6e6ab7a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:04.073658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e778b-2291-4666-abe0-b52e6e6ab7a4 service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:04.092869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 828/1620] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:04.095239 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e778b-2291-4666-abe0-b52e6e6ab7a4 service nova] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:04.104534 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 793/1621] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:04.106161 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38778602-fc6f-464d-8879-dd2469e2cf4b service neutron] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:04.121079 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e778b-2291-4666-abe0-b52e6e6ab7a4 service nova] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:04.125381 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38778602-fc6f-464d-8879-dd2469e2cf4b service neutron] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:04.128587 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a4a3e-9622-42d3-8aa7-f634dd5e3114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:04.129421 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a4a3e-9622-42d3-8aa7-f634dd5e3114 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:04.129712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a4a3e-9622-42d3-8aa7-f634dd5e3114 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:04.130103 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a4a3e-9622-42d3-8aa7-f634dd5e3114 admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:04.130947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a4a3e-9622-42d3-8aa7-f634dd5e3114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:04.133792 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a4a3e-9622-42d3-8aa7-f634dd5e3114 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:04.134648 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6eeeb-21e1-4f47-8177-9c5d76b3b489 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:04.135622 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6eeeb-21e1-4f47-8177-9c5d76b3b489 service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:04.136298 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6eeeb-21e1-4f47-8177-9c5d76b3b489 service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:04.136500 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6eeeb-21e1-4f47-8177-9c5d76b3b489 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:04.195956 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 829/1622] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:04 2022] POST /identity/v3/projects => generated 403 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:04.197216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a4a3e-9622-42d3-8aa7-f634dd5e3114 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:04.252841 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6eeeb-21e1-4f47-8177-9c5d76b3b489 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:04.258390 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6eeeb-21e1-4f47-8177-9c5d76b3b489 service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:04.282584 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 794/1623] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:04.340324 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a4a3e-9622-42d3-8aa7-f634dd5e3114 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:04.349317 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc071c50-f44d-487b-bcc2-69e49a65b5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:04.350093 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc071c50-f44d-487b-bcc2-69e49a65b5b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:04.350366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc071c50-f44d-487b-bcc2-69e49a65b5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:04.350680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc071c50-f44d-487b-bcc2-69e49a65b5b2 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:04.351448 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc071c50-f44d-487b-bcc2-69e49a65b5b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:04.354920 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc071c50-f44d-487b-bcc2-69e49a65b5b2 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:04.388830 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 830/1624] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:04 2022] POST /identity/v3/users => generated 308 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:04.392419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6eeeb-21e1-4f47-8177-9c5d76b3b489 service nova] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:04.405754 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6eeeb-21e1-4f47-8177-9c5d76b3b489 service nova] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:04.414320 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3f1cd-3ae1-4779-9ae7-35366aef2761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:04.415173 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3f1cd-3ae1-4779-9ae7-35366aef2761 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:04.415467 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3f1cd-3ae1-4779-9ae7-35366aef2761 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:04.415747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3f1cd-3ae1-4779-9ae7-35366aef2761 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:04.416492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3f1cd-3ae1-4779-9ae7-35366aef2761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:04.418822 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3f1cd-3ae1-4779-9ae7-35366aef2761 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:04.431912 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 795/1625] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:04.435823 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc071c50-f44d-487b-bcc2-69e49a65b5b2 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:04.448532 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc071c50-f44d-487b-bcc2-69e49a65b5b2 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:04.454413 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac04d6f9-5ea8-4fef-8d24-a42990e80a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:04.455498 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04d6f9-5ea8-4fef-8d24-a42990e80a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:04.455898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04d6f9-5ea8-4fef-8d24-a42990e80a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:04.456289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac04d6f9-5ea8-4fef-8d24-a42990e80a1c admin admin] PATH_INFO: `/v3/projects/4c080ce8a1204b429dd593b04ce5188d/users/ad8065c24be94ee89745e9aa3e5be1d7/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:04.481895 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04d6f9-5ea8-4fef-8d24-a42990e80a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c080ce8a1204b429dd593b04ce5188d, user_id=ad8065c24be94ee89745e9aa3e5be1d7, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:04.486010 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac04d6f9-5ea8-4fef-8d24-a42990e80a1c admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:04.509723 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 831/1626] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:04 2022] PUT /identity/v3/projects/4c080ce8a1204b429dd593b04ce5188d/users/ad8065c24be94ee89745e9aa3e5be1d7/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:51:04.513301 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3f1cd-3ae1-4779-9ae7-35366aef2761 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:04.531101 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3f1cd-3ae1-4779-9ae7-35366aef2761 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:04.664183 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d73861-f72d-4c40-9038-244a3d0e075c None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:04.664920 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d73861-f72d-4c40-9038-244a3d0e075c None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:04.665320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d73861-f72d-4c40-9038-244a3d0e075c None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:04.667481 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 832/1627] 10.222.0.15 () {54 vars in 912 bytes} [Thu Jun 23 15:51:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:51:04.684924 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5efb8-9b6a-4d79-8a5c-28843b9784b1 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:04.686368 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5efb8-9b6a-4d79-8a5c-28843b9784b1 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:04.687072 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5efb8-9b6a-4d79-8a5c-28843b9784b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:04.737069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-40b5efb8-9b6a-4d79-8a5c-28843b9784b1 None None] MFA Rules not processed for user `d54521ea1dca44c98d6723d0b9fd6468`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:04.740815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-40b5efb8-9b6a-4d79-8a5c-28843b9784b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:04.798149 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d896d-8f0f-421c-b879-450b771319d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:04.799768 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d896d-8f0f-421c-b879-450b771319d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:04.800176 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d896d-8f0f-421c-b879-450b771319d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:04.800566 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d896d-8f0f-421c-b879-450b771319d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:04.802684 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d896d-8f0f-421c-b879-450b771319d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:04.804528 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d896d-8f0f-421c-b879-450b771319d6 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:04.809589 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:04.833999 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 796/1628] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:04.840848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d896d-8f0f-421c-b879-450b771319d6 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:04.869547 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d896d-8f0f-421c-b879-450b771319d6 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:04.881462 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d99fdf-0c9d-4bb2-8dba-1a1b196c88d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:04.883020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d99fdf-0c9d-4bb2-8dba-1a1b196c88d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:04.883416 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d99fdf-0c9d-4bb2-8dba-1a1b196c88d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:04.883809 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d99fdf-0c9d-4bb2-8dba-1a1b196c88d0 admin admin] PATH_INFO: `/v3/projects/4c080ce8a1204b429dd593b04ce5188d/users/ad8065c24be94ee89745e9aa3e5be1d7/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:04.888030 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d99fdf-0c9d-4bb2-8dba-1a1b196c88d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c080ce8a1204b429dd593b04ce5188d, user_id=ad8065c24be94ee89745e9aa3e5be1d7, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:04.894106 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d99fdf-0c9d-4bb2-8dba-1a1b196c88d0 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:04.939309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 797/1629] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:04 2022] PUT /identity/v3/projects/4c080ce8a1204b429dd593b04ce5188d/users/ad8065c24be94ee89745e9aa3e5be1d7/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:51:04.950671 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0363b29-daeb-40ed-9d7e-4b97e5028e22 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:04.951319 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0363b29-daeb-40ed-9d7e-4b97e5028e22 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:04.952164 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0363b29-daeb-40ed-9d7e-4b97e5028e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:04.966938 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 833/1630] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 23 15:51:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:04.968179 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5efb8-9b6a-4d79-8a5c-28843b9784b1 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:05.014501 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-f0363b29-daeb-40ed-9d7e-4b97e5028e22 None None] MFA Rules not processed for user `ad8065c24be94ee89745e9aa3e5be1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:05.016069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-f0363b29-daeb-40ed-9d7e-4b97e5028e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:05.074907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:05.130462 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5efb8-9b6a-4d79-8a5c-28843b9784b1 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:05.183899 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 798/1631] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:04 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:51:05.188205 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b692255-195b-4679-a0ab-c7d2560b56b4 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:05.190475 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b692255-195b-4679-a0ab-c7d2560b56b4 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:05.190596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b692255-195b-4679-a0ab-c7d2560b56b4 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:05.195334 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 799/1632] 10.222.0.15 () {54 vars in 912 bytes} [Thu Jun 23 15:51:05 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:51:05.200105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b692255-195b-4679-a0ab-c7d2560b56b4 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:05.277624 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd16e0-9ff3-4a50-b086-60790f44281b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:05.278335 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd16e0-9ff3-4a50-b086-60790f44281b service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:05.278619 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd16e0-9ff3-4a50-b086-60790f44281b service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:05.278896 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd16e0-9ff3-4a50-b086-60790f44281b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:05.362766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b692255-195b-4679-a0ab-c7d2560b56b4 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:05.375125 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b73e3-eb60-48de-9d0e-47a9557e6a03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:05.377392 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b73e3-eb60-48de-9d0e-47a9557e6a03 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:05.378182 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b73e3-eb60-48de-9d0e-47a9557e6a03 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:05.380229 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b73e3-eb60-48de-9d0e-47a9557e6a03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:05.409106 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b73e3-eb60-48de-9d0e-47a9557e6a03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:05.415101 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b73e3-eb60-48de-9d0e-47a9557e6a03 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:05.441788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 800/1633] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:05 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:05.444773 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd16e0-9ff3-4a50-b086-60790f44281b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:05.448028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9f19f-f20f-4c92-b654-0d902e51a58d None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:05.448261 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd16e0-9ff3-4a50-b086-60790f44281b service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:05.449081 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9f19f-f20f-4c92-b654-0d902e51a58d None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:05.450226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9f19f-f20f-4c92-b654-0d902e51a58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:05.480217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 834/1634] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:05.503380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-60d9f19f-f20f-4c92-b654-0d902e51a58d None None] MFA Rules not processed for user `d54521ea1dca44c98d6723d0b9fd6468`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:05.508221 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-60d9f19f-f20f-4c92-b654-0d902e51a58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:05.549076 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 801/1635] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 23 15:51:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:05.610351 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd16e0-9ff3-4a50-b086-60790f44281b service cinder] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:05.623325 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd16e0-9ff3-4a50-b086-60790f44281b service cinder] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:05.649823 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1321968-d458-4e70-a405-236f35fc63ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:05.651069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1321968-d458-4e70-a405-236f35fc63ff service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:05.653380 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1321968-d458-4e70-a405-236f35fc63ff service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:05.655225 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1321968-d458-4e70-a405-236f35fc63ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:05.694031 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1321968-d458-4e70-a405-236f35fc63ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:05.698370 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1321968-d458-4e70-a405-236f35fc63ff service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:05.735736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:05.753280 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 835/1636] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:07.453917 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9f19f-f20f-4c92-b654-0d902e51a58d None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:07.644995 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9f19f-f20f-4c92-b654-0d902e51a58d None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:07.652393 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0887fa1-786d-4fac-a779-6b375a283c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:07.653539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0887fa1-786d-4fac-a779-6b375a283c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:07.654017 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0887fa1-786d-4fac-a779-6b375a283c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:07.654474 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0887fa1-786d-4fac-a779-6b375a283c78 admin admin] PATH_INFO: `/v3/users/5f09573e623f4f8495434e350b816117` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:07.656550 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0887fa1-786d-4fac-a779-6b375a283c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f09573e623f4f8495434e350b816117)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:07.660066 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0887fa1-786d-4fac-a779-6b375a283c78 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:07.779733 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-d0887fa1-786d-4fac-a779-6b375a283c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f09573e623f4f8495434e350b816117'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:07.793941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-d0887fa1-786d-4fac-a779-6b375a283c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f09573e623f4f8495434e350b816117'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:07.796500 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-d0887fa1-786d-4fac-a779-6b375a283c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f09573e623f4f8495434e350b816117'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:07.798493 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-d0887fa1-786d-4fac-a779-6b375a283c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f09573e623f4f8495434e350b816117'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:07.806446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:07.822312 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-d0887fa1-786d-4fac-a779-6b375a283c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f09573e623f4f8495434e350b816117'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:07.843844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 802/1637] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:51:07 2022] DELETE /identity/v3/users/5f09573e623f4f8495434e350b816117 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:07.849895 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41ec8b-e1cf-4914-a0c9-3bec41beabc6 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:07.850472 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41ec8b-e1cf-4914-a0c9-3bec41beabc6 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:07.850472 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41ec8b-e1cf-4914-a0c9-3bec41beabc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:07.897396 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-ad41ec8b-e1cf-4914-a0c9-3bec41beabc6 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:07.902083 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ad41ec8b-e1cf-4914-a0c9-3bec41beabc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:08.040890 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 836/1638] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:08.051238 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0887fa1-786d-4fac-a779-6b375a283c78 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:08.053112 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-d0887fa1-786d-4fac-a779-6b375a283c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:08.169885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0887fa1-786d-4fac-a779-6b375a283c78 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:08.175315 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e796df0-b113-4468-bf53-bcd9893bea90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:08.175991 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e796df0-b113-4468-bf53-bcd9893bea90 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:08.176276 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e796df0-b113-4468-bf53-bcd9893bea90 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:08.176554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e796df0-b113-4468-bf53-bcd9893bea90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:08.192745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e796df0-b113-4468-bf53-bcd9893bea90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:08.194294 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e796df0-b113-4468-bf53-bcd9893bea90 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:08.208700 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 803/1639] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:09.628214 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41ec8b-e1cf-4914-a0c9-3bec41beabc6 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:09.629827 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ad41ec8b-e1cf-4914-a0c9-3bec41beabc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:09.653498 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41ec8b-e1cf-4914-a0c9-3bec41beabc6 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:09.665420 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7995d45-a51b-4569-9c1d-62691e482f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:09.666677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7995d45-a51b-4569-9c1d-62691e482f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:09.667082 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7995d45-a51b-4569-9c1d-62691e482f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:09.667518 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7995d45-a51b-4569-9c1d-62691e482f6d admin admin] PATH_INFO: `/v3/projects/cb73fc5019774c3286a327672f243a66` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:09.670827 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7995d45-a51b-4569-9c1d-62691e482f6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb73fc5019774c3286a327672f243a66)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:09.672929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7995d45-a51b-4569-9c1d-62691e482f6d admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:09.819236 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-e7995d45-a51b-4569-9c1d-62691e482f6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb73fc5019774c3286a327672f243a66', 'request_id': 'req-e7995d45-a51b-4569-9c1d-62691e482f6d'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:09.834032 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-e7995d45-a51b-4569-9c1d-62691e482f6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb73fc5019774c3286a327672f243a66', 'request_id': 'req-e7995d45-a51b-4569-9c1d-62691e482f6d'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:09.870320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-e7995d45-a51b-4569-9c1d-62691e482f6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb73fc5019774c3286a327672f243a66', 'request_id': 'req-e7995d45-a51b-4569-9c1d-62691e482f6d'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:09.900544 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-e7995d45-a51b-4569-9c1d-62691e482f6d admin admin] The token cache is being invalidate because project cb73fc5019774c3286a327672f243a66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:51:09.902198 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-e7995d45-a51b-4569-9c1d-62691e482f6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:09.909135 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-e7995d45-a51b-4569-9c1d-62691e482f6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:09.914819 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 837/1640] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:51:09 2022] DELETE /identity/v3/projects/cb73fc5019774c3286a327672f243a66 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:09.919774 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e796df0-b113-4468-bf53-bcd9893bea90 service neutron] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:09.933197 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e796df0-b113-4468-bf53-bcd9893bea90 service neutron] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:10.150440 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b482d84-b672-43b1-9454-3ae0506429a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:10.151345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b482d84-b672-43b1-9454-3ae0506429a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:10.151629 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b482d84-b672-43b1-9454-3ae0506429a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:10.151912 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b482d84-b672-43b1-9454-3ae0506429a2 admin admin] PATH_INFO: `/v3/users/ad8065c24be94ee89745e9aa3e5be1d7` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:10.155746 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b482d84-b672-43b1-9454-3ae0506429a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad8065c24be94ee89745e9aa3e5be1d7)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:10.158028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b482d84-b672-43b1-9454-3ae0506429a2 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:10.306624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-4b482d84-b672-43b1-9454-3ae0506429a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad8065c24be94ee89745e9aa3e5be1d7'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:10.322601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-4b482d84-b672-43b1-9454-3ae0506429a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad8065c24be94ee89745e9aa3e5be1d7'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:10.324699 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-4b482d84-b672-43b1-9454-3ae0506429a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad8065c24be94ee89745e9aa3e5be1d7'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:10.325968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-4b482d84-b672-43b1-9454-3ae0506429a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad8065c24be94ee89745e9aa3e5be1d7'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:10.377120 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-4b482d84-b672-43b1-9454-3ae0506429a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad8065c24be94ee89745e9aa3e5be1d7'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:10.393670 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:10.407578 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 804/1641] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:51:09 2022] DELETE /identity/v3/users/ad8065c24be94ee89745e9aa3e5be1d7 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:10.953500 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c26b7-b8c9-4d4c-b599-3eee0b1db31e None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:10.955349 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c26b7-b8c9-4d4c-b599-3eee0b1db31e None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:10.955959 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c26b7-b8c9-4d4c-b599-3eee0b1db31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:11.040385 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-6f0c26b7-b8c9-4d4c-b599-3eee0b1db31e None None] MFA Rules not processed for user `fa813b65a2b141ffa2359e5f0b0ae4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:11.041831 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-6f0c26b7-b8c9-4d4c-b599-3eee0b1db31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:11.179314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 838/1642] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:11.186289 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b482d84-b672-43b1-9454-3ae0506429a2 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:11.188776 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-4b482d84-b672-43b1-9454-3ae0506429a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:11.360032 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b482d84-b672-43b1-9454-3ae0506429a2 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:11.373149 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb6126-c42f-4393-83bd-1c5833df392a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:11.373995 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb6126-c42f-4393-83bd-1c5833df392a service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:11.374351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb6126-c42f-4393-83bd-1c5833df392a service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:11.374697 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb6126-c42f-4393-83bd-1c5833df392a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:11.387170 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb6126-c42f-4393-83bd-1c5833df392a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:11.389311 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb6126-c42f-4393-83bd-1c5833df392a service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:11.423876 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 805/1643] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:11.592228 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c26b7-b8c9-4d4c-b599-3eee0b1db31e None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:11.593720 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-6f0c26b7-b8c9-4d4c-b599-3eee0b1db31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:11.635367 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:11.791276 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c26b7-b8c9-4d4c-b599-3eee0b1db31e None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:11.804148 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a22f40-98e2-4de1-81cc-c423c5e786b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:11.805063 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a22f40-98e2-4de1-81cc-c423c5e786b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:11.805348 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a22f40-98e2-4de1-81cc-c423c5e786b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:11.805609 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a22f40-98e2-4de1-81cc-c423c5e786b2 admin admin] PATH_INFO: `/v3/users/2e4b206a548f420ea5d1d56abd2e2092` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:11.810421 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a22f40-98e2-4de1-81cc-c423c5e786b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e4b206a548f420ea5d1d56abd2e2092)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:11.811496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: WARNING py.warnings [None req-41a22f40-98e2-4de1-81cc-c423c5e786b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 15:51:11.811496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: warnings.warn(msg) Jun 23 15:51:11.811496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: Jun 23 15:51:11.812735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a22f40-98e2-4de1-81cc-c423c5e786b2 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:11.986552 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-41a22f40-98e2-4de1-81cc-c423c5e786b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e4b206a548f420ea5d1d56abd2e2092'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:12.005727 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-41a22f40-98e2-4de1-81cc-c423c5e786b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e4b206a548f420ea5d1d56abd2e2092'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:12.007527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-41a22f40-98e2-4de1-81cc-c423c5e786b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e4b206a548f420ea5d1d56abd2e2092'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:12.008307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-41a22f40-98e2-4de1-81cc-c423c5e786b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e4b206a548f420ea5d1d56abd2e2092'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:12.046480 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-41a22f40-98e2-4de1-81cc-c423c5e786b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e4b206a548f420ea5d1d56abd2e2092'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:12.097650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 839/1644] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:51:11 2022] DELETE /identity/v3/users/2e4b206a548f420ea5d1d56abd2e2092 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:12.106008 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd651e-bec2-4fff-a1c1-fe0f9b8131a0 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:12.106478 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd651e-bec2-4fff-a1c1-fe0f9b8131a0 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:12.106826 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd651e-bec2-4fff-a1c1-fe0f9b8131a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:12.141420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-13dd651e-bec2-4fff-a1c1-fe0f9b8131a0 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:12.148634 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-13dd651e-bec2-4fff-a1c1-fe0f9b8131a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:12.288367 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 806/1645] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:12.322821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a22f40-98e2-4de1-81cc-c423c5e786b2 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:12.324555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-41a22f40-98e2-4de1-81cc-c423c5e786b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:12.488240 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a22f40-98e2-4de1-81cc-c423c5e786b2 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:12.498504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe03f6-726c-4bea-a7da-31a5b96808e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:12.499183 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe03f6-726c-4bea-a7da-31a5b96808e1 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:12.499622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe03f6-726c-4bea-a7da-31a5b96808e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:12.499911 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe03f6-726c-4bea-a7da-31a5b96808e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:12.523639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe03f6-726c-4bea-a7da-31a5b96808e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:12.525177 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe03f6-726c-4bea-a7da-31a5b96808e1 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:12.552028 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 840/1646] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:12.911210 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd651e-bec2-4fff-a1c1-fe0f9b8131a0 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:12.915906 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-13dd651e-bec2-4fff-a1c1-fe0f9b8131a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:12.938973 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd651e-bec2-4fff-a1c1-fe0f9b8131a0 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:12.972423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a121734-2e91-4b53-b598-7e03430098ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:12.974165 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a121734-2e91-4b53-b598-7e03430098ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:12.974605 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a121734-2e91-4b53-b598-7e03430098ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:12.974896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a121734-2e91-4b53-b598-7e03430098ef admin admin] PATH_INFO: `/v3/projects/4c080ce8a1204b429dd593b04ce5188d` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:12.977490 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a121734-2e91-4b53-b598-7e03430098ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c080ce8a1204b429dd593b04ce5188d)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:12.978723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: WARNING py.warnings [None req-2a121734-2e91-4b53-b598-7e03430098ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 15:51:12.978723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: warnings.warn(msg) Jun 23 15:51:12.978723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: Jun 23 15:51:12.980448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a121734-2e91-4b53-b598-7e03430098ef admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:13.114819 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-2a121734-2e91-4b53-b598-7e03430098ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c080ce8a1204b429dd593b04ce5188d', 'request_id': 'req-2a121734-2e91-4b53-b598-7e03430098ef'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:13.136757 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-2a121734-2e91-4b53-b598-7e03430098ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c080ce8a1204b429dd593b04ce5188d', 'request_id': 'req-2a121734-2e91-4b53-b598-7e03430098ef'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:13.169341 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-2a121734-2e91-4b53-b598-7e03430098ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c080ce8a1204b429dd593b04ce5188d', 'request_id': 'req-2a121734-2e91-4b53-b598-7e03430098ef'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:13.192983 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-2a121734-2e91-4b53-b598-7e03430098ef admin admin] The token cache is being invalidate because project 4c080ce8a1204b429dd593b04ce5188d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:51:13.193940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-2a121734-2e91-4b53-b598-7e03430098ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:13.195651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-2a121734-2e91-4b53-b598-7e03430098ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:13.201353 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 807/1647] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:51:12 2022] DELETE /identity/v3/projects/4c080ce8a1204b429dd593b04ce5188d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:13.207629 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12838345-943c-41ac-95e8-5d0471c66ff7 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:13.208447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12838345-943c-41ac-95e8-5d0471c66ff7 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:13.208860 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12838345-943c-41ac-95e8-5d0471c66ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:13.255490 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-12838345-943c-41ac-95e8-5d0471c66ff7 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:13.258358 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-12838345-943c-41ac-95e8-5d0471c66ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:13.363585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:13.502899 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 841/1648] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:13.506123 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169c4c0-a41a-45ee-8100-63bcd3b6640b None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:13.506640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169c4c0-a41a-45ee-8100-63bcd3b6640b None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:13.506723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169c4c0-a41a-45ee-8100-63bcd3b6640b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:13.605268 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-2169c4c0-a41a-45ee-8100-63bcd3b6640b None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:13.606593 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-2169c4c0-a41a-45ee-8100-63bcd3b6640b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:13.644034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 808/1649] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:13.650549 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12838345-943c-41ac-95e8-5d0471c66ff7 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:13.666128 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12838345-943c-41ac-95e8-5d0471c66ff7 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:13.677246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4ca83-1747-410e-a2dc-a7677c49c748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:13.677998 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4ca83-1747-410e-a2dc-a7677c49c748 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:13.678289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4ca83-1747-410e-a2dc-a7677c49c748 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:13.678631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4ca83-1747-410e-a2dc-a7677c49c748 admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:13.681129 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4ca83-1747-410e-a2dc-a7677c49c748 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:51:13.681831 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4ca83-1747-410e-a2dc-a7677c49c748 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:13.698043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4ca83-1747-410e-a2dc-a7677c49c748 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:13.754707 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 842/1650] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:51:13.755964 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169c4c0-a41a-45ee-8100-63bcd3b6640b None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:13.761664 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:13.775559 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169c4c0-a41a-45ee-8100-63bcd3b6640b None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:13.793677 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68c4f4-7d28-47d4-a84c-6532ae971084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:13.794655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68c4f4-7d28-47d4-a84c-6532ae971084 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:13.794952 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68c4f4-7d28-47d4-a84c-6532ae971084 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:13.795239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68c4f4-7d28-47d4-a84c-6532ae971084 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:13.796150 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68c4f4-7d28-47d4-a84c-6532ae971084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:13.803048 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d68c4f4-7d28-47d4-a84c-6532ae971084 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:13.884384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 809/1651] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:13 2022] POST /identity/v3/projects => generated 389 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:13.888215 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4ca83-1747-410e-a2dc-a7677c49c748 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:13.927924 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4ca83-1747-410e-a2dc-a7677c49c748 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:14.170066 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2b684-4cd9-44f4-83ef-2a89aea85a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:14.170791 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2b684-4cd9-44f4-83ef-2a89aea85a59 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:14.171079 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2b684-4cd9-44f4-83ef-2a89aea85a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:14.171363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2b684-4cd9-44f4-83ef-2a89aea85a59 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:14.172134 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2b684-4cd9-44f4-83ef-2a89aea85a59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:14.174290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2b684-4cd9-44f4-83ef-2a89aea85a59 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:14.233272 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 843/1652] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:13 2022] POST /identity/v3/users => generated 295 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:14.235122 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68c4f4-7d28-47d4-a84c-6532ae971084 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:14.269753 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68c4f4-7d28-47d4-a84c-6532ae971084 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:14.284601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915e36d-21f0-46cf-b2d9-4647cdb7bf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:14.285331 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915e36d-21f0-46cf-b2d9-4647cdb7bf05 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:14.285618 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915e36d-21f0-46cf-b2d9-4647cdb7bf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:14.285978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8915e36d-21f0-46cf-b2d9-4647cdb7bf05 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:14.287139 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915e36d-21f0-46cf-b2d9-4647cdb7bf05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:14.293019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8915e36d-21f0-46cf-b2d9-4647cdb7bf05 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:14.335890 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 810/1653] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:14.339630 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2b684-4cd9-44f4-83ef-2a89aea85a59 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:14.355382 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2b684-4cd9-44f4-83ef-2a89aea85a59 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:14.371133 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c5b17-870e-4b0f-9ca7-3e0bb827b0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:14.372166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c5b17-870e-4b0f-9ca7-3e0bb827b0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:14.372635 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c5b17-870e-4b0f-9ca7-3e0bb827b0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:14.373094 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c5b17-870e-4b0f-9ca7-3e0bb827b0f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:14.374083 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c5b17-870e-4b0f-9ca7-3e0bb827b0f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:14.375984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c5b17-870e-4b0f-9ca7-3e0bb827b0f4 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:14.407944 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 844/1654] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:14.408601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915e36d-21f0-46cf-b2d9-4647cdb7bf05 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:14.434746 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8915e36d-21f0-46cf-b2d9-4647cdb7bf05 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:14.449006 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fb329-c011-448c-97ea-82f128b4855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:14.450319 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fb329-c011-448c-97ea-82f128b4855c admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:14.450758 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fb329-c011-448c-97ea-82f128b4855c admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:14.451041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fb329-c011-448c-97ea-82f128b4855c admin admin] PATH_INFO: `/v3/projects/571bded6fbc44ffeb05e1980593118fa/users/0ef8c0eb69964e3cb6d8bf80055272ba/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:14.503955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759fb329-c011-448c-97ea-82f128b4855c admin admin] RBAC: Authorizing `identity:create_grant(project_id=571bded6fbc44ffeb05e1980593118fa, user_id=0ef8c0eb69964e3cb6d8bf80055272ba, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:14.506777 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759fb329-c011-448c-97ea-82f128b4855c admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:14.544198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 811/1655] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:14 2022] PUT /identity/v3/projects/571bded6fbc44ffeb05e1980593118fa/users/0ef8c0eb69964e3cb6d8bf80055272ba/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:51:14.553175 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93628a5c-57ac-4bdd-b709-19fe0d7c0594 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:14.553598 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93628a5c-57ac-4bdd-b709-19fe0d7c0594 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:14.554338 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93628a5c-57ac-4bdd-b709-19fe0d7c0594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:14.591730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fb329-c011-448c-97ea-82f128b4855c admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:14.594383 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-759fb329-c011-448c-97ea-82f128b4855c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:14.618952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-93628a5c-57ac-4bdd-b709-19fe0d7c0594 None None] MFA Rules not processed for user `0ef8c0eb69964e3cb6d8bf80055272ba`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:14.620577 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-93628a5c-57ac-4bdd-b709-19fe0d7c0594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:14.736124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759fb329-c011-448c-97ea-82f128b4855c admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:14.753007 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab037c1-8c34-4d17-ac62-b6be23988e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:14.753942 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab037c1-8c34-4d17-ac62-b6be23988e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:14.754381 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab037c1-8c34-4d17-ac62-b6be23988e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:14.754824 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab037c1-8c34-4d17-ac62-b6be23988e52 admin admin] PATH_INFO: `/v3/users/44a87003378542c19e5e094bc6979f14` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:14.756683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab037c1-8c34-4d17-ac62-b6be23988e52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44a87003378542c19e5e094bc6979f14)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:14.759076 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab037c1-8c34-4d17-ac62-b6be23988e52 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:14.820506 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 845/1656] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:14.827321 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93628a5c-57ac-4bdd-b709-19fe0d7c0594 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:14.864687 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-4ab037c1-8c34-4d17-ac62-b6be23988e52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44a87003378542c19e5e094bc6979f14'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:14.869615 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93628a5c-57ac-4bdd-b709-19fe0d7c0594 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:14.886980 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-4ab037c1-8c34-4d17-ac62-b6be23988e52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44a87003378542c19e5e094bc6979f14'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:14.891308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-4ab037c1-8c34-4d17-ac62-b6be23988e52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44a87003378542c19e5e094bc6979f14'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:14.891440 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7362a29-a7dd-4f0f-b4c5-be533a46490b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:14.892126 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7362a29-a7dd-4f0f-b4c5-be533a46490b admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:14.892730 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7362a29-a7dd-4f0f-b4c5-be533a46490b admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:14.892730 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7362a29-a7dd-4f0f-b4c5-be533a46490b admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:14.893308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-4ab037c1-8c34-4d17-ac62-b6be23988e52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44a87003378542c19e5e094bc6979f14'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:14.893408 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7362a29-a7dd-4f0f-b4c5-be533a46490b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:14.895344 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7362a29-a7dd-4f0f-b4c5-be533a46490b admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:14.932844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-4ab037c1-8c34-4d17-ac62-b6be23988e52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44a87003378542c19e5e094bc6979f14'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:14.962982 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 812/1657] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:51:14 2022] DELETE /identity/v3/users/44a87003378542c19e5e094bc6979f14 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:51:14.964048 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab037c1-8c34-4d17-ac62-b6be23988e52 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:14.965525 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-4ab037c1-8c34-4d17-ac62-b6be23988e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:14.979347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 846/1658] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:14 2022] POST /identity/v3/projects => generated 389 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:14.980853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634bc7c-d556-4bbc-be8e-adff4e2906c8 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:14.981142 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634bc7c-d556-4bbc-be8e-adff4e2906c8 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:14.981421 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634bc7c-d556-4bbc-be8e-adff4e2906c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:15.020110 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-9634bc7c-d556-4bbc-be8e-adff4e2906c8 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:15.021362 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-9634bc7c-d556-4bbc-be8e-adff4e2906c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:15.031978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:15.033363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:15.119811 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab037c1-8c34-4d17-ac62-b6be23988e52 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:15.228043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 847/1659] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:15.229337 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634bc7c-d556-4bbc-be8e-adff4e2906c8 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:15.238495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-9634bc7c-d556-4bbc-be8e-adff4e2906c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:15.268504 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c34d14-efac-464a-9f2f-ec11fa7f7495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:15.269724 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c34d14-efac-464a-9f2f-ec11fa7f7495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:15.270135 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c34d14-efac-464a-9f2f-ec11fa7f7495 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:15.270418 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c34d14-efac-464a-9f2f-ec11fa7f7495 admin admin] PATH_INFO: `/v3/projects/9d132303353d465bacd773c6d905930e` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:15.271838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c34d14-efac-464a-9f2f-ec11fa7f7495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d132303353d465bacd773c6d905930e)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:15.277366 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c34d14-efac-464a-9f2f-ec11fa7f7495 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:15.315748 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634bc7c-d556-4bbc-be8e-adff4e2906c8 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:15.341015 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89e401-bfaf-45b5-9115-af465f93d761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:15.341734 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89e401-bfaf-45b5-9115-af465f93d761 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:15.342062 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89e401-bfaf-45b5-9115-af465f93d761 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:15.342353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b89e401-bfaf-45b5-9115-af465f93d761 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:15.343065 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89e401-bfaf-45b5-9115-af465f93d761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:15.345080 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b89e401-bfaf-45b5-9115-af465f93d761 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:15.378038 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-79c34d14-efac-464a-9f2f-ec11fa7f7495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d132303353d465bacd773c6d905930e', 'request_id': 'req-79c34d14-efac-464a-9f2f-ec11fa7f7495'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:15.398698 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-79c34d14-efac-464a-9f2f-ec11fa7f7495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d132303353d465bacd773c6d905930e', 'request_id': 'req-79c34d14-efac-464a-9f2f-ec11fa7f7495'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:15.417254 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-79c34d14-efac-464a-9f2f-ec11fa7f7495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d132303353d465bacd773c6d905930e', 'request_id': 'req-79c34d14-efac-464a-9f2f-ec11fa7f7495'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:15.429406 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 848/1660] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:15 2022] POST /identity/v3/users => generated 301 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:15.430401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89e401-bfaf-45b5-9115-af465f93d761 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:15.437391 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-79c34d14-efac-464a-9f2f-ec11fa7f7495 admin admin] The token cache is being invalidate because project 9d132303353d465bacd773c6d905930e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:51:15.437508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-79c34d14-efac-464a-9f2f-ec11fa7f7495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:15.438289 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-79c34d14-efac-464a-9f2f-ec11fa7f7495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:15.439618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5b89e401-bfaf-45b5-9115-af465f93d761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:15.440566 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 813/1661] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:51:14 2022] DELETE /identity/v3/projects/9d132303353d465bacd773c6d905930e => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:15.441693 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c34d14-efac-464a-9f2f-ec11fa7f7495 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:15.450938 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-79c34d14-efac-464a-9f2f-ec11fa7f7495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:15.575549 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c34d14-efac-464a-9f2f-ec11fa7f7495 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:15.603160 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89ad85-5819-4552-8fe7-5450544cdf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:15.604184 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89ad85-5819-4552-8fe7-5450544cdf70 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:15.604292 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89ad85-5819-4552-8fe7-5450544cdf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:15.605757 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89ad85-5819-4552-8fe7-5450544cdf70 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:15.606630 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89ad85-5819-4552-8fe7-5450544cdf70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:15.608928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b89e401-bfaf-45b5-9115-af465f93d761 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:15.612215 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89ad85-5819-4552-8fe7-5450544cdf70 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:15.618841 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:15.649844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 814/1662] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:15.654797 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ff990-b70d-4a21-94f9-75b3df428bab None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:15.655090 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ff990-b70d-4a21-94f9-75b3df428bab None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:15.655375 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ff990-b70d-4a21-94f9-75b3df428bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:15.697710 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2297f-598e-444e-8791-4278a144e117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:15.698858 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2297f-598e-444e-8791-4278a144e117 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:15.699398 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2297f-598e-444e-8791-4278a144e117 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:15.699993 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2297f-598e-444e-8791-4278a144e117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:15.704357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-01b2297f-598e-444e-8791-4278a144e117 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:15.705570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-bb4ff990-b70d-4a21-94f9-75b3df428bab None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:15.715548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-bb4ff990-b70d-4a21-94f9-75b3df428bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:15.729345 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2297f-598e-444e-8791-4278a144e117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:15.730966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b2297f-598e-444e-8791-4278a144e117 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:15.754263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 815/1663] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:15.754263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ff990-b70d-4a21-94f9-75b3df428bab None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:15.754529 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 849/1664] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:15.761833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c29f6-a9f2-4b03-a755-151efa6a6c20 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:15.762158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c29f6-a9f2-4b03-a755-151efa6a6c20 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:15.762605 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c29f6-a9f2-4b03-a755-151efa6a6c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:15.780954 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ff990-b70d-4a21-94f9-75b3df428bab None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:15.797805 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1a71b-848e-4e66-a849-8f6d5d92cc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:15.798768 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1a71b-848e-4e66-a849-8f6d5d92cc95 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:15.799059 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1a71b-848e-4e66-a849-8f6d5d92cc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:15.799341 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1a71b-848e-4e66-a849-8f6d5d92cc95 admin admin] PATH_INFO: `/v3/projects/6af9a160d12a405a938865c1be5122b1/users/968a8dae10234e5aaffc8f513e74c625/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:15.800613 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-e24c29f6-a9f2-4b03-a755-151efa6a6c20 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:15.808643 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e24c29f6-a9f2-4b03-a755-151efa6a6c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:15.827897 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 850/1665] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:15.830231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c29f6-a9f2-4b03-a755-151efa6a6c20 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:15.831878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1a71b-848e-4e66-a849-8f6d5d92cc95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af9a160d12a405a938865c1be5122b1, user_id=968a8dae10234e5aaffc8f513e74c625, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:15.835112 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1a71b-848e-4e66-a849-8f6d5d92cc95 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:15.853501 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c29f6-a9f2-4b03-a755-151efa6a6c20 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:15.865351 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c0fa1-a7f8-41c1-b4f6-0cdf5422e813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:15.866840 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c0fa1-a7f8-41c1-b4f6-0cdf5422e813 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:15.867182 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c0fa1-a7f8-41c1-b4f6-0cdf5422e813 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:15.867474 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c0fa1-a7f8-41c1-b4f6-0cdf5422e813 admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:15.868427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c0fa1-a7f8-41c1-b4f6-0cdf5422e813 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:51:15.868797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c0fa1-a7f8-41c1-b4f6-0cdf5422e813 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:15.871967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c0fa1-a7f8-41c1-b4f6-0cdf5422e813 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:15.872176 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 816/1666] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:15 2022] PUT /identity/v3/projects/6af9a160d12a405a938865c1be5122b1/users/968a8dae10234e5aaffc8f513e74c625/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:15.876147 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1a71b-848e-4e66-a849-8f6d5d92cc95 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:15.911146 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 851/1667] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:51:15.913901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c0fa1-a7f8-41c1-b4f6-0cdf5422e813 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:15.927726 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c0fa1-a7f8-41c1-b4f6-0cdf5422e813 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:15.971354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:16.037000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cc56c-01ba-4bc7-88a2-4753e2637a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:16.038460 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1a71b-848e-4e66-a849-8f6d5d92cc95 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:16.039015 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cc56c-01ba-4bc7-88a2-4753e2637a83 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:16.039785 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cc56c-01ba-4bc7-88a2-4753e2637a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:16.040367 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cc56c-01ba-4bc7-88a2-4753e2637a83 admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:16.041649 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cc56c-01ba-4bc7-88a2-4753e2637a83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:16.044061 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780232a-fd97-4418-bb85-f4739aed9e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:16.044587 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cc56c-01ba-4bc7-88a2-4753e2637a83 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:16.045167 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780232a-fd97-4418-bb85-f4739aed9e64 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:16.045525 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780232a-fd97-4418-bb85-f4739aed9e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:16.045967 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780232a-fd97-4418-bb85-f4739aed9e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:16.046912 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780232a-fd97-4418-bb85-f4739aed9e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:16.048576 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780232a-fd97-4418-bb85-f4739aed9e64 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:16.085705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 817/1668] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 15:51:16.089084 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780232a-fd97-4418-bb85-f4739aed9e64 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:16.102314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 852/1669] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:15 2022] POST /identity/v3/projects => generated 369 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:16.104459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cc56c-01ba-4bc7-88a2-4753e2637a83 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:16.120466 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780232a-fd97-4418-bb85-f4739aed9e64 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:16.282281 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cc56c-01ba-4bc7-88a2-4753e2637a83 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:16.284099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640d83a-44f2-4355-a445-fe9c44aaeddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:16.285047 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640d83a-44f2-4355-a445-fe9c44aaeddd admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:16.285337 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640d83a-44f2-4355-a445-fe9c44aaeddd admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:16.285622 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640d83a-44f2-4355-a445-fe9c44aaeddd admin admin] PATH_INFO: `/v3/projects/6af9a160d12a405a938865c1be5122b1/users/968a8dae10234e5aaffc8f513e74c625/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:16.289494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640d83a-44f2-4355-a445-fe9c44aaeddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af9a160d12a405a938865c1be5122b1, user_id=968a8dae10234e5aaffc8f513e74c625, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:16.295351 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe135d82-d573-4413-9e1d-45ee4c8bd961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:16.296056 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe135d82-d573-4413-9e1d-45ee4c8bd961 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:16.296344 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe135d82-d573-4413-9e1d-45ee4c8bd961 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:16.296699 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe135d82-d573-4413-9e1d-45ee4c8bd961 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:16.297345 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe135d82-d573-4413-9e1d-45ee4c8bd961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:16.298619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640d83a-44f2-4355-a445-fe9c44aaeddd admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:16.303061 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe135d82-d573-4413-9e1d-45ee4c8bd961 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:16.330629 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 818/1670] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:16 2022] PUT /identity/v3/projects/6af9a160d12a405a938865c1be5122b1/users/968a8dae10234e5aaffc8f513e74c625/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:16.346780 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebec700-2e0d-4840-89ab-280fcd6779f3 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:16.347074 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebec700-2e0d-4840-89ab-280fcd6779f3 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:16.347363 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebec700-2e0d-4840-89ab-280fcd6779f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:16.348940 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 853/1671] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:16 2022] POST /identity/v3/users => generated 285 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:16.352245 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe135d82-d573-4413-9e1d-45ee4c8bd961 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:16.376432 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe135d82-d573-4413-9e1d-45ee4c8bd961 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:16.408677 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-8ebec700-2e0d-4840-89ab-280fcd6779f3 None None] MFA Rules not processed for user `968a8dae10234e5aaffc8f513e74c625`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:16.415029 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-8ebec700-2e0d-4840-89ab-280fcd6779f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:16.522999 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7fd61f-0c72-43de-8d7f-00d1209680e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:16.526428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fd61f-0c72-43de-8d7f-00d1209680e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:16.526807 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fd61f-0c72-43de-8d7f-00d1209680e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:16.527167 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fd61f-0c72-43de-8d7f-00d1209680e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:16.528678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7fd61f-0c72-43de-8d7f-00d1209680e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:16.533245 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7fd61f-0c72-43de-8d7f-00d1209680e7 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:16.535909 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:16.561596 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 854/1672] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:16.568141 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7fd61f-0c72-43de-8d7f-00d1209680e7 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:16.586747 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7fd61f-0c72-43de-8d7f-00d1209680e7 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:16.598321 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 819/1673] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:16 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:16.599528 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e5a2a-3f27-4b9d-b4d5-5464ac1c00e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:16.601064 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e5a2a-3f27-4b9d-b4d5-5464ac1c00e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:16.601361 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e5a2a-3f27-4b9d-b4d5-5464ac1c00e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:16.601647 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e5a2a-3f27-4b9d-b4d5-5464ac1c00e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:16.602430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e5a2a-3f27-4b9d-b4d5-5464ac1c00e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:16.604198 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e5a2a-3f27-4b9d-b4d5-5464ac1c00e8 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:16.609811 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebec700-2e0d-4840-89ab-280fcd6779f3 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:16.611735 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-8ebec700-2e0d-4840-89ab-280fcd6779f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:16.652724 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 855/1674] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:16.657965 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e5a2a-3f27-4b9d-b4d5-5464ac1c00e8 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:16.686677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e5a2a-3f27-4b9d-b4d5-5464ac1c00e8 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:16.700549 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbec0b-ffaa-4b70-b712-6adf290609d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:16.708387 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbec0b-ffaa-4b70-b712-6adf290609d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:16.708690 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbec0b-ffaa-4b70-b712-6adf290609d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:16.708982 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbec0b-ffaa-4b70-b712-6adf290609d2 admin admin] PATH_INFO: `/v3/projects/eab4e160e2c54a16a0b496a37d4e4692/users/e0750ed4cc2f49d0bccba2c14d59b651/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:16.747834 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbec0b-ffaa-4b70-b712-6adf290609d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eab4e160e2c54a16a0b496a37d4e4692, user_id=e0750ed4cc2f49d0bccba2c14d59b651, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:16.756788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbec0b-ffaa-4b70-b712-6adf290609d2 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:16.767846 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebec700-2e0d-4840-89ab-280fcd6779f3 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:16.773463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea0ca2-6773-4fc3-9a98-5ee80b10552d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:16.774235 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea0ca2-6773-4fc3-9a98-5ee80b10552d service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:16.774599 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea0ca2-6773-4fc3-9a98-5ee80b10552d service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:16.775926 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea0ca2-6773-4fc3-9a98-5ee80b10552d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:16.784169 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 856/1675] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:16 2022] PUT /identity/v3/projects/eab4e160e2c54a16a0b496a37d4e4692/users/e0750ed4cc2f49d0bccba2c14d59b651/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:16.797659 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000637a-ea49-44da-9e0b-bad94b7917a6 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:16.798066 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000637a-ea49-44da-9e0b-bad94b7917a6 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:16.798538 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000637a-ea49-44da-9e0b-bad94b7917a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:16.811984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:16.824403 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea0ca2-6773-4fc3-9a98-5ee80b10552d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:16.827701 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea0ca2-6773-4fc3-9a98-5ee80b10552d service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:16.844227 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 820/1676] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:51:16.846578 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-b000637a-ea49-44da-9e0b-bad94b7917a6 None None] MFA Rules not processed for user `e0750ed4cc2f49d0bccba2c14d59b651`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:16.847885 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-b000637a-ea49-44da-9e0b-bad94b7917a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:16.935179 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 857/1677] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:51:16.937027 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea0ca2-6773-4fc3-9a98-5ee80b10552d service cinder] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:16.962502 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea0ca2-6773-4fc3-9a98-5ee80b10552d service cinder] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:17.095378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000637a-ea49-44da-9e0b-bad94b7917a6 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:17.120813 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300fa1d-e199-4da0-a6b2-b8b1a57a08f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:17.121519 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300fa1d-e199-4da0-a6b2-b8b1a57a08f6 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:17.121811 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300fa1d-e199-4da0-a6b2-b8b1a57a08f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:17.122134 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300fa1d-e199-4da0-a6b2-b8b1a57a08f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:17.124546 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300fa1d-e199-4da0-a6b2-b8b1a57a08f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:17.127718 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300fa1d-e199-4da0-a6b2-b8b1a57a08f6 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:17.192281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 821/1678] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:16 2022] POST /identity/v3/projects => generated 369 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:17.195824 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300fa1d-e199-4da0-a6b2-b8b1a57a08f6 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:17.305217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000637a-ea49-44da-9e0b-bad94b7917a6 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:17.356122 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300fa1d-e199-4da0-a6b2-b8b1a57a08f6 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:17.368808 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc18f8e-91e3-4a8b-97d3-5cc177eada9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:17.369682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc18f8e-91e3-4a8b-97d3-5cc177eada9c admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:17.371101 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc18f8e-91e3-4a8b-97d3-5cc177eada9c admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:17.371410 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc18f8e-91e3-4a8b-97d3-5cc177eada9c admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:17.373237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc18f8e-91e3-4a8b-97d3-5cc177eada9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:17.378807 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc18f8e-91e3-4a8b-97d3-5cc177eada9c admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:17.420764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:17.431183 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 822/1679] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:17 2022] POST /identity/v3/users => generated 291 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:17.432717 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc18f8e-91e3-4a8b-97d3-5cc177eada9c admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:17.454912 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc18f8e-91e3-4a8b-97d3-5cc177eada9c admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:17.463927 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1825437-909f-4732-a8bf-e6b82d1bb9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:17.466879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3449c66-d40e-4c8a-be60-278b9e9d6b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:17.467573 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3449c66-d40e-4c8a-be60-278b9e9d6b88 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:17.467786 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1825437-909f-4732-a8bf-e6b82d1bb9d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:17.467890 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3449c66-d40e-4c8a-be60-278b9e9d6b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:17.468127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3449c66-d40e-4c8a-be60-278b9e9d6b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:17.468438 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1825437-909f-4732-a8bf-e6b82d1bb9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:17.468854 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1825437-909f-4732-a8bf-e6b82d1bb9d8 admin admin] PATH_INFO: `/v3/users/0ef8c0eb69964e3cb6d8bf80055272ba` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:17.468967 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3449c66-d40e-4c8a-be60-278b9e9d6b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:17.472156 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1825437-909f-4732-a8bf-e6b82d1bb9d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ef8c0eb69964e3cb6d8bf80055272ba)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:17.473452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3449c66-d40e-4c8a-be60-278b9e9d6b88 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:17.476208 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1825437-909f-4732-a8bf-e6b82d1bb9d8 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:17.505472 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 823/1680] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:17.508893 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3449c66-d40e-4c8a-be60-278b9e9d6b88 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:17.538878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3449c66-d40e-4c8a-be60-278b9e9d6b88 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:17.553725 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b5545-9c1d-408c-91d8-bcaf774fe96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:17.558398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b5545-9c1d-408c-91d8-bcaf774fe96f admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:17.558808 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b5545-9c1d-408c-91d8-bcaf774fe96f admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:17.559110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b5545-9c1d-408c-91d8-bcaf774fe96f admin admin] PATH_INFO: `/v3/projects/a966bd22b37d4863875e6ebd727ec83c/users/617086781441406bab74d7867387734f/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:17.595277 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:17.599311 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b1825437-909f-4732-a8bf-e6b82d1bb9d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ef8c0eb69964e3cb6d8bf80055272ba'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:17.603124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b5545-9c1d-408c-91d8-bcaf774fe96f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a966bd22b37d4863875e6ebd727ec83c, user_id=617086781441406bab74d7867387734f, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:17.613958 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b5545-9c1d-408c-91d8-bcaf774fe96f admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:17.617440 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b1825437-909f-4732-a8bf-e6b82d1bb9d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ef8c0eb69964e3cb6d8bf80055272ba'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:17.618740 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b1825437-909f-4732-a8bf-e6b82d1bb9d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ef8c0eb69964e3cb6d8bf80055272ba'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:17.620174 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b1825437-909f-4732-a8bf-e6b82d1bb9d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ef8c0eb69964e3cb6d8bf80055272ba'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:17.646568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 824/1681] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:17 2022] PUT /identity/v3/projects/a966bd22b37d4863875e6ebd727ec83c/users/617086781441406bab74d7867387734f/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:17.651369 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b5545-9c1d-408c-91d8-bcaf774fe96f admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:17.656331 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-179b5545-9c1d-408c-91d8-bcaf774fe96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:17.657270 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b1825437-909f-4732-a8bf-e6b82d1bb9d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ef8c0eb69964e3cb6d8bf80055272ba'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:17.684422 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 858/1682] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:51:17 2022] DELETE /identity/v3/users/0ef8c0eb69964e3cb6d8bf80055272ba => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:17.690249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49500040-ed91-4079-abfe-b8564e153282 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:17.690763 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49500040-ed91-4079-abfe-b8564e153282 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:17.691126 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49500040-ed91-4079-abfe-b8564e153282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:17.742625 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-49500040-ed91-4079-abfe-b8564e153282 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:17.744015 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-49500040-ed91-4079-abfe-b8564e153282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:17.820800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b5545-9c1d-408c-91d8-bcaf774fe96f admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:17.917774 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 859/1683] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:17.959340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18634c9-bae8-431f-8155-37e1f601aab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:17.961441 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18634c9-bae8-431f-8155-37e1f601aab9 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:17.961441 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18634c9-bae8-431f-8155-37e1f601aab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:17.961598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18634c9-bae8-431f-8155-37e1f601aab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:17.963724 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18634c9-bae8-431f-8155-37e1f601aab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:17.963992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18634c9-bae8-431f-8155-37e1f601aab9 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:17.971701 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49500040-ed91-4079-abfe-b8564e153282 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:17.974586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-49500040-ed91-4079-abfe-b8564e153282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:17.997311 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 825/1684] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:17.998608 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18634c9-bae8-431f-8155-37e1f601aab9 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:18.012795 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18634c9-bae8-431f-8155-37e1f601aab9 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:18.029497 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf37d4-9d48-4a83-ac7c-a7d58badb8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:18.030455 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf37d4-9d48-4a83-ac7c-a7d58badb8b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:18.030742 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf37d4-9d48-4a83-ac7c-a7d58badb8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:18.031020 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf37d4-9d48-4a83-ac7c-a7d58badb8b8 admin admin] PATH_INFO: `/v3/projects/a966bd22b37d4863875e6ebd727ec83c/users/617086781441406bab74d7867387734f/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:18.033352 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf37d4-9d48-4a83-ac7c-a7d58badb8b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a966bd22b37d4863875e6ebd727ec83c, user_id=617086781441406bab74d7867387734f, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:18.036056 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf37d4-9d48-4a83-ac7c-a7d58badb8b8 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:18.072439 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 826/1685] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:17 2022] PUT /identity/v3/projects/a966bd22b37d4863875e6ebd727ec83c/users/617086781441406bab74d7867387734f/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:18.074281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65b8ab-67dc-4cfe-a6b1-6395d72978d8 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:18.074580 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65b8ab-67dc-4cfe-a6b1-6395d72978d8 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:18.074864 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65b8ab-67dc-4cfe-a6b1-6395d72978d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:18.123059 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49500040-ed91-4079-abfe-b8564e153282 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:18.125312 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-0c65b8ab-67dc-4cfe-a6b1-6395d72978d8 None None] MFA Rules not processed for user `617086781441406bab74d7867387734f`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:18.126596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-0c65b8ab-67dc-4cfe-a6b1-6395d72978d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:18.225923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:18.258452 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23fe925-ed2e-4498-9cec-c04d597af44e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:18.259439 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fe925-ed2e-4498-9cec-c04d597af44e service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:18.261441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fe925-ed2e-4498-9cec-c04d597af44e service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:18.262188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23fe925-ed2e-4498-9cec-c04d597af44e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:18.278996 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 827/1686] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:18 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:18.293288 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65b8ab-67dc-4cfe-a6b1-6395d72978d8 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:18.294802 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-0c65b8ab-67dc-4cfe-a6b1-6395d72978d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:18.360132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:18.431693 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65b8ab-67dc-4cfe-a6b1-6395d72978d8 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:18.432967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23fe925-ed2e-4498-9cec-c04d597af44e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:18.434713 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23fe925-ed2e-4498-9cec-c04d597af44e service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:18.441517 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afafa89-22c6-463d-9813-63bb1f3ef077 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:18.442247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afafa89-22c6-463d-9813-63bb1f3ef077 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:18.442532 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afafa89-22c6-463d-9813-63bb1f3ef077 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:18.442813 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afafa89-22c6-463d-9813-63bb1f3ef077 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:18.463720 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 860/1687] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:18.467705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afafa89-22c6-463d-9813-63bb1f3ef077 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:18.470163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afafa89-22c6-463d-9813-63bb1f3ef077 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:18.498476 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 828/1688] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:18 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:51:19.004761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff7512-e7e6-440d-b4c3-a9cd4f3602ec None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:19.005125 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff7512-e7e6-440d-b4c3-a9cd4f3602ec None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:19.006178 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff7512-e7e6-440d-b4c3-a9cd4f3602ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:19.090752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-d3ff7512-e7e6-440d-b4c3-a9cd4f3602ec None None] MFA Rules not processed for user `baaf74865f9849e49a7ccf2fe7ecb898`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:19.092952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-d3ff7512-e7e6-440d-b4c3-a9cd4f3602ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:19.318192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 861/1689] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:19.337202 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afafa89-22c6-463d-9813-63bb1f3ef077 service cinder] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:19.344582 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-1afafa89-22c6-463d-9813-63bb1f3ef077 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:19.467662 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff7512-e7e6-440d-b4c3-a9cd4f3602ec None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:19.471144 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-d3ff7512-e7e6-440d-b4c3-a9cd4f3602ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:19.514418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff7512-e7e6-440d-b4c3-a9cd4f3602ec None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:19.534297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cc73e-d075-4773-af84-f9f6db7b5343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:19.538702 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cc73e-d075-4773-af84-f9f6db7b5343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:19.539357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cc73e-d075-4773-af84-f9f6db7b5343 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:19.540515 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cc73e-d075-4773-af84-f9f6db7b5343 admin admin] PATH_INFO: `/v3/projects/e17ad5c9ec6f48639498f434c3c399cf` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:19.544151 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9cc73e-d075-4773-af84-f9f6db7b5343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e17ad5c9ec6f48639498f434c3c399cf)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:19.550178 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9cc73e-d075-4773-af84-f9f6db7b5343 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:19.624113 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afafa89-22c6-463d-9813-63bb1f3ef077 service cinder] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:19.655759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d489810-fc06-4951-adda-073983c533d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:19.657046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d489810-fc06-4951-adda-073983c533d0 service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:19.657543 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d489810-fc06-4951-adda-073983c533d0 service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:19.658112 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d489810-fc06-4951-adda-073983c533d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:19.690815 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d489810-fc06-4951-adda-073983c533d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:19.692478 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d489810-fc06-4951-adda-073983c533d0 service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:19.696175 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-fa9cc73e-d075-4773-af84-f9f6db7b5343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e17ad5c9ec6f48639498f434c3c399cf', 'request_id': 'req-fa9cc73e-d075-4773-af84-f9f6db7b5343'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:19.724670 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-fa9cc73e-d075-4773-af84-f9f6db7b5343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e17ad5c9ec6f48639498f434c3c399cf', 'request_id': 'req-fa9cc73e-d075-4773-af84-f9f6db7b5343'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:19.725576 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 829/1690] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:19.745583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-fa9cc73e-d075-4773-af84-f9f6db7b5343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e17ad5c9ec6f48639498f434c3c399cf', 'request_id': 'req-fa9cc73e-d075-4773-af84-f9f6db7b5343'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:19.795949 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-fa9cc73e-d075-4773-af84-f9f6db7b5343 admin admin] The token cache is being invalidate because project e17ad5c9ec6f48639498f434c3c399cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:51:19.797005 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-fa9cc73e-d075-4773-af84-f9f6db7b5343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:19.800089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-fa9cc73e-d075-4773-af84-f9f6db7b5343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:19.828103 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 862/1691] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:51:19 2022] DELETE /identity/v3/projects/e17ad5c9ec6f48639498f434c3c399cf => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:19.828308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21182db1-5873-4200-80ce-273e8e6e9488 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:19.828764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21182db1-5873-4200-80ce-273e8e6e9488 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:19.829189 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21182db1-5873-4200-80ce-273e8e6e9488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:19.872045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-21182db1-5873-4200-80ce-273e8e6e9488 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:19.873325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-21182db1-5873-4200-80ce-273e8e6e9488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:20.071885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 830/1692] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:20.081298 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755b212-1fcf-439d-aee5-49b1b63babe6 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:20.081769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755b212-1fcf-439d-aee5-49b1b63babe6 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:20.082477 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755b212-1fcf-439d-aee5-49b1b63babe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:20.134262 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-3755b212-1fcf-439d-aee5-49b1b63babe6 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:20.135977 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-3755b212-1fcf-439d-aee5-49b1b63babe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:20.200493 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21182db1-5873-4200-80ce-273e8e6e9488 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:20.205472 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 863/1693] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:20.212900 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21182db1-5873-4200-80ce-273e8e6e9488 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:20.239333 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096e2b4-0ceb-42dc-a208-7ab051ee978f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:20.240037 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096e2b4-0ceb-42dc-a208-7ab051ee978f admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:20.240302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096e2b4-0ceb-42dc-a208-7ab051ee978f admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:20.240578 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0096e2b4-0ceb-42dc-a208-7ab051ee978f admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:20.242005 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096e2b4-0ceb-42dc-a208-7ab051ee978f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:51:20.242577 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096e2b4-0ceb-42dc-a208-7ab051ee978f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:20.244306 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0096e2b4-0ceb-42dc-a208-7ab051ee978f admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:20.248546 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:20.301809 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755b212-1fcf-439d-aee5-49b1b63babe6 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:20.312921 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 831/1694] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:51:20.329332 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755b212-1fcf-439d-aee5-49b1b63babe6 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:20.343221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c4ff5-5909-444f-a8d3-cc57f3bdaab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:20.345509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c4ff5-5909-444f-a8d3-cc57f3bdaab8 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:20.345899 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c4ff5-5909-444f-a8d3-cc57f3bdaab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:20.346314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c4ff5-5909-444f-a8d3-cc57f3bdaab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:20.347105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c4ff5-5909-444f-a8d3-cc57f3bdaab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:20.353196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c4ff5-5909-444f-a8d3-cc57f3bdaab8 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:20.422131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096e2b4-0ceb-42dc-a208-7ab051ee978f admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:20.422730 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 864/1695] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:20 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:20.440917 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0096e2b4-0ceb-42dc-a208-7ab051ee978f admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:20.610023 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbba6a-6522-4ce4-8b18-10f9af7b71d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:20.610653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbba6a-6522-4ce4-8b18-10f9af7b71d9 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:20.610946 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbba6a-6522-4ce4-8b18-10f9af7b71d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:20.611253 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbba6a-6522-4ce4-8b18-10f9af7b71d9 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:20.614511 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbba6a-6522-4ce4-8b18-10f9af7b71d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:20.616758 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbba6a-6522-4ce4-8b18-10f9af7b71d9 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:20.673218 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 832/1696] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:20 2022] POST /identity/v3/users => generated 286 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:20.677361 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c4ff5-5909-444f-a8d3-cc57f3bdaab8 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:20.689031 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c4ff5-5909-444f-a8d3-cc57f3bdaab8 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:20.715240 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa3c46-786b-48c5-8273-8c735acc161c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:20.715940 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa3c46-786b-48c5-8273-8c735acc161c admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:20.716435 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa3c46-786b-48c5-8273-8c735acc161c admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:20.716587 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa3c46-786b-48c5-8273-8c735acc161c admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:20.717351 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa3c46-786b-48c5-8273-8c735acc161c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:20.719651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa3c46-786b-48c5-8273-8c735acc161c admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:20.751176 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 865/1697] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:20.755028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbba6a-6522-4ce4-8b18-10f9af7b71d9 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:20.778377 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbba6a-6522-4ce4-8b18-10f9af7b71d9 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:20.796013 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8b55d-9954-4117-870b-b2952dc21458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:20.796853 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8b55d-9954-4117-870b-b2952dc21458 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:20.797216 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8b55d-9954-4117-870b-b2952dc21458 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:20.797629 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8b55d-9954-4117-870b-b2952dc21458 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:20.800507 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8b55d-9954-4117-870b-b2952dc21458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:20.802334 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8b55d-9954-4117-870b-b2952dc21458 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:20.825920 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 833/1698] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:20.829908 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa3c46-786b-48c5-8273-8c735acc161c admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:20.836226 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:20.859314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa3c46-786b-48c5-8273-8c735acc161c admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:20.873744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1aeb2e-0ee0-43cb-85ce-04a2ea7710e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:20.877888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1aeb2e-0ee0-43cb-85ce-04a2ea7710e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:20.878453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1aeb2e-0ee0-43cb-85ce-04a2ea7710e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:20.879321 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1aeb2e-0ee0-43cb-85ce-04a2ea7710e0 admin admin] PATH_INFO: `/v3/projects/9a559f5a108d408eb2e002a6ab8de616/users/d4bf26ceac6c4dedbcd2e1650b7c3125/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:20.926367 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1aeb2e-0ee0-43cb-85ce-04a2ea7710e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a559f5a108d408eb2e002a6ab8de616, user_id=d4bf26ceac6c4dedbcd2e1650b7c3125, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:20.930126 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1aeb2e-0ee0-43cb-85ce-04a2ea7710e0 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:20.959336 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 866/1699] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:20 2022] PUT /identity/v3/projects/9a559f5a108d408eb2e002a6ab8de616/users/d4bf26ceac6c4dedbcd2e1650b7c3125/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:20.970865 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01021cc5-7282-4013-92f9-54b9f66debef None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:20.971469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01021cc5-7282-4013-92f9-54b9f66debef None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:20.971895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01021cc5-7282-4013-92f9-54b9f66debef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:21.036986 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-01021cc5-7282-4013-92f9-54b9f66debef None None] MFA Rules not processed for user `d4bf26ceac6c4dedbcd2e1650b7c3125`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:21.038621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-01021cc5-7282-4013-92f9-54b9f66debef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:21.197209 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 834/1700] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:21.213568 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1aeb2e-0ee0-43cb-85ce-04a2ea7710e0 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:21.215357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-9a1aeb2e-0ee0-43cb-85ce-04a2ea7710e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:21.293347 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01021cc5-7282-4013-92f9-54b9f66debef None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:21.296279 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-01021cc5-7282-4013-92f9-54b9f66debef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:21.456653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01021cc5-7282-4013-92f9-54b9f66debef None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:21.468511 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f86ae-e843-4976-bab3-65c2cdd0b327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:21.469811 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f86ae-e843-4976-bab3-65c2cdd0b327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:21.470382 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f86ae-e843-4976-bab3-65c2cdd0b327 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:21.470863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f86ae-e843-4976-bab3-65c2cdd0b327 admin admin] PATH_INFO: `/v3/projects/571bded6fbc44ffeb05e1980593118fa` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:21.475161 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f86ae-e843-4976-bab3-65c2cdd0b327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=571bded6fbc44ffeb05e1980593118fa)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:21.482236 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f86ae-e843-4976-bab3-65c2cdd0b327 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:21.498843 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1aeb2e-0ee0-43cb-85ce-04a2ea7710e0 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:21.499936 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:21.522525 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0b38b-a6c5-47ff-bb96-9e82754d911d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:21.524130 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0b38b-a6c5-47ff-bb96-9e82754d911d service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:21.524453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0b38b-a6c5-47ff-bb96-9e82754d911d service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:21.524721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0b38b-a6c5-47ff-bb96-9e82754d911d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:21.553831 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0b38b-a6c5-47ff-bb96-9e82754d911d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:21.556033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0b38b-a6c5-47ff-bb96-9e82754d911d service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:21.589980 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 867/1701] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:21.609902 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-527f86ae-e843-4976-bab3-65c2cdd0b327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '571bded6fbc44ffeb05e1980593118fa', 'request_id': 'req-527f86ae-e843-4976-bab3-65c2cdd0b327'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:21.642485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-527f86ae-e843-4976-bab3-65c2cdd0b327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '571bded6fbc44ffeb05e1980593118fa', 'request_id': 'req-527f86ae-e843-4976-bab3-65c2cdd0b327'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:21.680933 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-527f86ae-e843-4976-bab3-65c2cdd0b327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '571bded6fbc44ffeb05e1980593118fa', 'request_id': 'req-527f86ae-e843-4976-bab3-65c2cdd0b327'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:21.723232 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-527f86ae-e843-4976-bab3-65c2cdd0b327 admin admin] The token cache is being invalidate because project 571bded6fbc44ffeb05e1980593118fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:51:21.723552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-527f86ae-e843-4976-bab3-65c2cdd0b327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:21.726033 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-527f86ae-e843-4976-bab3-65c2cdd0b327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:21.733014 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 835/1702] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:51:21 2022] DELETE /identity/v3/projects/571bded6fbc44ffeb05e1980593118fa => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:21.734629 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0b38b-a6c5-47ff-bb96-9e82754d911d service nova] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:21.755432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f86ae-e843-4976-bab3-65c2cdd0b327 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:21.756648 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-527f86ae-e843-4976-bab3-65c2cdd0b327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:21.766619 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0b38b-a6c5-47ff-bb96-9e82754d911d service nova] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:21.968184 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f86ae-e843-4976-bab3-65c2cdd0b327 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:21.987804 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f7c40-d683-495c-affe-cc524223efaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:21.992589 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f7c40-d683-495c-affe-cc524223efaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:21.994797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f7c40-d683-495c-affe-cc524223efaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:21.996685 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f7c40-d683-495c-affe-cc524223efaa admin admin] PATH_INFO: `/v3/users/968a8dae10234e5aaffc8f513e74c625` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:21.998272 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eeb662-5f9a-4bce-bf73-ea08568dcfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:21.999210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f7c40-d683-495c-affe-cc524223efaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=968a8dae10234e5aaffc8f513e74c625)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:22.001518 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eeb662-5f9a-4bce-bf73-ea08568dcfc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:22.003766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eeb662-5f9a-4bce-bf73-ea08568dcfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:22.007161 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eeb662-5f9a-4bce-bf73-ea08568dcfc6 admin admin] PATH_INFO: `/v3/users/e0750ed4cc2f49d0bccba2c14d59b651` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:22.010970 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f7c40-d683-495c-affe-cc524223efaa admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:22.012476 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eeb662-5f9a-4bce-bf73-ea08568dcfc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0750ed4cc2f49d0bccba2c14d59b651)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:22.022654 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eeb662-5f9a-4bce-bf73-ea08568dcfc6 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:22.134819 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d93f7c40-d683-495c-affe-cc524223efaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '968a8dae10234e5aaffc8f513e74c625'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:22.139396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e1eeb662-5f9a-4bce-bf73-ea08568dcfc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0750ed4cc2f49d0bccba2c14d59b651'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:22.147451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d93f7c40-d683-495c-affe-cc524223efaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '968a8dae10234e5aaffc8f513e74c625'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:22.150260 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d93f7c40-d683-495c-affe-cc524223efaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '968a8dae10234e5aaffc8f513e74c625'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:22.152682 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d93f7c40-d683-495c-affe-cc524223efaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '968a8dae10234e5aaffc8f513e74c625'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:22.154770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e1eeb662-5f9a-4bce-bf73-ea08568dcfc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0750ed4cc2f49d0bccba2c14d59b651'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:22.156363 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e1eeb662-5f9a-4bce-bf73-ea08568dcfc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0750ed4cc2f49d0bccba2c14d59b651'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:22.158362 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e1eeb662-5f9a-4bce-bf73-ea08568dcfc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0750ed4cc2f49d0bccba2c14d59b651'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:22.171000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:22.188212 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d93f7c40-d683-495c-affe-cc524223efaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '968a8dae10234e5aaffc8f513e74c625'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:22.194847 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e1eeb662-5f9a-4bce-bf73-ea08568dcfc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0750ed4cc2f49d0bccba2c14d59b651'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:22.234445 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 868/1703] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:51:21 2022] DELETE /identity/v3/users/968a8dae10234e5aaffc8f513e74c625 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:22.235890 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f7c40-d683-495c-affe-cc524223efaa admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:22.236320 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 836/1704] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:51:21 2022] DELETE /identity/v3/users/e0750ed4cc2f49d0bccba2c14d59b651 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:22.238172 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-d93f7c40-d683-495c-affe-cc524223efaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:22.241425 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d3d2a-a7ac-4817-9c78-4fe5babdff0e None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:22.241987 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d3d2a-a7ac-4817-9c78-4fe5babdff0e None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:22.242472 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d3d2a-a7ac-4817-9c78-4fe5babdff0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:22.285114 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-4d6d3d2a-a7ac-4817-9c78-4fe5babdff0e None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:22.287418 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-4d6d3d2a-a7ac-4817-9c78-4fe5babdff0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:22.315120 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:22.415835 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f7c40-d683-495c-affe-cc524223efaa admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:22.444920 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 837/1705] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:22.447239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15277f96-4e45-476d-97c4-f5103497e005 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:22.448641 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15277f96-4e45-476d-97c4-f5103497e005 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:22.449011 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15277f96-4e45-476d-97c4-f5103497e005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:22.537465 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-15277f96-4e45-476d-97c4-f5103497e005 None None] MFA Rules not processed for user `7e678b395d334be399ecb6af37f9987b`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:22.552492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-15277f96-4e45-476d-97c4-f5103497e005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:22.590885 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee6cff-eeee-441a-b081-5ef223be9e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:22.591633 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee6cff-eeee-441a-b081-5ef223be9e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:22.591920 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee6cff-eeee-441a-b081-5ef223be9e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:22.593287 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee6cff-eeee-441a-b081-5ef223be9e56 admin admin] PATH_INFO: `/v3/users/d4bf26ceac6c4dedbcd2e1650b7c3125` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:22.596647 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee6cff-eeee-441a-b081-5ef223be9e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4bf26ceac6c4dedbcd2e1650b7c3125)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:22.599570 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee6cff-eeee-441a-b081-5ef223be9e56 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:22.772498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 838/1706] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:22.772498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15277f96-4e45-476d-97c4-f5103497e005 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:22.778114 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-15277f96-4e45-476d-97c4-f5103497e005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:22.806911 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-92ee6cff-eeee-441a-b081-5ef223be9e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4bf26ceac6c4dedbcd2e1650b7c3125'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:22.823095 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-92ee6cff-eeee-441a-b081-5ef223be9e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4bf26ceac6c4dedbcd2e1650b7c3125'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:22.825182 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-92ee6cff-eeee-441a-b081-5ef223be9e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4bf26ceac6c4dedbcd2e1650b7c3125'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:22.827630 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-92ee6cff-eeee-441a-b081-5ef223be9e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4bf26ceac6c4dedbcd2e1650b7c3125'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:22.887216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-92ee6cff-eeee-441a-b081-5ef223be9e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4bf26ceac6c4dedbcd2e1650b7c3125'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:22.909108 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 869/1707] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:51:22 2022] DELETE /identity/v3/users/d4bf26ceac6c4dedbcd2e1650b7c3125 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:22.913710 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee6cff-eeee-441a-b081-5ef223be9e56 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:22.915267 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-92ee6cff-eeee-441a-b081-5ef223be9e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:22.926824 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15277f96-4e45-476d-97c4-f5103497e005 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:22.933705 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:23.084588 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8b57e-6b68-4f0a-83fe-6c28244fdaa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:23.085479 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8b57e-6b68-4f0a-83fe-6c28244fdaa3 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:23.086210 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8b57e-6b68-4f0a-83fe-6c28244fdaa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:23.087463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8b57e-6b68-4f0a-83fe-6c28244fdaa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:23.090499 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee6cff-eeee-441a-b081-5ef223be9e56 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:23.091646 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-96e8b57e-6b68-4f0a-83fe-6c28244fdaa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:23.107223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa659a-a32b-4187-87d3-d47f7680a930 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:23.107914 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa659a-a32b-4187-87d3-d47f7680a930 service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:23.108203 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa659a-a32b-4187-87d3-d47f7680a930 service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:23.108483 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa659a-a32b-4187-87d3-d47f7680a930 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:23.110695 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-80fa659a-a32b-4187-87d3-d47f7680a930 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:23.120644 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:23.218946 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8b57e-6b68-4f0a-83fe-6c28244fdaa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:23.220601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8b57e-6b68-4f0a-83fe-6c28244fdaa3 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:23.241726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 839/1708] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:23.243591 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886715f-ca95-4ee1-ab38-59ab2a891fb8 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:23.244057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886715f-ca95-4ee1-ab38-59ab2a891fb8 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:23.244453 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886715f-ca95-4ee1-ab38-59ab2a891fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:23.278794 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-2886715f-ca95-4ee1-ab38-59ab2a891fb8 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:23.281020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa659a-a32b-4187-87d3-d47f7680a930 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:23.283121 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa659a-a32b-4187-87d3-d47f7680a930 service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:23.284610 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-2886715f-ca95-4ee1-ab38-59ab2a891fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:23.310834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 840/1709] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:23.315297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 870/1710] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:23.315753 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2e42d-be1a-4003-84f0-d8cf1d7b4642 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:23.316537 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2e42d-be1a-4003-84f0-d8cf1d7b4642 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:23.317247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2e42d-be1a-4003-84f0-d8cf1d7b4642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:23.351043 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-02b2e42d-be1a-4003-84f0-d8cf1d7b4642 None None] MFA Rules not processed for user `fa813b65a2b141ffa2359e5f0b0ae4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:23.354199 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-02b2e42d-be1a-4003-84f0-d8cf1d7b4642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:23.426110 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa659a-a32b-4187-87d3-d47f7680a930 service nova] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:23.429308 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-80fa659a-a32b-4187-87d3-d47f7680a930 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:23.464949 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa659a-a32b-4187-87d3-d47f7680a930 service nova] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:23.485174 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5eaad2-d695-4cff-a21e-30ffddb0b337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:23.489361 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5eaad2-d695-4cff-a21e-30ffddb0b337 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:23.492254 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5eaad2-d695-4cff-a21e-30ffddb0b337 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:23.492254 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5eaad2-d695-4cff-a21e-30ffddb0b337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:23.530571 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5eaad2-d695-4cff-a21e-30ffddb0b337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:23.533384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5eaad2-d695-4cff-a21e-30ffddb0b337 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:23.575172 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 871/1711] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:23.583995 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 841/1712] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:25.144606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31477249-b9ec-4d5c-9c6a-068759128aaa None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:25.145371 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31477249-b9ec-4d5c-9c6a-068759128aaa None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:25.145371 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31477249-b9ec-4d5c-9c6a-068759128aaa None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:25.146686 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 872/1713] 10.222.0.15 () {54 vars in 912 bytes} [Thu Jun 23 15:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 15:51:25.153091 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6952b-3822-4a52-9e55-28218644ad74 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:25.153938 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6952b-3822-4a52-9e55-28218644ad74 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:25.153938 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6952b-3822-4a52-9e55-28218644ad74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:25.200860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-21f6952b-3822-4a52-9e55-28218644ad74 None None] MFA Rules not processed for user `44e9fc6def5341a589221350067bb0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:25.201765 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-21f6952b-3822-4a52-9e55-28218644ad74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:25.240300 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31477249-b9ec-4d5c-9c6a-068759128aaa None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:25.242996 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-31477249-b9ec-4d5c-9c6a-068759128aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:25.247776 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 842/1714] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 23 15:51:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:25.292039 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6952b-3822-4a52-9e55-28218644ad74 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:25.297208 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31477249-b9ec-4d5c-9c6a-068759128aaa None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:25.298525 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-21f6952b-3822-4a52-9e55-28218644ad74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:25.327791 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddec7a-2cc4-4d8d-ad79-97c7635bbae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:25.336493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddec7a-2cc4-4d8d-ad79-97c7635bbae9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:25.337456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddec7a-2cc4-4d8d-ad79-97c7635bbae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:25.338053 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ddec7a-2cc4-4d8d-ad79-97c7635bbae9 admin admin] PATH_INFO: `/v3/projects/6af9a160d12a405a938865c1be5122b1` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:25.340906 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ddec7a-2cc4-4d8d-ad79-97c7635bbae9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af9a160d12a405a938865c1be5122b1)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:25.345563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ddec7a-2cc4-4d8d-ad79-97c7635bbae9 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:25.364038 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6952b-3822-4a52-9e55-28218644ad74 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:25.378580 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e261cf3-1163-41f7-be40-e0228ed55df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:25.379509 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e261cf3-1163-41f7-be40-e0228ed55df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:25.381697 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e261cf3-1163-41f7-be40-e0228ed55df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:25.382710 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e261cf3-1163-41f7-be40-e0228ed55df7 admin admin] PATH_INFO: `/v3/projects/9a559f5a108d408eb2e002a6ab8de616` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:25.384560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e261cf3-1163-41f7-be40-e0228ed55df7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a559f5a108d408eb2e002a6ab8de616)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:25.410545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e261cf3-1163-41f7-be40-e0228ed55df7 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:25.537940 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b4ddec7a-2cc4-4d8d-ad79-97c7635bbae9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af9a160d12a405a938865c1be5122b1', 'request_id': 'req-b4ddec7a-2cc4-4d8d-ad79-97c7635bbae9'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:25.563585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b4ddec7a-2cc4-4d8d-ad79-97c7635bbae9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af9a160d12a405a938865c1be5122b1', 'request_id': 'req-b4ddec7a-2cc4-4d8d-ad79-97c7635bbae9'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:25.595006 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b4ddec7a-2cc4-4d8d-ad79-97c7635bbae9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af9a160d12a405a938865c1be5122b1', 'request_id': 'req-b4ddec7a-2cc4-4d8d-ad79-97c7635bbae9'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:25.611723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-3e261cf3-1163-41f7-be40-e0228ed55df7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a559f5a108d408eb2e002a6ab8de616', 'request_id': 'req-3e261cf3-1163-41f7-be40-e0228ed55df7'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:25.636089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b4ddec7a-2cc4-4d8d-ad79-97c7635bbae9 admin admin] The token cache is being invalidate because project 6af9a160d12a405a938865c1be5122b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:51:25.636915 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-3e261cf3-1163-41f7-be40-e0228ed55df7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a559f5a108d408eb2e002a6ab8de616', 'request_id': 'req-3e261cf3-1163-41f7-be40-e0228ed55df7'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:25.637523 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b4ddec7a-2cc4-4d8d-ad79-97c7635bbae9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:25.639395 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b4ddec7a-2cc4-4d8d-ad79-97c7635bbae9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:25.645286 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 873/1715] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:51:25 2022] DELETE /identity/v3/projects/6af9a160d12a405a938865c1be5122b1 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:25.647618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddec7a-2cc4-4d8d-ad79-97c7635bbae9 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:25.655505 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-b4ddec7a-2cc4-4d8d-ad79-97c7635bbae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:25.660737 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-3e261cf3-1163-41f7-be40-e0228ed55df7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a559f5a108d408eb2e002a6ab8de616', 'request_id': 'req-3e261cf3-1163-41f7-be40-e0228ed55df7'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:25.682602 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-3e261cf3-1163-41f7-be40-e0228ed55df7 admin admin] The token cache is being invalidate because project 9a559f5a108d408eb2e002a6ab8de616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:51:25.682899 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-3e261cf3-1163-41f7-be40-e0228ed55df7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:25.683764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-3e261cf3-1163-41f7-be40-e0228ed55df7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:25.689428 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 843/1716] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:51:25 2022] DELETE /identity/v3/projects/9a559f5a108d408eb2e002a6ab8de616 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:25.690809 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e261cf3-1163-41f7-be40-e0228ed55df7 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:25.692581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-3e261cf3-1163-41f7-be40-e0228ed55df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:25.708677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:25.732288 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:25.847304 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e261cf3-1163-41f7-be40-e0228ed55df7 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:25.856899 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840547c-fef4-434c-859a-7fff612e3972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:25.857580 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840547c-fef4-434c-859a-7fff612e3972 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:25.857904 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840547c-fef4-434c-859a-7fff612e3972 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:25.858175 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840547c-fef4-434c-859a-7fff612e3972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:25.860680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ddec7a-2cc4-4d8d-ad79-97c7635bbae9 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:25.864469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-3840547c-fef4-434c-859a-7fff612e3972 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:25.897585 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840547c-fef4-434c-859a-7fff612e3972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:25.900809 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840547c-fef4-434c-859a-7fff612e3972 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:25.937431 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 844/1717] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:25.939917 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53425a-0189-41fc-8dac-ff7e19a0389d None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:25.943349 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53425a-0189-41fc-8dac-ff7e19a0389d None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:25.944505 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53425a-0189-41fc-8dac-ff7e19a0389d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:25.997646 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-4a53425a-0189-41fc-8dac-ff7e19a0389d None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:26.000105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-4a53425a-0189-41fc-8dac-ff7e19a0389d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:26.042274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354e4b9-0cbe-48f3-9d97-88b756c285ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:26.043164 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354e4b9-0cbe-48f3-9d97-88b756c285ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:26.043449 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354e4b9-0cbe-48f3-9d97-88b756c285ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:26.047330 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354e4b9-0cbe-48f3-9d97-88b756c285ef admin admin] PATH_INFO: `/v3/projects/eab4e160e2c54a16a0b496a37d4e4692` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:26.051840 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354e4b9-0cbe-48f3-9d97-88b756c285ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=eab4e160e2c54a16a0b496a37d4e4692)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:26.058818 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354e4b9-0cbe-48f3-9d97-88b756c285ef admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:26.195782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-f354e4b9-0cbe-48f3-9d97-88b756c285ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eab4e160e2c54a16a0b496a37d4e4692', 'request_id': 'req-f354e4b9-0cbe-48f3-9d97-88b756c285ef'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:26.205468 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 845/1718] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:26.219783 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-f354e4b9-0cbe-48f3-9d97-88b756c285ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eab4e160e2c54a16a0b496a37d4e4692', 'request_id': 'req-f354e4b9-0cbe-48f3-9d97-88b756c285ef'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:26.219981 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7075d-ebcb-4da8-9216-2e2ab5157e3f None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:26.220522 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7075d-ebcb-4da8-9216-2e2ab5157e3f None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:26.227113 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7075d-ebcb-4da8-9216-2e2ab5157e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:26.237831 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-f354e4b9-0cbe-48f3-9d97-88b756c285ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eab4e160e2c54a16a0b496a37d4e4692', 'request_id': 'req-f354e4b9-0cbe-48f3-9d97-88b756c285ef'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:26.261013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-f354e4b9-0cbe-48f3-9d97-88b756c285ef admin admin] The token cache is being invalidate because project eab4e160e2c54a16a0b496a37d4e4692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:51:26.261316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-f354e4b9-0cbe-48f3-9d97-88b756c285ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:26.263119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-f354e4b9-0cbe-48f3-9d97-88b756c285ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:26.274153 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 874/1719] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:51:25 2022] DELETE /identity/v3/projects/eab4e160e2c54a16a0b496a37d4e4692 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:26.275961 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21ad97-7930-47db-90ea-588a73167440 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:26.276253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21ad97-7930-47db-90ea-588a73167440 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:26.276597 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21ad97-7930-47db-90ea-588a73167440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:26.304251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-a1b7075d-ebcb-4da8-9216-2e2ab5157e3f None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:26.308636 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-a1b7075d-ebcb-4da8-9216-2e2ab5157e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:26.314473 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-3c21ad97-7930-47db-90ea-588a73167440 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:26.315780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-3c21ad97-7930-47db-90ea-588a73167440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:26.421916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:26.498018 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 875/1720] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:26.504311 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21ad97-7930-47db-90ea-588a73167440 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:26.507881 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-3c21ad97-7930-47db-90ea-588a73167440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:26.554104 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21ad97-7930-47db-90ea-588a73167440 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:26.567323 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348895c-b5fc-4c07-815f-33464761d741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:26.568977 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348895c-b5fc-4c07-815f-33464761d741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:26.569323 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348895c-b5fc-4c07-815f-33464761d741 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:26.569669 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348895c-b5fc-4c07-815f-33464761d741 admin admin] PATH_INFO: `/v3/users/617086781441406bab74d7867387734f` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:26.575457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348895c-b5fc-4c07-815f-33464761d741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=617086781441406bab74d7867387734f)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:26.579190 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348895c-b5fc-4c07-815f-33464761d741 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:26.607419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 846/1721] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:26.609182 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7075d-ebcb-4da8-9216-2e2ab5157e3f None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:26.636510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7075d-ebcb-4da8-9216-2e2ab5157e3f None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:26.657008 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4341131c-bb3a-462b-91a9-2b6917cbe3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:26.657744 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341131c-bb3a-462b-91a9-2b6917cbe3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:26.658064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341131c-bb3a-462b-91a9-2b6917cbe3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:26.658350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4341131c-bb3a-462b-91a9-2b6917cbe3f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:26.659149 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4341131c-bb3a-462b-91a9-2b6917cbe3f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:51:26.659467 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4341131c-bb3a-462b-91a9-2b6917cbe3f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:26.663379 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4341131c-bb3a-462b-91a9-2b6917cbe3f8 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:26.699498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 847/1722] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:51:26.707752 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f67df-2de0-4170-b3e1-39563a4cbe50 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:26.708392 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f67df-2de0-4170-b3e1-39563a4cbe50 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:26.708543 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f67df-2de0-4170-b3e1-39563a4cbe50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:26.726189 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-a348895c-b5fc-4c07-815f-33464761d741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '617086781441406bab74d7867387734f'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:26.747970 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-a348895c-b5fc-4c07-815f-33464761d741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '617086781441406bab74d7867387734f'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:26.750061 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-a348895c-b5fc-4c07-815f-33464761d741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '617086781441406bab74d7867387734f'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:26.751830 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-a348895c-b5fc-4c07-815f-33464761d741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '617086781441406bab74d7867387734f'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:26.754343 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-b09f67df-2de0-4170-b3e1-39563a4cbe50 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:26.755631 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-b09f67df-2de0-4170-b3e1-39563a4cbe50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:26.782287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 848/1723] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:26.788935 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f67df-2de0-4170-b3e1-39563a4cbe50 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:26.792490 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-b09f67df-2de0-4170-b3e1-39563a4cbe50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:26.802385 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-a348895c-b5fc-4c07-815f-33464761d741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '617086781441406bab74d7867387734f'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:26.843256 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 876/1724] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:51:26 2022] DELETE /identity/v3/users/617086781441406bab74d7867387734f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:26.844162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348895c-b5fc-4c07-815f-33464761d741 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:26.856625 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f67df-2de0-4170-b3e1-39563a4cbe50 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:26.913117 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:26.997787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24cc614-e8d2-4e42-8682-448288531cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:26.998586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cc614-e8d2-4e42-8682-448288531cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:26.999538 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cc614-e8d2-4e42-8682-448288531cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:26.999864 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cc614-e8d2-4e42-8682-448288531cc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:27.000624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24cc614-e8d2-4e42-8682-448288531cc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:27.003068 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24cc614-e8d2-4e42-8682-448288531cc6 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:27.068524 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 849/1725] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:26 2022] POST /identity/v3/projects => generated 407 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:27.075136 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80051506-7b7f-4633-bb65-57e8b671b1dd None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:27.075442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80051506-7b7f-4633-bb65-57e8b671b1dd None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:27.075718 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80051506-7b7f-4633-bb65-57e8b671b1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:27.125820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348895c-b5fc-4c07-815f-33464761d741 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:27.167739 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-80051506-7b7f-4633-bb65-57e8b671b1dd None None] MFA Rules not processed for user `65a232a57388409091409128d7dbb56f`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:27.168993 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-80051506-7b7f-4633-bb65-57e8b671b1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:27.378713 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f7dbc-f813-4a17-90ae-c4c7a4b9bb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:27.379416 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f7dbc-f813-4a17-90ae-c4c7a4b9bb17 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:27.379708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f7dbc-f813-4a17-90ae-c4c7a4b9bb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:27.379985 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f7dbc-f813-4a17-90ae-c4c7a4b9bb17 admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:27.380745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f7dbc-f813-4a17-90ae-c4c7a4b9bb17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:51:27.381114 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f7dbc-f813-4a17-90ae-c4c7a4b9bb17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:27.392836 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f7dbc-f813-4a17-90ae-c4c7a4b9bb17 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:27.423035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 877/1726] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 579 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:51:27.429659 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f7dbc-f813-4a17-90ae-c4c7a4b9bb17 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:27.440417 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 850/1727] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:27.444518 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80051506-7b7f-4633-bb65-57e8b671b1dd None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:27.459222 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f7dbc-f813-4a17-90ae-c4c7a4b9bb17 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:27.473683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80051506-7b7f-4633-bb65-57e8b671b1dd None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:27.477373 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0ee08-c752-4055-bfc4-f17445ebcbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:27.478137 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0ee08-c752-4055-bfc4-f17445ebcbe4 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:27.478422 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0ee08-c752-4055-bfc4-f17445ebcbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:27.479830 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0ee08-c752-4055-bfc4-f17445ebcbe4 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:27.480597 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0ee08-c752-4055-bfc4-f17445ebcbe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:27.482615 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0ee08-c752-4055-bfc4-f17445ebcbe4 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:27.493190 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:27.494270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be6e66-4308-48e2-b97c-6b391390c943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:27.496011 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be6e66-4308-48e2-b97c-6b391390c943 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:27.496369 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be6e66-4308-48e2-b97c-6b391390c943 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:27.496851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0be6e66-4308-48e2-b97c-6b391390c943 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:27.497769 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be6e66-4308-48e2-b97c-6b391390c943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:27.499769 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0be6e66-4308-48e2-b97c-6b391390c943 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:27.543553 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 878/1728] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:27 2022] POST /identity/v3/users => generated 304 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:27.545506 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e4548-163f-4ed3-8d33-b15ce4694b57 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:27.546114 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e4548-163f-4ed3-8d33-b15ce4694b57 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:27.546749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e4548-163f-4ed3-8d33-b15ce4694b57 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:27.555006 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 879/1729] 10.222.0.15 () {54 vars in 960 bytes} [Thu Jun 23 15:51:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:51:27.556862 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc396d7-231d-483d-81b7-c012a8d531b1 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:27.557411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc396d7-231d-483d-81b7-c012a8d531b1 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:27.557949 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc396d7-231d-483d-81b7-c012a8d531b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:27.574849 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 851/1730] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:27 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:27.575826 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be6e66-4308-48e2-b97c-6b391390c943 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:27.639698 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-ccc396d7-231d-483d-81b7-c012a8d531b1 None None] MFA Rules not processed for user `65a232a57388409091409128d7dbb56f`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:27.648158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ccc396d7-231d-483d-81b7-c012a8d531b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:27.805293 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0be6e66-4308-48e2-b97c-6b391390c943 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:27.842950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90847f75-605a-425f-b479-32834c3e3194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:27.843768 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90847f75-605a-425f-b479-32834c3e3194 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:27.844100 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90847f75-605a-425f-b479-32834c3e3194 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:27.844430 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90847f75-605a-425f-b479-32834c3e3194 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:27.845326 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90847f75-605a-425f-b479-32834c3e3194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:27.849345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90847f75-605a-425f-b479-32834c3e3194 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:27.877362 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 852/1731] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:27.879021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828407b8-ff56-4289-b377-dead12516e87 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:27.879320 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828407b8-ff56-4289-b377-dead12516e87 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:27.879607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828407b8-ff56-4289-b377-dead12516e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:27.891148 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 880/1732] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:27.893394 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc396d7-231d-483d-81b7-c012a8d531b1 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:27.926127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc396d7-231d-483d-81b7-c012a8d531b1 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:27.927079 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-828407b8-ff56-4289-b377-dead12516e87 None None] MFA Rules not processed for user `9300c3a803e94f9a93442f551fc9646f`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:27.928919 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-828407b8-ff56-4289-b377-dead12516e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:27.937521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db9f8f-68d5-4ffd-b303-1bcaeafcdf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:27.939541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db9f8f-68d5-4ffd-b303-1bcaeafcdf14 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:27.940407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db9f8f-68d5-4ffd-b303-1bcaeafcdf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:27.941488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db9f8f-68d5-4ffd-b303-1bcaeafcdf14 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:27.943516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db9f8f-68d5-4ffd-b303-1bcaeafcdf14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:27.950114 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db9f8f-68d5-4ffd-b303-1bcaeafcdf14 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:27.976500 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:28.015250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 881/1733] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:27 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:28.018777 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f80e52-b79c-45d5-a66f-b3c415825cf8 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:28.018777 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f80e52-b79c-45d5-a66f-b3c415825cf8 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:28.018777 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f80e52-b79c-45d5-a66f-b3c415825cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:28.086807 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-28f80e52-b79c-45d5-a66f-b3c415825cf8 None None] MFA Rules not processed for user `7fe974cf493c4545abc70a6745359a66`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:28.089813 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 853/1734] 10.222.0.15 () {58 vars in 1057 bytes} [Thu Jun 23 15:51:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:28.090475 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-28f80e52-b79c-45d5-a66f-b3c415825cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:28.090877 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828407b8-ff56-4289-b377-dead12516e87 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:28.106721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828407b8-ff56-4289-b377-dead12516e87 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:28.116308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b434cf8-18af-4275-85e0-9ae6ccbfe55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:28.117408 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b434cf8-18af-4275-85e0-9ae6ccbfe55f admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:28.117880 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b434cf8-18af-4275-85e0-9ae6ccbfe55f admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:28.118307 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b434cf8-18af-4275-85e0-9ae6ccbfe55f admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:28.119218 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b434cf8-18af-4275-85e0-9ae6ccbfe55f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:28.121429 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b434cf8-18af-4275-85e0-9ae6ccbfe55f admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:28.140691 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 854/1735] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:28.142214 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b434cf8-18af-4275-85e0-9ae6ccbfe55f admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:28.145450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-1b434cf8-18af-4275-85e0-9ae6ccbfe55f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:28.253245 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b434cf8-18af-4275-85e0-9ae6ccbfe55f admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:28.265659 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5e9d9-9e1a-4c3c-b917-d92195889e9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:28.267895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5e9d9-9e1a-4c3c-b917-d92195889e9a service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:28.268192 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5e9d9-9e1a-4c3c-b917-d92195889e9a service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:28.268495 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5e9d9-9e1a-4c3c-b917-d92195889e9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:28.270118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 882/1736] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:28.271857 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f80e52-b79c-45d5-a66f-b3c415825cf8 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:28.280782 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5e9d9-9e1a-4c3c-b917-d92195889e9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:28.283215 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5e9d9-9e1a-4c3c-b917-d92195889e9a service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:28.285407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f80e52-b79c-45d5-a66f-b3c415825cf8 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:28.296359 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 855/1737] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:28.297906 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5e9d9-9e1a-4c3c-b917-d92195889e9a service nova] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:28.312180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5e9d9-9e1a-4c3c-b917-d92195889e9a service nova] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:28.316674 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176dc16-6261-4ed5-ada7-f199e4b2c545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:28.317633 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176dc16-6261-4ed5-ada7-f199e4b2c545 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:28.318134 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176dc16-6261-4ed5-ada7-f199e4b2c545 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:28.318553 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014d40f-8301-4ad6-b6e4-68eb5444700f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9300c3a803e94f9a93442f551fc9646f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:28.319556 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176dc16-6261-4ed5-ada7-f199e4b2c545 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:28.319778 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014d40f-8301-4ad6-b6e4-68eb5444700f service placement] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:28.320072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014d40f-8301-4ad6-b6e4-68eb5444700f service placement] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:28.320358 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014d40f-8301-4ad6-b6e4-68eb5444700f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:28.321087 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176dc16-6261-4ed5-ada7-f199e4b2c545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:28.324614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-a014d40f-8301-4ad6-b6e4-68eb5444700f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:28.327211 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176dc16-6261-4ed5-ada7-f199e4b2c545 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:28.346837 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014d40f-8301-4ad6-b6e4-68eb5444700f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:28.349683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a014d40f-8301-4ad6-b6e4-68eb5444700f service placement] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:28.373306 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 883/1738] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:28.378286 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176dc16-6261-4ed5-ada7-f199e4b2c545 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:28.403264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 856/1739] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:28.410863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de330460-7e07-4283-94d0-fa59cec7b241 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:28.413902 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de330460-7e07-4283-94d0-fa59cec7b241 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:28.420914 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de330460-7e07-4283-94d0-fa59cec7b241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:28.424217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176dc16-6261-4ed5-ada7-f199e4b2c545 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:28.438312 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e7eaf-585d-4336-aa17-109cf9ba562b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:28.439897 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e7eaf-585d-4336-aa17-109cf9ba562b admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:28.440410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e7eaf-585d-4336-aa17-109cf9ba562b admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:28.440923 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e7eaf-585d-4336-aa17-109cf9ba562b admin admin] PATH_INFO: `/v3/projects/0a05b2f700d849358b02953fb33c4ac8/users/0e459bed33ba444ca7c025b6204ba00c/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:28.494294 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-de330460-7e07-4283-94d0-fa59cec7b241 None None] MFA Rules not processed for user `7fe974cf493c4545abc70a6745359a66`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:28.495824 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-de330460-7e07-4283-94d0-fa59cec7b241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:28.508857 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e7eaf-585d-4336-aa17-109cf9ba562b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a05b2f700d849358b02953fb33c4ac8, user_id=0e459bed33ba444ca7c025b6204ba00c, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:28.517032 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 857/1740] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:28.517032 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de330460-7e07-4283-94d0-fa59cec7b241 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:28.517336 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e7eaf-585d-4336-aa17-109cf9ba562b admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:28.529805 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de330460-7e07-4283-94d0-fa59cec7b241 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:28.536918 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d03b3-9d62-4372-97ad-da607ee34035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:28.537744 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d03b3-9d62-4372-97ad-da607ee34035 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:28.538135 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d03b3-9d62-4372-97ad-da607ee34035 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:28.538577 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d03b3-9d62-4372-97ad-da607ee34035 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:28.539885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d03b3-9d62-4372-97ad-da607ee34035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:28.541790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d03b3-9d62-4372-97ad-da607ee34035 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:28.561973 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 858/1741] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:28.561973 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d03b3-9d62-4372-97ad-da607ee34035 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:28.564434 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-314d03b3-9d62-4372-97ad-da607ee34035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:28.594389 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d03b3-9d62-4372-97ad-da607ee34035 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:28.597727 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 884/1742] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:28 2022] PUT /identity/v3/projects/0a05b2f700d849358b02953fb33c4ac8/users/0e459bed33ba444ca7c025b6204ba00c/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:28.606873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e7eaf-585d-4336-aa17-109cf9ba562b admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:28.741204 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:28.853206 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e7eaf-585d-4336-aa17-109cf9ba562b admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:28.856652 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:28.903269 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2c211-bfd3-483c-a2ab-40f95f750847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:28.905454 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2c211-bfd3-483c-a2ab-40f95f750847 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:28.906248 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2c211-bfd3-483c-a2ab-40f95f750847 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:28.906958 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2c211-bfd3-483c-a2ab-40f95f750847 admin admin] PATH_INFO: `/v3/projects/cde67034f87c4efdba6b36bd4371226e/users/780e25768d3441b497b3c6f8a34841bc/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:28.911181 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ed1bd-5752-4f2e-bd2b-b03ca0f5d726 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:28.912355 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ed1bd-5752-4f2e-bd2b-b03ca0f5d726 service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:28.912863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ed1bd-5752-4f2e-bd2b-b03ca0f5d726 service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:28.913361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ed1bd-5752-4f2e-bd2b-b03ca0f5d726 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:28.960899 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2c211-bfd3-483c-a2ab-40f95f750847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cde67034f87c4efdba6b36bd4371226e, user_id=780e25768d3441b497b3c6f8a34841bc, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:28.977452 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2c211-bfd3-483c-a2ab-40f95f750847 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:29.029457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 885/1743] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:28 2022] PUT /identity/v3/projects/cde67034f87c4efdba6b36bd4371226e/users/780e25768d3441b497b3c6f8a34841bc/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:29.029457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695d2b3-554e-4d4c-a395-3111c87738cc None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:29.030789 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695d2b3-554e-4d4c-a395-3111c87738cc None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:29.031254 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695d2b3-554e-4d4c-a395-3111c87738cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:29.124067 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-6695d2b3-554e-4d4c-a395-3111c87738cc None None] MFA Rules not processed for user `0e459bed33ba444ca7c025b6204ba00c`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:29.125467 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-6695d2b3-554e-4d4c-a395-3111c87738cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:29.247687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 886/1744] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:29 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:29.250457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197c174-c4a0-4401-ad43-1dcd90bb7579 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:29.250830 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197c174-c4a0-4401-ad43-1dcd90bb7579 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:29.252325 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197c174-c4a0-4401-ad43-1dcd90bb7579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:29.282779 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-6197c174-c4a0-4401-ad43-1dcd90bb7579 None None] MFA Rules not processed for user `7e678b395d334be399ecb6af37f9987b`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:29.285052 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-6197c174-c4a0-4401-ad43-1dcd90bb7579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:29.388427 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ed1bd-5752-4f2e-bd2b-b03ca0f5d726 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:29.391554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ed1bd-5752-4f2e-bd2b-b03ca0f5d726 service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:29.417058 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 859/1745] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 858 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:29.419804 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79339e-4b1e-45e8-a28a-d840783a4566 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:29.420491 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79339e-4b1e-45e8-a28a-d840783a4566 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:29.421422 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79339e-4b1e-45e8-a28a-d840783a4566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:29.435826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 887/1746] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:29.442812 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197c174-c4a0-4401-ad43-1dcd90bb7579 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:29.446084 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-6197c174-c4a0-4401-ad43-1dcd90bb7579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:29.483435 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-5e79339e-4b1e-45e8-a28a-d840783a4566 None None] MFA Rules not processed for user `780e25768d3441b497b3c6f8a34841bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:29.485109 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-5e79339e-4b1e-45e8-a28a-d840783a4566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:29.613585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:29.639564 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 860/1747] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:29.641344 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79339e-4b1e-45e8-a28a-d840783a4566 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:29.656168 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197c174-c4a0-4401-ad43-1dcd90bb7579 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:29.663247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79339e-4b1e-45e8-a28a-d840783a4566 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:29.673297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f9e47-6d64-4c8d-a7bd-bbf633f79e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:29.675525 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3febe-284b-4464-bacb-429f6d280d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:29.675967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f9e47-6d64-4c8d-a7bd-bbf633f79e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:29.677148 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f9e47-6d64-4c8d-a7bd-bbf633f79e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:29.677648 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f9e47-6d64-4c8d-a7bd-bbf633f79e2c admin admin] PATH_INFO: `/v3/projects/a966bd22b37d4863875e6ebd727ec83c` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:29.678260 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3febe-284b-4464-bacb-429f6d280d13 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:29.678427 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3febe-284b-4464-bacb-429f6d280d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:29.679331 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3febe-284b-4464-bacb-429f6d280d13 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:29.682003 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3febe-284b-4464-bacb-429f6d280d13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:29.682909 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f9e47-6d64-4c8d-a7bd-bbf633f79e2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a966bd22b37d4863875e6ebd727ec83c)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:29.688012 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f9e47-6d64-4c8d-a7bd-bbf633f79e2c admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:29.688511 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3febe-284b-4464-bacb-429f6d280d13 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:29.750255 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 861/1748] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:29 2022] POST /identity/v3/projects => generated 409 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:29.757166 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57071c0-96bb-4b25-83e8-5befb06ddb5b None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:29.767989 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57071c0-96bb-4b25-83e8-5befb06ddb5b None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:29.769912 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57071c0-96bb-4b25-83e8-5befb06ddb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:29.854409 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-b57071c0-96bb-4b25-83e8-5befb06ddb5b None None] MFA Rules not processed for user `baaf74865f9849e49a7ccf2fe7ecb898`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:29.867865 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-b57071c0-96bb-4b25-83e8-5befb06ddb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:29.886880 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-2f8f9e47-6d64-4c8d-a7bd-bbf633f79e2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a966bd22b37d4863875e6ebd727ec83c', 'request_id': 'req-2f8f9e47-6d64-4c8d-a7bd-bbf633f79e2c'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:29.910008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-2f8f9e47-6d64-4c8d-a7bd-bbf633f79e2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a966bd22b37d4863875e6ebd727ec83c', 'request_id': 'req-2f8f9e47-6d64-4c8d-a7bd-bbf633f79e2c'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:29.932990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-2f8f9e47-6d64-4c8d-a7bd-bbf633f79e2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a966bd22b37d4863875e6ebd727ec83c', 'request_id': 'req-2f8f9e47-6d64-4c8d-a7bd-bbf633f79e2c'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:29.975499 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-2f8f9e47-6d64-4c8d-a7bd-bbf633f79e2c admin admin] The token cache is being invalidate because project a966bd22b37d4863875e6ebd727ec83c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:51:29.975898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-2f8f9e47-6d64-4c8d-a7bd-bbf633f79e2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:29.979530 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-2f8f9e47-6d64-4c8d-a7bd-bbf633f79e2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:29.985053 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 888/1749] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:51:29 2022] DELETE /identity/v3/projects/a966bd22b37d4863875e6ebd727ec83c => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:29.987911 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f9e47-6d64-4c8d-a7bd-bbf633f79e2c admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:29.989662 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-2f8f9e47-6d64-4c8d-a7bd-bbf633f79e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:30.060825 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 862/1750] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:30.064623 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57071c0-96bb-4b25-83e8-5befb06ddb5b None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:30.071025 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-b57071c0-96bb-4b25-83e8-5befb06ddb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:30.124092 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:30.160323 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f9e47-6d64-4c8d-a7bd-bbf633f79e2c admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:30.167463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed6266-c134-4305-a5d6-a80003449665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:30.168404 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed6266-c134-4305-a5d6-a80003449665 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:30.168716 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed6266-c134-4305-a5d6-a80003449665 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:30.169106 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed6266-c134-4305-a5d6-a80003449665 admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:30.171053 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed6266-c134-4305-a5d6-a80003449665 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:30.174947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed6266-c134-4305-a5d6-a80003449665 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:30.239299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 889/1751] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:29 2022] POST /identity/v3/projects => generated 377 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:30.246388 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5451b0-631d-49f6-b6d1-83d39f4e0831 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:30.246720 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5451b0-631d-49f6-b6d1-83d39f4e0831 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:30.247009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5451b0-631d-49f6-b6d1-83d39f4e0831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:30.258497 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57071c0-96bb-4b25-83e8-5befb06ddb5b None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:30.334236 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-9a5451b0-631d-49f6-b6d1-83d39f4e0831 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:30.336952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-9a5451b0-631d-49f6-b6d1-83d39f4e0831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:30.494822 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556b35d-1451-4eea-a9cb-669afe00fbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:30.495672 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556b35d-1451-4eea-a9cb-669afe00fbb3 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:30.500369 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556b35d-1451-4eea-a9cb-669afe00fbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:30.500937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556b35d-1451-4eea-a9cb-669afe00fbb3 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:30.503579 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556b35d-1451-4eea-a9cb-669afe00fbb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:30.517019 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 890/1752] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:30.518099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556b35d-1451-4eea-a9cb-669afe00fbb3 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:30.518192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdca120-c764-4c92-ad9a-4fd1f2ddf45d None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:30.518192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdca120-c764-4c92-ad9a-4fd1f2ddf45d None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:30.518192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdca120-c764-4c92-ad9a-4fd1f2ddf45d None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:30.527866 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 891/1753] 10.222.0.15 () {54 vars in 912 bytes} [Thu Jun 23 15:51:30 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:51:30.528717 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdca120-c764-4c92-ad9a-4fd1f2ddf45d None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:30.557632 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:30.575820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdca120-c764-4c92-ad9a-4fd1f2ddf45d None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:30.589101 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29bcb1-cee2-47de-9ea7-980b37f40a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:30.590159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29bcb1-cee2-47de-9ea7-980b37f40a54 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:30.590616 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29bcb1-cee2-47de-9ea7-980b37f40a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:30.591103 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29bcb1-cee2-47de-9ea7-980b37f40a54 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:30.592150 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29bcb1-cee2-47de-9ea7-980b37f40a54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:30.594095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 863/1754] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:30 2022] POST /identity/v3/users => generated 311 bytes in 533 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:30.594762 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29bcb1-cee2-47de-9ea7-980b37f40a54 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:30.596538 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30c1fa-4975-476e-9176-357c6a1873ea None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:30.610937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30c1fa-4975-476e-9176-357c6a1873ea None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:30.611414 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30c1fa-4975-476e-9176-357c6a1873ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:30.643259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 892/1755] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:30 2022] POST /identity/v3/users => generated 295 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:30.644968 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1729a-ff22-445a-b86e-78e231fce345 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:30.645423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1729a-ff22-445a-b86e-78e231fce345 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:30.645871 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1729a-ff22-445a-b86e-78e231fce345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:30.669498 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-cda1729a-ff22-445a-b86e-78e231fce345 None None] MFA Rules not processed for user `44e9fc6def5341a589221350067bb0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:30.671626 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-cda1729a-ff22-445a-b86e-78e231fce345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:30.703947 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-7d30c1fa-4975-476e-9176-357c6a1873ea None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:30.705252 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-7d30c1fa-4975-476e-9176-357c6a1873ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:30.731545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 864/1756] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:30.732482 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30c1fa-4975-476e-9176-357c6a1873ea None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:30.768823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30c1fa-4975-476e-9176-357c6a1873ea None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:30.785789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19447f5-c590-4f87-8e3c-92a89e055df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:30.786708 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19447f5-c590-4f87-8e3c-92a89e055df4 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:30.787147 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19447f5-c590-4f87-8e3c-92a89e055df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:30.787526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19447f5-c590-4f87-8e3c-92a89e055df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:30.788391 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19447f5-c590-4f87-8e3c-92a89e055df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:30.790881 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19447f5-c590-4f87-8e3c-92a89e055df4 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:30.806273 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 893/1757] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 23 15:51:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:30.813969 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1729a-ff22-445a-b86e-78e231fce345 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:30.844484 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 865/1758] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:30.856662 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19447f5-c590-4f87-8e3c-92a89e055df4 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:30.867870 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1729a-ff22-445a-b86e-78e231fce345 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:30.884989 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19447f5-c590-4f87-8e3c-92a89e055df4 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:30.891459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaa927-64cf-4d8e-8c52-ff4c9b21479c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:30.893130 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaa927-64cf-4d8e-8c52-ff4c9b21479c admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:30.893648 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaa927-64cf-4d8e-8c52-ff4c9b21479c admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:30.895938 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbaa927-64cf-4d8e-8c52-ff4c9b21479c admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:30.897777 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbaa927-64cf-4d8e-8c52-ff4c9b21479c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:30.907225 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbaa927-64cf-4d8e-8c52-ff4c9b21479c admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:30.911103 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58cf84-c0c6-405e-a8f4-2b99cded15d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:30.912344 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58cf84-c0c6-405e-a8f4-2b99cded15d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:30.912631 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58cf84-c0c6-405e-a8f4-2b99cded15d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:30.912952 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58cf84-c0c6-405e-a8f4-2b99cded15d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:30.913698 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58cf84-c0c6-405e-a8f4-2b99cded15d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:51:30.914072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58cf84-c0c6-405e-a8f4-2b99cded15d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:30.915800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58cf84-c0c6-405e-a8f4-2b99cded15d9 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:30.931390 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 866/1759] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:51:30.932010 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58cf84-c0c6-405e-a8f4-2b99cded15d9 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:30.954220 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58cf84-c0c6-405e-a8f4-2b99cded15d9 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:30.959148 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 894/1760] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:30.960991 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaa927-64cf-4d8e-8c52-ff4c9b21479c admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:30.968133 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5dbaa927-64cf-4d8e-8c52-ff4c9b21479c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:30.972268 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6e3d0-2537-4c2d-b95f-e736800bb3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:30.973374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6e3d0-2537-4c2d-b95f-e736800bb3df admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:30.973963 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6e3d0-2537-4c2d-b95f-e736800bb3df admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:30.974450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6e3d0-2537-4c2d-b95f-e736800bb3df admin admin] PATH_INFO: `/v3/projects/00fe71f0b79946f9a2bc86f1a4b02032/users/9ba036a140404484be0875ead59d296f/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:31.007365 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbaa927-64cf-4d8e-8c52-ff4c9b21479c admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:31.010040 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6e3d0-2537-4c2d-b95f-e736800bb3df admin admin] RBAC: Authorizing `identity:create_grant(project_id=00fe71f0b79946f9a2bc86f1a4b02032, user_id=9ba036a140404484be0875ead59d296f, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:31.013657 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6e3d0-2537-4c2d-b95f-e736800bb3df admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:31.018591 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee76f0-bfab-4a88-981f-c1a66cdbca5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:31.026780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee76f0-bfab-4a88-981f-c1a66cdbca5c service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:31.027546 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee76f0-bfab-4a88-981f-c1a66cdbca5c service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:31.028403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee76f0-bfab-4a88-981f-c1a66cdbca5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:31.070924 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee76f0-bfab-4a88-981f-c1a66cdbca5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:31.076277 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee76f0-bfab-4a88-981f-c1a66cdbca5c service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:31.081521 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 867/1761] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:30 2022] PUT /identity/v3/projects/00fe71f0b79946f9a2bc86f1a4b02032/users/9ba036a140404484be0875ead59d296f/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:31.082783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6e3d0-2537-4c2d-b95f-e736800bb3df admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:31.109417 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 895/1762] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:31.111160 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee76f0-bfab-4a88-981f-c1a66cdbca5c service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:31.151456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee76f0-bfab-4a88-981f-c1a66cdbca5c service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:31.349332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:31.355459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec3cfe-c0df-4bcd-93a5-5b43e4c8b1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:31.361059 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec3cfe-c0df-4bcd-93a5-5b43e4c8b1c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:31.363976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec3cfe-c0df-4bcd-93a5-5b43e4c8b1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:31.363976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec3cfe-c0df-4bcd-93a5-5b43e4c8b1c0 admin admin] PATH_INFO: `/v3/projects/9f7576dafd374f24a71a30181ec9ac52/users/de444e5a943b4b8f96587f38425f1917/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:31.367904 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6e3d0-2537-4c2d-b95f-e736800bb3df admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:31.391104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783bd8e-4cac-4505-af66-4b8a404db3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:31.391352 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783bd8e-4cac-4505-af66-4b8a404db3ed admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:31.391778 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783bd8e-4cac-4505-af66-4b8a404db3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:31.392206 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783bd8e-4cac-4505-af66-4b8a404db3ed admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:31.396390 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783bd8e-4cac-4505-af66-4b8a404db3ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:31.414666 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783bd8e-4cac-4505-af66-4b8a404db3ed admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:31.464207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec3cfe-c0df-4bcd-93a5-5b43e4c8b1c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7576dafd374f24a71a30181ec9ac52, user_id=de444e5a943b4b8f96587f38425f1917, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:31.471536 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec3cfe-c0df-4bcd-93a5-5b43e4c8b1c0 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:31.500274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 896/1763] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:31 2022] PUT /identity/v3/projects/9f7576dafd374f24a71a30181ec9ac52/users/de444e5a943b4b8f96587f38425f1917/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:31.502690 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec3cfe-c0df-4bcd-93a5-5b43e4c8b1c0 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:31.537977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 868/1764] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:31 2022] POST /identity/v3/projects => generated 387 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:31.539627 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783bd8e-4cac-4505-af66-4b8a404db3ed admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:31.674461 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:31.688204 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec3cfe-c0df-4bcd-93a5-5b43e4c8b1c0 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:31.707350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0e191-f31a-4850-8ae7-5285269a32a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:31.708190 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0e191-f31a-4850-8ae7-5285269a32a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:31.708589 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0e191-f31a-4850-8ae7-5285269a32a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:31.708892 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783bd8e-4cac-4505-af66-4b8a404db3ed admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:31.709934 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0e191-f31a-4850-8ae7-5285269a32a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:31.710780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0e191-f31a-4850-8ae7-5285269a32a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:31.712726 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0e191-f31a-4850-8ae7-5285269a32a1 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:31.726609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72dd712-9316-42a0-9b9b-407624749654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:31.727675 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dd712-9316-42a0-9b9b-407624749654 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:31.728102 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dd712-9316-42a0-9b9b-407624749654 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:31.728520 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dd712-9316-42a0-9b9b-407624749654 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:31.729401 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72dd712-9316-42a0-9b9b-407624749654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:31.731261 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72dd712-9316-42a0-9b9b-407624749654 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:31.745467 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 897/1765] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:31.746556 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0e191-f31a-4850-8ae7-5285269a32a1 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:31.752556 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 869/1766] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:31.753625 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72dd712-9316-42a0-9b9b-407624749654 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:31.765504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0e191-f31a-4850-8ae7-5285269a32a1 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:31.778638 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72dd712-9316-42a0-9b9b-407624749654 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:31.790526 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d92f3-91c7-41bc-b242-e9be770a573b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:31.791372 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05239bc4-1ab7-4b3f-9967-86d480c5d521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:31.792642 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05239bc4-1ab7-4b3f-9967-86d480c5d521 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:31.793084 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05239bc4-1ab7-4b3f-9967-86d480c5d521 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:31.793502 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05239bc4-1ab7-4b3f-9967-86d480c5d521 admin admin] PATH_INFO: `/v3/projects/00fe71f0b79946f9a2bc86f1a4b02032/users/9ba036a140404484be0875ead59d296f/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:31.794083 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d92f3-91c7-41bc-b242-e9be770a573b admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:31.795072 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d92f3-91c7-41bc-b242-e9be770a573b admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:31.796675 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d92f3-91c7-41bc-b242-e9be770a573b admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:31.797607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05239bc4-1ab7-4b3f-9967-86d480c5d521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00fe71f0b79946f9a2bc86f1a4b02032, user_id=9ba036a140404484be0875ead59d296f, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:31.798556 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d92f3-91c7-41bc-b242-e9be770a573b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:31.803455 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05239bc4-1ab7-4b3f-9967-86d480c5d521 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:31.808631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d92f3-91c7-41bc-b242-e9be770a573b admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:31.850485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 870/1767] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:31 2022] PUT /identity/v3/projects/00fe71f0b79946f9a2bc86f1a4b02032/users/9ba036a140404484be0875ead59d296f/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:31.850485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05239bc4-1ab7-4b3f-9967-86d480c5d521 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:31.880990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 898/1768] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:31 2022] POST /identity/v3/users => generated 294 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:31.886670 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9981d-f334-4f54-8f82-56b9ca8b33c7 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:31.890341 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9981d-f334-4f54-8f82-56b9ca8b33c7 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:31.891048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9981d-f334-4f54-8f82-56b9ca8b33c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:31.962129 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-f7b9981d-f334-4f54-8f82-56b9ca8b33c7 None None] MFA Rules not processed for user `9ba036a140404484be0875ead59d296f`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:31.963926 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-f7b9981d-f334-4f54-8f82-56b9ca8b33c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:32.013744 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05239bc4-1ab7-4b3f-9967-86d480c5d521 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:32.032266 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9135d09-c6fd-4494-a7f5-71cdec9485d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:32.033289 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9135d09-c6fd-4494-a7f5-71cdec9485d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:32.033611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9135d09-c6fd-4494-a7f5-71cdec9485d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:32.033904 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9135d09-c6fd-4494-a7f5-71cdec9485d8 admin admin] PATH_INFO: `/v3/projects/9f7576dafd374f24a71a30181ec9ac52/users/de444e5a943b4b8f96587f38425f1917/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:32.039679 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9135d09-c6fd-4494-a7f5-71cdec9485d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f7576dafd374f24a71a30181ec9ac52, user_id=de444e5a943b4b8f96587f38425f1917, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:32.042782 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9135d09-c6fd-4494-a7f5-71cdec9485d8 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:32.082688 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 871/1769] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:31 2022] PUT /identity/v3/projects/9f7576dafd374f24a71a30181ec9ac52/users/de444e5a943b4b8f96587f38425f1917/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:32.082688 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9135d09-c6fd-4494-a7f5-71cdec9485d8 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:32.212971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 899/1770] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:31 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:32.212971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f849c0-9564-4105-8746-bf4cef29681b None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:32.212971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f849c0-9564-4105-8746-bf4cef29681b None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:32.212971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f849c0-9564-4105-8746-bf4cef29681b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:32.226766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:32.233053 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9135d09-c6fd-4494-a7f5-71cdec9485d8 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:32.243320 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a4a26-48aa-4c8f-85c7-ffc663cc44d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:32.244894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a4a26-48aa-4c8f-85c7-ffc663cc44d7 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:32.245316 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a4a26-48aa-4c8f-85c7-ffc663cc44d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:32.245707 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a4a26-48aa-4c8f-85c7-ffc663cc44d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:32.246665 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a4a26-48aa-4c8f-85c7-ffc663cc44d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:32.248673 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a4a26-48aa-4c8f-85c7-ffc663cc44d7 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:32.255321 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-58f849c0-9564-4105-8746-bf4cef29681b None None] MFA Rules not processed for user `de444e5a943b4b8f96587f38425f1917`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:32.256750 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-58f849c0-9564-4105-8746-bf4cef29681b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:32.267169 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 872/1771] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:32.268645 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a4a26-48aa-4c8f-85c7-ffc663cc44d7 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:32.272611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-072a4a26-48aa-4c8f-85c7-ffc663cc44d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:32.349556 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 900/1772] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:32.349556 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f849c0-9564-4105-8746-bf4cef29681b None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:32.361768 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a4a26-48aa-4c8f-85c7-ffc663cc44d7 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:32.368951 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8fe43-bb28-4d23-82c0-e15748c64c88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:32.369807 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8fe43-bb28-4d23-82c0-e15748c64c88 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:32.370277 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8fe43-bb28-4d23-82c0-e15748c64c88 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:32.370843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8fe43-bb28-4d23-82c0-e15748c64c88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:32.387137 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f849c0-9564-4105-8746-bf4cef29681b None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:32.408893 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cde80-683e-4e41-9cea-72a10169b020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:32.409600 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cde80-683e-4e41-9cea-72a10169b020 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:32.410048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cde80-683e-4e41-9cea-72a10169b020 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:32.410933 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cde80-683e-4e41-9cea-72a10169b020 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:32.411383 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cde80-683e-4e41-9cea-72a10169b020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:32.415346 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cde80-683e-4e41-9cea-72a10169b020 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:32.446382 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 901/1773] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:32.447414 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cde80-683e-4e41-9cea-72a10169b020 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:32.453910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-7d6cde80-683e-4e41-9cea-72a10169b020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:32.486342 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cde80-683e-4e41-9cea-72a10169b020 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:32.501129 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d70a02-00c5-44de-becd-e70c66065e9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:32.502847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d70a02-00c5-44de-becd-e70c66065e9c service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:32.503200 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d70a02-00c5-44de-becd-e70c66065e9c service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:32.503517 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d70a02-00c5-44de-becd-e70c66065e9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:32.507403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-34d70a02-00c5-44de-becd-e70c66065e9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:32.569451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:32.614835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8fe43-bb28-4d23-82c0-e15748c64c88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:32.618564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d70a02-00c5-44de-becd-e70c66065e9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:32.620606 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8fe43-bb28-4d23-82c0-e15748c64c88 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:32.622534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d70a02-00c5-44de-becd-e70c66065e9c service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:32.662362 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 902/1774] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:32.663129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 873/1775] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:32 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:32.667837 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d70a02-00c5-44de-becd-e70c66065e9c service cinder] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:32.670026 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279fbb5-a60e-4a84-b70b-c7d346df0ac3 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:32.670988 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279fbb5-a60e-4a84-b70b-c7d346df0ac3 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:32.672124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279fbb5-a60e-4a84-b70b-c7d346df0ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:32.714728 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d70a02-00c5-44de-becd-e70c66065e9c service cinder] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:32.761293 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a704ea-683e-421d-84d8-876f7e9e66a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:32.762410 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-9279fbb5-a60e-4a84-b70b-c7d346df0ac3 None None] MFA Rules not processed for user `dbf2c12174e94e2db9be178973183ced`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:32.767943 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a704ea-683e-421d-84d8-876f7e9e66a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:32.768576 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a704ea-683e-421d-84d8-876f7e9e66a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:32.769294 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-9279fbb5-a60e-4a84-b70b-c7d346df0ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:32.770897 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a704ea-683e-421d-84d8-876f7e9e66a4 admin admin] PATH_INFO: `/v3/projects/fed4ce4c0a654317802f50d08e8536da/users/32f1947ec64847b2b9815bd98c385814/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:32.858927 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a704ea-683e-421d-84d8-876f7e9e66a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fed4ce4c0a654317802f50d08e8536da, user_id=32f1947ec64847b2b9815bd98c385814, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:32.885946 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a704ea-683e-421d-84d8-876f7e9e66a4 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:32.918467 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 903/1776] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:32 2022] PUT /identity/v3/projects/fed4ce4c0a654317802f50d08e8536da/users/32f1947ec64847b2b9815bd98c385814/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:32.930243 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c9fde-e37f-40b9-b11d-8ec42995d4d6 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:32.930825 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c9fde-e37f-40b9-b11d-8ec42995d4d6 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:32.931567 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c9fde-e37f-40b9-b11d-8ec42995d4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:33.035749 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 874/1777] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 23 15:51:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:33.043471 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-354c9fde-e37f-40b9-b11d-8ec42995d4d6 None None] MFA Rules not processed for user `32f1947ec64847b2b9815bd98c385814`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:33.044782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-354c9fde-e37f-40b9-b11d-8ec42995d4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:33.313715 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279fbb5-a60e-4a84-b70b-c7d346df0ac3 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:33.328551 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279fbb5-a60e-4a84-b70b-c7d346df0ac3 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:33.333210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 904/1778] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:51:33.338321 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c9fde-e37f-40b9-b11d-8ec42995d4d6 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:33.529209 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:33.557422 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5441249-995a-480f-bf8d-5a7cbb108539 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:33.564714 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5441249-995a-480f-bf8d-5a7cbb108539 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:33.566301 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5441249-995a-480f-bf8d-5a7cbb108539 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:33.567270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5441249-995a-480f-bf8d-5a7cbb108539 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:33.581219 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-c5441249-995a-480f-bf8d-5a7cbb108539 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:33.595201 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c9fde-e37f-40b9-b11d-8ec42995d4d6 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:33.614903 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d3b6e-bacd-49f4-87bc-9ef033ea5408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:33.616337 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d3b6e-bacd-49f4-87bc-9ef033ea5408 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:33.616658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d3b6e-bacd-49f4-87bc-9ef033ea5408 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:33.617112 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21d3b6e-bacd-49f4-87bc-9ef033ea5408 admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:33.617886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d3b6e-bacd-49f4-87bc-9ef033ea5408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:33.620209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21d3b6e-bacd-49f4-87bc-9ef033ea5408 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:33.741198 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 905/1779] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:33 2022] POST /identity/v3/projects => generated 385 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:33.742316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d3b6e-bacd-49f4-87bc-9ef033ea5408 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:33.752432 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-d21d3b6e-bacd-49f4-87bc-9ef033ea5408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:33.872753 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:33.879796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5441249-995a-480f-bf8d-5a7cbb108539 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:33.881985 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5441249-995a-480f-bf8d-5a7cbb108539 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:33.912985 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 875/1780] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:33 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:33.914802 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5441249-995a-480f-bf8d-5a7cbb108539 service cinder] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:33.942424 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5441249-995a-480f-bf8d-5a7cbb108539 service cinder] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:34.063000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21d3b6e-bacd-49f4-87bc-9ef033ea5408 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:34.086006 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddfa6e-792e-46ef-8136-76a3233f3550 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5824ee17e276483faf20db88a93545f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:34.087064 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddfa6e-792e-46ef-8136-76a3233f3550 service swift] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:34.087562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddfa6e-792e-46ef-8136-76a3233f3550 service swift] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:34.088086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddfa6e-792e-46ef-8136-76a3233f3550 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:34.187219 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdbb8a-5217-4ab9-98bf-b82a46d8d657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:34.191378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdbb8a-5217-4ab9-98bf-b82a46d8d657 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:34.191794 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdbb8a-5217-4ab9-98bf-b82a46d8d657 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:34.192093 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdbb8a-5217-4ab9-98bf-b82a46d8d657 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:34.194940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bdbb8a-5217-4ab9-98bf-b82a46d8d657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:34.200465 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bdbb8a-5217-4ab9-98bf-b82a46d8d657 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:34.239225 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddfa6e-792e-46ef-8136-76a3233f3550 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:34.243022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddfa6e-792e-46ef-8136-76a3233f3550 service swift] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:34.286559 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 876/1781] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:33 2022] POST /identity/v3/users => generated 299 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:34.295371 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdbb8a-5217-4ab9-98bf-b82a46d8d657 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:34.303103 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 906/1782] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 23 15:51:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 15:51:34.309126 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d670e-2bbd-47f8-bb50-c58907446b4e None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:34.309955 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d670e-2bbd-47f8-bb50-c58907446b4e None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:34.310484 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d670e-2bbd-47f8-bb50-c58907446b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:34.336121 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdbb8a-5217-4ab9-98bf-b82a46d8d657 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:34.382073 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cfe4d-b6ee-4d17-abfe-3787e53672c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:34.382950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cfe4d-b6ee-4d17-abfe-3787e53672c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:34.387974 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cfe4d-b6ee-4d17-abfe-3787e53672c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:34.390083 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084cfe4d-b6ee-4d17-abfe-3787e53672c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:34.395417 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cfe4d-b6ee-4d17-abfe-3787e53672c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:34.410723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084cfe4d-b6ee-4d17-abfe-3787e53672c5 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:34.449366 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 877/1783] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:34.460730 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-df7d670e-2bbd-47f8-bb50-c58907446b4e None None] MFA Rules not processed for user `7fe974cf493c4545abc70a6745359a66`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:34.462966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-df7d670e-2bbd-47f8-bb50-c58907446b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:34.464091 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cfe4d-b6ee-4d17-abfe-3787e53672c5 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:34.507274 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084cfe4d-b6ee-4d17-abfe-3787e53672c5 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:34.549436 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f338c-88dc-4bb1-a3a8-3f15475c50c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:34.550813 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f338c-88dc-4bb1-a3a8-3f15475c50c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:34.551266 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f338c-88dc-4bb1-a3a8-3f15475c50c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:34.551723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f338c-88dc-4bb1-a3a8-3f15475c50c2 admin admin] PATH_INFO: `/v3/projects/57b4117f83974c9a96d9fcccbe7048c9/users/d13c70843aa447b7903a7d982df8c48d/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:34.614457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f338c-88dc-4bb1-a3a8-3f15475c50c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b4117f83974c9a96d9fcccbe7048c9, user_id=d13c70843aa447b7903a7d982df8c48d, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:34.619246 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f338c-88dc-4bb1-a3a8-3f15475c50c2 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:34.687360 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 878/1784] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:34 2022] PUT /identity/v3/projects/57b4117f83974c9a96d9fcccbe7048c9/users/d13c70843aa447b7903a7d982df8c48d/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:34.688892 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f338c-88dc-4bb1-a3a8-3f15475c50c2 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:34.721742 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 907/1785] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:34.826610 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:34.840402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f338c-88dc-4bb1-a3a8-3f15475c50c2 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:34.899643 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd7400-9871-4f19-96fb-4d369230f003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:34.900840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd7400-9871-4f19-96fb-4d369230f003 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:34.909935 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd7400-9871-4f19-96fb-4d369230f003 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:34.912785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd7400-9871-4f19-96fb-4d369230f003 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:34.923660 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd7400-9871-4f19-96fb-4d369230f003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:34.925777 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd7400-9871-4f19-96fb-4d369230f003 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:35.027540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 879/1786] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:35.032505 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d670e-2bbd-47f8-bb50-c58907446b4e None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:35.129990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d670e-2bbd-47f8-bb50-c58907446b4e None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:35.164055 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe7370-1694-445b-ba1f-ec18f744900d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:35.171944 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe7370-1694-445b-ba1f-ec18f744900d admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:35.172556 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe7370-1694-445b-ba1f-ec18f744900d admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:35.173238 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe7370-1694-445b-ba1f-ec18f744900d admin admin] PATH_INFO: `/v3/projects/57b4117f83974c9a96d9fcccbe7048c9/users/d13c70843aa447b7903a7d982df8c48d/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:35.194664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe7370-1694-445b-ba1f-ec18f744900d admin admin] RBAC: Authorizing `identity:create_grant(project_id=57b4117f83974c9a96d9fcccbe7048c9, user_id=d13c70843aa447b7903a7d982df8c48d, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:35.218196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe7370-1694-445b-ba1f-ec18f744900d admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:35.260710 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 908/1787] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:35 2022] PUT /identity/v3/projects/57b4117f83974c9a96d9fcccbe7048c9/users/d13c70843aa447b7903a7d982df8c48d/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:35.272699 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202964a-029e-46c8-830b-daf526c8a287 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:35.273210 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202964a-029e-46c8-830b-daf526c8a287 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:35.273427 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202964a-029e-46c8-830b-daf526c8a287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:35.477801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-5202964a-029e-46c8-830b-daf526c8a287 None None] MFA Rules not processed for user `d13c70843aa447b7903a7d982df8c48d`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:35.485789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-5202964a-029e-46c8-830b-daf526c8a287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:35.925380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 880/1788] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 655 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:35.974491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe7370-1694-445b-ba1f-ec18f744900d admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:36.256874 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe7370-1694-445b-ba1f-ec18f744900d admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:36.266911 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45306f71-f301-4cee-870a-d0ffdeac7e90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:36.267732 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45306f71-f301-4cee-870a-d0ffdeac7e90 service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:36.268027 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45306f71-f301-4cee-870a-d0ffdeac7e90 service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:36.269673 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45306f71-f301-4cee-870a-d0ffdeac7e90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:36.328631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45306f71-f301-4cee-870a-d0ffdeac7e90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:36.343891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45306f71-f301-4cee-870a-d0ffdeac7e90 service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:36.369845 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:36.430339 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 909/1789] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:36.534124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202964a-029e-46c8-830b-daf526c8a287 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:36.731823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202964a-029e-46c8-830b-daf526c8a287 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:36.739874 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc2d1a-7321-4d0c-8c73-01a38367e04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:36.740774 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc2d1a-7321-4d0c-8c73-01a38367e04f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:36.741109 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc2d1a-7321-4d0c-8c73-01a38367e04f admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:36.741621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc2d1a-7321-4d0c-8c73-01a38367e04f admin admin] PATH_INFO: `/v3/users/32f1947ec64847b2b9815bd98c385814` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:36.742973 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc2d1a-7321-4d0c-8c73-01a38367e04f admin admin] RBAC: Authorizing `identity:delete_user(user_id=32f1947ec64847b2b9815bd98c385814)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:36.745409 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc2d1a-7321-4d0c-8c73-01a38367e04f admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:36.857464 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-51bc2d1a-7321-4d0c-8c73-01a38367e04f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32f1947ec64847b2b9815bd98c385814'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:36.870315 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-51bc2d1a-7321-4d0c-8c73-01a38367e04f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32f1947ec64847b2b9815bd98c385814'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:36.870656 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-51bc2d1a-7321-4d0c-8c73-01a38367e04f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32f1947ec64847b2b9815bd98c385814'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:36.871279 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-51bc2d1a-7321-4d0c-8c73-01a38367e04f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32f1947ec64847b2b9815bd98c385814'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:36.894693 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-51bc2d1a-7321-4d0c-8c73-01a38367e04f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32f1947ec64847b2b9815bd98c385814'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:36.915783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:36.925219 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 881/1790] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:51:36 2022] DELETE /identity/v3/users/32f1947ec64847b2b9815bd98c385814 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:36.930541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729ec03-3d50-478d-a6ba-c7d8d503b0fd None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:36.931010 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729ec03-3d50-478d-a6ba-c7d8d503b0fd None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:36.931435 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729ec03-3d50-478d-a6ba-c7d8d503b0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:37.004533 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-0729ec03-3d50-478d-a6ba-c7d8d503b0fd None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:37.006863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-0729ec03-3d50-478d-a6ba-c7d8d503b0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:37.245118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc2d1a-7321-4d0c-8c73-01a38367e04f admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:37.248348 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-51bc2d1a-7321-4d0c-8c73-01a38367e04f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:37.355487 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 910/1791] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:37.482508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729ec03-3d50-478d-a6ba-c7d8d503b0fd None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:37.484114 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-0729ec03-3d50-478d-a6ba-c7d8d503b0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:37.658467 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc2d1a-7321-4d0c-8c73-01a38367e04f admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:37.674274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729ec03-3d50-478d-a6ba-c7d8d503b0fd None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:37.680253 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4abc0a-fd68-443a-b7de-35d88266f27b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:37.684891 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4abc0a-fd68-443a-b7de-35d88266f27b service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:37.686330 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4abc0a-fd68-443a-b7de-35d88266f27b service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:37.687062 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2c9b5-5ce9-4abb-91bb-2662987a2126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:37.688054 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2c9b5-5ce9-4abb-91bb-2662987a2126 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:37.688290 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4abc0a-fd68-443a-b7de-35d88266f27b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:37.688799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2c9b5-5ce9-4abb-91bb-2662987a2126 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:37.689281 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2c9b5-5ce9-4abb-91bb-2662987a2126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:37.695315 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-cc4abc0a-fd68-443a-b7de-35d88266f27b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:37.716811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2c9b5-5ce9-4abb-91bb-2662987a2126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:37.718936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2c9b5-5ce9-4abb-91bb-2662987a2126 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:37.748753 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 911/1792] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:51:38.022999 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4abc0a-fd68-443a-b7de-35d88266f27b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:38.025364 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4abc0a-fd68-443a-b7de-35d88266f27b service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:38.054324 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 882/1793] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 815 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:39.674533 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12170f90-50e7-4c8e-8e04-b19751613f2e None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:39.677179 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12170f90-50e7-4c8e-8e04-b19751613f2e None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:39.677888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12170f90-50e7-4c8e-8e04-b19751613f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:39.767859 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-12170f90-50e7-4c8e-8e04-b19751613f2e None None] MFA Rules not processed for user `44e9fc6def5341a589221350067bb0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:39.772898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-12170f90-50e7-4c8e-8e04-b19751613f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:39.803817 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 912/1794] 10.222.0.33 () {58 vars in 1015 bytes} [Thu Jun 23 15:51:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:39.998141 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4abc0a-fd68-443a-b7de-35d88266f27b service cinder] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:40.043237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4abc0a-fd68-443a-b7de-35d88266f27b service cinder] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:40.098172 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7388c-373b-4714-b272-6d181a0a56bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:40.098172 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7388c-373b-4714-b272-6d181a0a56bd service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:40.098172 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7388c-373b-4714-b272-6d181a0a56bd service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:40.098172 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7388c-373b-4714-b272-6d181a0a56bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:40.147444 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7388c-373b-4714-b272-6d181a0a56bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:40.164484 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7388c-373b-4714-b272-6d181a0a56bd service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:40.285268 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 883/1795] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:40.508593 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12170f90-50e7-4c8e-8e04-b19751613f2e None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:40.547669 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12170f90-50e7-4c8e-8e04-b19751613f2e None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:40.556366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b4ea7-48a3-4d65-9687-f2af4cdc2c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:40.558744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b4ea7-48a3-4d65-9687-f2af4cdc2c0e service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:40.559185 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b4ea7-48a3-4d65-9687-f2af4cdc2c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:40.559575 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b4ea7-48a3-4d65-9687-f2af4cdc2c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:40.588188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b4ea7-48a3-4d65-9687-f2af4cdc2c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:40.590524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b4ea7-48a3-4d65-9687-f2af4cdc2c0e service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:40.633073 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 913/1796] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:42.902657 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7388c-373b-4714-b272-6d181a0a56bd service neutron] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:42.904338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-c4c7388c-373b-4714-b272-6d181a0a56bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:42.939632 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7388c-373b-4714-b272-6d181a0a56bd service neutron] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:42.957749 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecb668-1cd5-4f26-947b-721d31ab6109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:42.958960 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecb668-1cd5-4f26-947b-721d31ab6109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:42.959417 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecb668-1cd5-4f26-947b-721d31ab6109 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:42.960037 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecb668-1cd5-4f26-947b-721d31ab6109 admin admin] PATH_INFO: `/v3/users/0e459bed33ba444ca7c025b6204ba00c` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:42.962210 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ecb668-1cd5-4f26-947b-721d31ab6109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e459bed33ba444ca7c025b6204ba00c)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:42.973312 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ecb668-1cd5-4f26-947b-721d31ab6109 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:43.084815 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-64ecb668-1cd5-4f26-947b-721d31ab6109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e459bed33ba444ca7c025b6204ba00c'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:43.094787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-64ecb668-1cd5-4f26-947b-721d31ab6109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e459bed33ba444ca7c025b6204ba00c'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:43.096086 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-64ecb668-1cd5-4f26-947b-721d31ab6109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e459bed33ba444ca7c025b6204ba00c'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:43.096985 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-64ecb668-1cd5-4f26-947b-721d31ab6109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e459bed33ba444ca7c025b6204ba00c'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:43.132529 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-64ecb668-1cd5-4f26-947b-721d31ab6109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e459bed33ba444ca7c025b6204ba00c'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:43.162110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 884/1797] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:51:42 2022] DELETE /identity/v3/users/0e459bed33ba444ca7c025b6204ba00c => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:43.166250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbde11-96a7-46eb-9b2b-60cfd128780b None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:43.167337 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbde11-96a7-46eb-9b2b-60cfd128780b None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:43.167812 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbde11-96a7-46eb-9b2b-60cfd128780b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:43.211002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-7ebbde11-96a7-46eb-9b2b-60cfd128780b None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:43.214151 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecb668-1cd5-4f26-947b-721d31ab6109 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:43.215710 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-64ecb668-1cd5-4f26-947b-721d31ab6109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:43.226942 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-7ebbde11-96a7-46eb-9b2b-60cfd128780b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:43.237593 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:43.469635 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecb668-1cd5-4f26-947b-721d31ab6109 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:43.478999 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 914/1798] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:43.486538 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fd912-c180-4d69-9d10-a153f536b017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:43.487469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fd912-c180-4d69-9d10-a153f536b017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:43.487757 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fd912-c180-4d69-9d10-a153f536b017 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:43.488293 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fd912-c180-4d69-9d10-a153f536b017 admin admin] PATH_INFO: `/v3/projects/fed4ce4c0a654317802f50d08e8536da` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:43.497054 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5fd912-c180-4d69-9d10-a153f536b017 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fed4ce4c0a654317802f50d08e8536da)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:43.504081 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5fd912-c180-4d69-9d10-a153f536b017 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:43.609110 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbde11-96a7-46eb-9b2b-60cfd128780b None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:43.612883 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-7ebbde11-96a7-46eb-9b2b-60cfd128780b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:43.695090 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:43.708508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-3e5fd912-c180-4d69-9d10-a153f536b017 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fed4ce4c0a654317802f50d08e8536da', 'request_id': 'req-3e5fd912-c180-4d69-9d10-a153f536b017'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:43.753150 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-3e5fd912-c180-4d69-9d10-a153f536b017 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fed4ce4c0a654317802f50d08e8536da', 'request_id': 'req-3e5fd912-c180-4d69-9d10-a153f536b017'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:43.786047 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-3e5fd912-c180-4d69-9d10-a153f536b017 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fed4ce4c0a654317802f50d08e8536da', 'request_id': 'req-3e5fd912-c180-4d69-9d10-a153f536b017'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:43.822779 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbde11-96a7-46eb-9b2b-60cfd128780b None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:43.831464 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-3e5fd912-c180-4d69-9d10-a153f536b017 admin admin] The token cache is being invalidate because project fed4ce4c0a654317802f50d08e8536da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:51:43.831776 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-3e5fd912-c180-4d69-9d10-a153f536b017 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:43.836795 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-3e5fd912-c180-4d69-9d10-a153f536b017 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:43.842285 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 885/1799] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:51:43 2022] DELETE /identity/v3/projects/fed4ce4c0a654317802f50d08e8536da => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:43.847051 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fd912-c180-4d69-9d10-a153f536b017 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:43.854882 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-3e5fd912-c180-4d69-9d10-a153f536b017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:43.992012 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6573e887-ae5d-46bc-bb7f-94e62e3b1c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:43.992012 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573e887-ae5d-46bc-bb7f-94e62e3b1c0e service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:43.992012 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573e887-ae5d-46bc-bb7f-94e62e3b1c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:43.992012 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6573e887-ae5d-46bc-bb7f-94e62e3b1c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:43.996340 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-6573e887-ae5d-46bc-bb7f-94e62e3b1c0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:44.054294 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fd912-c180-4d69-9d10-a153f536b017 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:44.064475 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319659e-a57c-46bd-aebb-4b731f07323d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:44.065992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319659e-a57c-46bd-aebb-4b731f07323d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:44.066476 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319659e-a57c-46bd-aebb-4b731f07323d admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:44.067036 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319659e-a57c-46bd-aebb-4b731f07323d admin admin] PATH_INFO: `/v3/users/d13c70843aa447b7903a7d982df8c48d` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:44.070385 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319659e-a57c-46bd-aebb-4b731f07323d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d13c70843aa447b7903a7d982df8c48d)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:44.074665 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319659e-a57c-46bd-aebb-4b731f07323d admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:44.233744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573e887-ae5d-46bc-bb7f-94e62e3b1c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:44.240811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6573e887-ae5d-46bc-bb7f-94e62e3b1c0e service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:44.241422 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:44.280047 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c319659e-a57c-46bd-aebb-4b731f07323d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd13c70843aa447b7903a7d982df8c48d'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:44.286155 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 915/1800] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:44.294144 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c319659e-a57c-46bd-aebb-4b731f07323d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd13c70843aa447b7903a7d982df8c48d'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:44.295530 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c319659e-a57c-46bd-aebb-4b731f07323d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd13c70843aa447b7903a7d982df8c48d'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:44.297079 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c319659e-a57c-46bd-aebb-4b731f07323d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd13c70843aa447b7903a7d982df8c48d'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:44.333129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c319659e-a57c-46bd-aebb-4b731f07323d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd13c70843aa447b7903a7d982df8c48d'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:44.375990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 886/1801] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:51:43 2022] DELETE /identity/v3/users/d13c70843aa447b7903a7d982df8c48d => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:46.551669 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bb18f-d887-4779-b975-1223cce29f11 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:46.552629 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bb18f-d887-4779-b975-1223cce29f11 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:46.553887 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bb18f-d887-4779-b975-1223cce29f11 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:46.555535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 916/1802] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jun 23 15:51:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:51:46.734047 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6a72e-3604-46a0-8d3d-c4df4d7bd775 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:46.734633 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6a72e-3604-46a0-8d3d-c4df4d7bd775 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:46.734633 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6a72e-3604-46a0-8d3d-c4df4d7bd775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:46.835450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-25c6a72e-3604-46a0-8d3d-c4df4d7bd775 None None] MFA Rules not processed for user `d54521ea1dca44c98d6723d0b9fd6468`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:46.836717 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-25c6a72e-3604-46a0-8d3d-c4df4d7bd775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:47.062164 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 887/1803] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jun 23 15:51:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:47.766743 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bb18f-d887-4779-b975-1223cce29f11 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:47.768619 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-8e7bb18f-d887-4779-b975-1223cce29f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:47.987464 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bb18f-d887-4779-b975-1223cce29f11 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:47.999607 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ca238-4b4a-40e9-975d-94a7cd7cfe1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:48.003653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ca238-4b4a-40e9-975d-94a7cd7cfe1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:48.006278 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ca238-4b4a-40e9-975d-94a7cd7cfe1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:48.010374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ca238-4b4a-40e9-975d-94a7cd7cfe1c admin admin] PATH_INFO: `/v3/projects/0a05b2f700d849358b02953fb33c4ac8` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:48.016641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ca238-4b4a-40e9-975d-94a7cd7cfe1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a05b2f700d849358b02953fb33c4ac8)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:48.027166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ca238-4b4a-40e9-975d-94a7cd7cfe1c admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:48.091110 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:48.096183 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6a72e-3604-46a0-8d3d-c4df4d7bd775 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:48.098032 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-25c6a72e-3604-46a0-8d3d-c4df4d7bd775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:48.111501 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-9c1ca238-4b4a-40e9-975d-94a7cd7cfe1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a05b2f700d849358b02953fb33c4ac8', 'request_id': 'req-9c1ca238-4b4a-40e9-975d-94a7cd7cfe1c'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:48.155831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6a72e-3604-46a0-8d3d-c4df4d7bd775 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:48.160708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-9c1ca238-4b4a-40e9-975d-94a7cd7cfe1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a05b2f700d849358b02953fb33c4ac8', 'request_id': 'req-9c1ca238-4b4a-40e9-975d-94a7cd7cfe1c'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:48.187495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-9c1ca238-4b4a-40e9-975d-94a7cd7cfe1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a05b2f700d849358b02953fb33c4ac8', 'request_id': 'req-9c1ca238-4b4a-40e9-975d-94a7cd7cfe1c'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:48.204598 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-9c1ca238-4b4a-40e9-975d-94a7cd7cfe1c admin admin] The token cache is being invalidate because project 0a05b2f700d849358b02953fb33c4ac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:51:48.205110 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-9c1ca238-4b4a-40e9-975d-94a7cd7cfe1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:48.206382 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-9c1ca238-4b4a-40e9-975d-94a7cd7cfe1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:48.211270 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 917/1804] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:51:47 2022] DELETE /identity/v3/projects/0a05b2f700d849358b02953fb33c4ac8 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:48.217918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ca238-4b4a-40e9-975d-94a7cd7cfe1c admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:48.229356 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-9c1ca238-4b4a-40e9-975d-94a7cd7cfe1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:48.357409 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ca238-4b4a-40e9-975d-94a7cd7cfe1c admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:48.374120 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09257b37-d1ba-4d19-a051-2be47d46f55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:48.375079 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09257b37-d1ba-4d19-a051-2be47d46f55c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:48.375479 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09257b37-d1ba-4d19-a051-2be47d46f55c admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:48.376326 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09257b37-d1ba-4d19-a051-2be47d46f55c admin admin] PATH_INFO: `/v3/users/9ba036a140404484be0875ead59d296f` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:48.380549 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09257b37-d1ba-4d19-a051-2be47d46f55c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ba036a140404484be0875ead59d296f)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:48.384414 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09257b37-d1ba-4d19-a051-2be47d46f55c admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:48.422685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e13e8a-39c8-4cc3-bafa-c4c4b3f9e653 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:48.423455 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e13e8a-39c8-4cc3-bafa-c4c4b3f9e653 service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:48.423754 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e13e8a-39c8-4cc3-bafa-c4c4b3f9e653 service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:48.424065 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e13e8a-39c8-4cc3-bafa-c4c4b3f9e653 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:48.426754 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-12e13e8a-39c8-4cc3-bafa-c4c4b3f9e653 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:48.452321 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e13e8a-39c8-4cc3-bafa-c4c4b3f9e653 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:48.455023 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e13e8a-39c8-4cc3-bafa-c4c4b3f9e653 service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:48.482802 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 888/1805] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:51:48.522958 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-09257b37-d1ba-4d19-a051-2be47d46f55c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ba036a140404484be0875ead59d296f'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:48.534546 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-09257b37-d1ba-4d19-a051-2be47d46f55c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ba036a140404484be0875ead59d296f'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:48.536508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-09257b37-d1ba-4d19-a051-2be47d46f55c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ba036a140404484be0875ead59d296f'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:48.538147 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-09257b37-d1ba-4d19-a051-2be47d46f55c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ba036a140404484be0875ead59d296f'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:48.557347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-09257b37-d1ba-4d19-a051-2be47d46f55c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ba036a140404484be0875ead59d296f'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:48.609951 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 918/1806] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:51:48 2022] DELETE /identity/v3/users/9ba036a140404484be0875ead59d296f => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:48.623634 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e13e8a-39c8-4cc3-bafa-c4c4b3f9e653 service nova] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:48.626206 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-12e13e8a-39c8-4cc3-bafa-c4c4b3f9e653 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:48.659772 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e13e8a-39c8-4cc3-bafa-c4c4b3f9e653 service nova] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:48.782966 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:48.976953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb729a99-9ef3-4574-b8b3-63cc82c2d306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:48.977238 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb729a99-9ef3-4574-b8b3-63cc82c2d306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:48.981159 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb729a99-9ef3-4574-b8b3-63cc82c2d306 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:48.981714 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb729a99-9ef3-4574-b8b3-63cc82c2d306 admin admin] PATH_INFO: `/v3/projects/57b4117f83974c9a96d9fcccbe7048c9` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:48.995996 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb729a99-9ef3-4574-b8b3-63cc82c2d306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57b4117f83974c9a96d9fcccbe7048c9)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:49.020181 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb729a99-9ef3-4574-b8b3-63cc82c2d306 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:49.132743 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-cb729a99-9ef3-4574-b8b3-63cc82c2d306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57b4117f83974c9a96d9fcccbe7048c9', 'request_id': 'req-cb729a99-9ef3-4574-b8b3-63cc82c2d306'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:49.148715 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-cb729a99-9ef3-4574-b8b3-63cc82c2d306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57b4117f83974c9a96d9fcccbe7048c9', 'request_id': 'req-cb729a99-9ef3-4574-b8b3-63cc82c2d306'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:49.160818 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-cb729a99-9ef3-4574-b8b3-63cc82c2d306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57b4117f83974c9a96d9fcccbe7048c9', 'request_id': 'req-cb729a99-9ef3-4574-b8b3-63cc82c2d306'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:49.185925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-cb729a99-9ef3-4574-b8b3-63cc82c2d306 admin admin] The token cache is being invalidate because project 57b4117f83974c9a96d9fcccbe7048c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:51:49.186566 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-cb729a99-9ef3-4574-b8b3-63cc82c2d306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:49.188600 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-cb729a99-9ef3-4574-b8b3-63cc82c2d306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:49.192967 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 889/1807] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:51:48 2022] DELETE /identity/v3/projects/57b4117f83974c9a96d9fcccbe7048c9 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:49.201103 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33c3d4-9bd3-43f9-a625-5977a737b3eb None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:49.201787 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33c3d4-9bd3-43f9-a625-5977a737b3eb None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:49.202099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33c3d4-9bd3-43f9-a625-5977a737b3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:49.276024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-5c33c3d4-9bd3-43f9-a625-5977a737b3eb None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:49.278223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5c33c3d4-9bd3-43f9-a625-5977a737b3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:49.493332 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:49.551675 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 919/1808] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:51:49.560150 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e931e4-d934-4c68-be78-afd300e6f007 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:49.560453 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e931e4-d934-4c68-be78-afd300e6f007 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:49.560778 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e931e4-d934-4c68-be78-afd300e6f007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:49.608394 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-18e931e4-d934-4c68-be78-afd300e6f007 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:49.610879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-18e931e4-d934-4c68-be78-afd300e6f007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:49.644001 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 890/1809] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:49.648078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33c3d4-9bd3-43f9-a625-5977a737b3eb None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:49.663432 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33c3d4-9bd3-43f9-a625-5977a737b3eb None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:49.684816 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618e8e1-abcf-4f96-bf1b-2639b5844720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:49.685824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618e8e1-abcf-4f96-bf1b-2639b5844720 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:49.687035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618e8e1-abcf-4f96-bf1b-2639b5844720 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:49.688613 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618e8e1-abcf-4f96-bf1b-2639b5844720 admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:49.692580 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618e8e1-abcf-4f96-bf1b-2639b5844720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:51:49.693782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618e8e1-abcf-4f96-bf1b-2639b5844720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:49.699413 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618e8e1-abcf-4f96-bf1b-2639b5844720 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:49.763474 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 920/1810] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:51:49.768019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e931e4-d934-4c68-be78-afd300e6f007 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:49.785951 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e931e4-d934-4c68-be78-afd300e6f007 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:49.801114 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab41aa-f5df-4994-b93e-d7cec32693a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:49.802666 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab41aa-f5df-4994-b93e-d7cec32693a9 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:49.802948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab41aa-f5df-4994-b93e-d7cec32693a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:49.803247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab41aa-f5df-4994-b93e-d7cec32693a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:49.805251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab41aa-f5df-4994-b93e-d7cec32693a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:49.811808 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab41aa-f5df-4994-b93e-d7cec32693a9 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:49.877903 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 891/1811] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:49 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:51:49.882127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618e8e1-abcf-4f96-bf1b-2639b5844720 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:49.895266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618e8e1-abcf-4f96-bf1b-2639b5844720 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:50.161040 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fffbc-6a68-4a53-a741-17cd6996c790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:50.161876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fffbc-6a68-4a53-a741-17cd6996c790 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:50.162358 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fffbc-6a68-4a53-a741-17cd6996c790 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:50.162692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fffbc-6a68-4a53-a741-17cd6996c790 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:50.164824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85fffbc-6a68-4a53-a741-17cd6996c790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:50.168567 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85fffbc-6a68-4a53-a741-17cd6996c790 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:50.246776 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 921/1812] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:49 2022] POST /identity/v3/users => generated 290 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:50.251590 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab41aa-f5df-4994-b93e-d7cec32693a9 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:50.285440 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab41aa-f5df-4994-b93e-d7cec32693a9 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:50.296541 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7459f0-f011-40e5-b7d3-7338ef3cc24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:50.297806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7459f0-f011-40e5-b7d3-7338ef3cc24b admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:50.298393 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7459f0-f011-40e5-b7d3-7338ef3cc24b admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:50.299046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7459f0-f011-40e5-b7d3-7338ef3cc24b admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:50.308077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7459f0-f011-40e5-b7d3-7338ef3cc24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:50.321747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7459f0-f011-40e5-b7d3-7338ef3cc24b admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:50.369766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 892/1813] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 15:51:50.373511 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fffbc-6a68-4a53-a741-17cd6996c790 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:50.391787 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fffbc-6a68-4a53-a741-17cd6996c790 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:50.420408 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec84a4-7b25-49e6-aa41-06801283148c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:50.426902 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec84a4-7b25-49e6-aa41-06801283148c admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:50.427548 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec84a4-7b25-49e6-aa41-06801283148c admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:50.427880 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec84a4-7b25-49e6-aa41-06801283148c admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:50.434214 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec84a4-7b25-49e6-aa41-06801283148c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:50.437046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec84a4-7b25-49e6-aa41-06801283148c admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:50.445563 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7459f0-f011-40e5-b7d3-7338ef3cc24b admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:50.450400 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-8d7459f0-f011-40e5-b7d3-7338ef3cc24b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:50.478595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7459f0-f011-40e5-b7d3-7338ef3cc24b admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:50.495877 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 922/1814] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 15:51:50.497387 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec84a4-7b25-49e6-aa41-06801283148c admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:50.514768 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c99d86-e6e8-427a-8b04-f2d85bd25c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:50.515670 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c99d86-e6e8-427a-8b04-f2d85bd25c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:50.515956 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c99d86-e6e8-427a-8b04-f2d85bd25c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:50.516237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c99d86-e6e8-427a-8b04-f2d85bd25c7c admin admin] PATH_INFO: `/v3/projects/00fe71f0b79946f9a2bc86f1a4b02032` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:50.526855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c99d86-e6e8-427a-8b04-f2d85bd25c7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=00fe71f0b79946f9a2bc86f1a4b02032)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:50.528856 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c99d86-e6e8-427a-8b04-f2d85bd25c7c admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:50.535467 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec84a4-7b25-49e6-aa41-06801283148c admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:50.581297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb38cd9-1495-4644-8099-22564f47a24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:50.582330 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb38cd9-1495-4644-8099-22564f47a24d admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:50.582783 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb38cd9-1495-4644-8099-22564f47a24d admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:50.583172 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb38cd9-1495-4644-8099-22564f47a24d admin admin] PATH_INFO: `/v3/projects/d03667f7ea344786985955ad1e53354d/users/b75c32a9f7004c2cbd6a7a50c4f8ce00/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:50.678396 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb38cd9-1495-4644-8099-22564f47a24d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d03667f7ea344786985955ad1e53354d, user_id=b75c32a9f7004c2cbd6a7a50c4f8ce00, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:50.704684 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-18c99d86-e6e8-427a-8b04-f2d85bd25c7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00fe71f0b79946f9a2bc86f1a4b02032', 'request_id': 'req-18c99d86-e6e8-427a-8b04-f2d85bd25c7c'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:50.707016 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb38cd9-1495-4644-8099-22564f47a24d admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:50.719466 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-18c99d86-e6e8-427a-8b04-f2d85bd25c7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00fe71f0b79946f9a2bc86f1a4b02032', 'request_id': 'req-18c99d86-e6e8-427a-8b04-f2d85bd25c7c'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:50.734025 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-18c99d86-e6e8-427a-8b04-f2d85bd25c7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00fe71f0b79946f9a2bc86f1a4b02032', 'request_id': 'req-18c99d86-e6e8-427a-8b04-f2d85bd25c7c'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:50.780290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 923/1815] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:50 2022] PUT /identity/v3/projects/d03667f7ea344786985955ad1e53354d/users/b75c32a9f7004c2cbd6a7a50c4f8ce00/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:50.799645 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b842c-719a-41db-829d-aeeb94af33a1 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:50.799921 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-18c99d86-e6e8-427a-8b04-f2d85bd25c7c admin admin] The token cache is being invalidate because project 00fe71f0b79946f9a2bc86f1a4b02032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:51:50.800108 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b842c-719a-41db-829d-aeeb94af33a1 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:50.800293 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-18c99d86-e6e8-427a-8b04-f2d85bd25c7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:50.801587 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-18c99d86-e6e8-427a-8b04-f2d85bd25c7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:50.803494 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b842c-719a-41db-829d-aeeb94af33a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:50.804597 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 893/1816] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:51:50 2022] DELETE /identity/v3/projects/00fe71f0b79946f9a2bc86f1a4b02032 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:50.810312 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f402781-5223-4e98-bb33-88d82630266c None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:50.810744 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f402781-5223-4e98-bb33-88d82630266c None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:50.811215 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f402781-5223-4e98-bb33-88d82630266c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:50.831605 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:50.852728 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-6f402781-5223-4e98-bb33-88d82630266c None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:50.855871 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-6f402781-5223-4e98-bb33-88d82630266c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:50.857348 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-ef2b842c-719a-41db-829d-aeeb94af33a1 None None] MFA Rules not processed for user `b75c32a9f7004c2cbd6a7a50c4f8ce00`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:50.861633 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ef2b842c-719a-41db-829d-aeeb94af33a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:50.983880 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 894/1817] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:51:50.992455 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4addc2-fcfa-4c7b-8518-8aef017210e6 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:50.993516 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4addc2-fcfa-4c7b-8518-8aef017210e6 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:50.993516 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4addc2-fcfa-4c7b-8518-8aef017210e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:51.011467 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 924/1818] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:51.016043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b842c-719a-41db-829d-aeeb94af33a1 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:51.019333 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ef2b842c-719a-41db-829d-aeeb94af33a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:51.037821 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-ea4addc2-fcfa-4c7b-8518-8aef017210e6 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:51.040500 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-ea4addc2-fcfa-4c7b-8518-8aef017210e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:51.051390 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 895/1819] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:51.059030 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4addc2-fcfa-4c7b-8518-8aef017210e6 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:51.070660 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4addc2-fcfa-4c7b-8518-8aef017210e6 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:51.072567 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b842c-719a-41db-829d-aeeb94af33a1 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:51.078781 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790e006-305d-4ec3-bc8f-7a9b94cf0c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:51.079742 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790e006-305d-4ec3-bc8f-7a9b94cf0c90 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:51.080150 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790e006-305d-4ec3-bc8f-7a9b94cf0c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:51.080437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790e006-305d-4ec3-bc8f-7a9b94cf0c90 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:51.081306 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790e006-305d-4ec3-bc8f-7a9b94cf0c90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:51:51.081722 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790e006-305d-4ec3-bc8f-7a9b94cf0c90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:51.083610 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790e006-305d-4ec3-bc8f-7a9b94cf0c90 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:51.093349 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903af06f-afb9-4ab8-b144-a4909602f77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:51.094067 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903af06f-afb9-4ab8-b144-a4909602f77b admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:51.094355 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903af06f-afb9-4ab8-b144-a4909602f77b admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:51.094633 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903af06f-afb9-4ab8-b144-a4909602f77b admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:51.095402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903af06f-afb9-4ab8-b144-a4909602f77b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:51.100122 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903af06f-afb9-4ab8-b144-a4909602f77b admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:51.110930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 896/1820] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:51:51.116066 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:51.116890 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790e006-305d-4ec3-bc8f-7a9b94cf0c90 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:51.139937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790e006-305d-4ec3-bc8f-7a9b94cf0c90 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:51.148911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a995ed-38b7-4791-a441-e8178f5bab1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:51.149146 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 925/1821] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:51 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:51.149240 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a995ed-38b7-4791-a441-e8178f5bab1a admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:51.149503 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a995ed-38b7-4791-a441-e8178f5bab1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:51.149788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a995ed-38b7-4791-a441-e8178f5bab1a admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:51.150546 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a995ed-38b7-4791-a441-e8178f5bab1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:51.152296 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903af06f-afb9-4ab8-b144-a4909602f77b admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:51.153418 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a995ed-38b7-4791-a441-e8178f5bab1a admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:51.193676 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 897/1822] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:51 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:51.196691 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a995ed-38b7-4791-a441-e8178f5bab1a admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:51.259675 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903af06f-afb9-4ab8-b144-a4909602f77b admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:51.309021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a995ed-38b7-4791-a441-e8178f5bab1a admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:51.321074 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377ad01-cf09-4da2-a3c2-c31ffd502aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:51.323862 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377ad01-cf09-4da2-a3c2-c31ffd502aad admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:51.325100 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377ad01-cf09-4da2-a3c2-c31ffd502aad admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:51.326040 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377ad01-cf09-4da2-a3c2-c31ffd502aad admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:51.327065 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377ad01-cf09-4da2-a3c2-c31ffd502aad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:51.330924 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377ad01-cf09-4da2-a3c2-c31ffd502aad admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:51.376473 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 898/1823] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:51 2022] POST /identity/v3/users => generated 291 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:51:51.385307 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377ad01-cf09-4da2-a3c2-c31ffd502aad admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:51.404959 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9f74a-613c-4ba9-923f-aad39ca13595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:51.406069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9f74a-613c-4ba9-923f-aad39ca13595 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:51.406567 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9f74a-613c-4ba9-923f-aad39ca13595 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:51.407360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9f74a-613c-4ba9-923f-aad39ca13595 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:51.408299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9f74a-613c-4ba9-923f-aad39ca13595 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:51.408689 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377ad01-cf09-4da2-a3c2-c31ffd502aad admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:51.411603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9f74a-613c-4ba9-923f-aad39ca13595 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:51.416783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a867722-a60c-49b5-a8f7-2fd19b0d2b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:51.417596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a867722-a60c-49b5-a8f7-2fd19b0d2b76 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:51.418029 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a867722-a60c-49b5-a8f7-2fd19b0d2b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:51.418434 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a867722-a60c-49b5-a8f7-2fd19b0d2b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:51.419288 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a867722-a60c-49b5-a8f7-2fd19b0d2b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:51.421115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a867722-a60c-49b5-a8f7-2fd19b0d2b76 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:51.447664 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 899/1824] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:51.458058 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a867722-a60c-49b5-a8f7-2fd19b0d2b76 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:51.473394 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a867722-a60c-49b5-a8f7-2fd19b0d2b76 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:51.473755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 926/1825] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:51 2022] POST /identity/v3/users => generated 296 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:51:51.475183 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9f74a-613c-4ba9-923f-aad39ca13595 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:51.488833 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b618ed-08e7-41a2-8e92-e1f4af901984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:51.489538 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b618ed-08e7-41a2-8e92-e1f4af901984 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:51.489887 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b618ed-08e7-41a2-8e92-e1f4af901984 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:51.490204 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b618ed-08e7-41a2-8e92-e1f4af901984 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:51.491053 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b618ed-08e7-41a2-8e92-e1f4af901984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:51.492656 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b618ed-08e7-41a2-8e92-e1f4af901984 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:51.497495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9f74a-613c-4ba9-923f-aad39ca13595 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:51.504677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2daa2b-5bc2-44ce-bf36-bf3346c255b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:51.505370 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2daa2b-5bc2-44ce-bf36-bf3346c255b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:51.505680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2daa2b-5bc2-44ce-bf36-bf3346c255b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:51.506152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2daa2b-5bc2-44ce-bf36-bf3346c255b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:51.507005 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2daa2b-5bc2-44ce-bf36-bf3346c255b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:51.513902 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2daa2b-5bc2-44ce-bf36-bf3346c255b8 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:51.521555 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 900/1826] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:51.524018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b618ed-08e7-41a2-8e92-e1f4af901984 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:51.534529 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 927/1827] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:51.535818 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3348cb-aa07-47cc-b829-fefb5299faab None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:51.536188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3348cb-aa07-47cc-b829-fefb5299faab None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:51.537445 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3348cb-aa07-47cc-b829-fefb5299faab None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:51.539143 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 928/1828] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jun 23 15:51:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:51:51.543946 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3348cb-aa07-47cc-b829-fefb5299faab None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:51.556599 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b618ed-08e7-41a2-8e92-e1f4af901984 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:51.569576 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdca73-5b8c-426f-9eac-097ecefead49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:51.570542 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdca73-5b8c-426f-9eac-097ecefead49 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:51.570829 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdca73-5b8c-426f-9eac-097ecefead49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:51.571109 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdca73-5b8c-426f-9eac-097ecefead49 admin admin] PATH_INFO: `/v3/projects/a25f2429bdd241bc94797d9fbff034ec/users/1df8ccd3cc32418b8adbf8e43fcd45b6/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:51.571847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3348cb-aa07-47cc-b829-fefb5299faab None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:51.585348 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8eeb5b-2a16-435a-a8ef-068cc71deab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:51.586796 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8eeb5b-2a16-435a-a8ef-068cc71deab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:51.587163 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8eeb5b-2a16-435a-a8ef-068cc71deab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:51.587520 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8eeb5b-2a16-435a-a8ef-068cc71deab9 admin admin] PATH_INFO: `/v3/projects/48352e9503f841ce83021615da8e0071/users/eb61da8b95de4d99a4085e86774e0068/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:51.602360 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdca73-5b8c-426f-9eac-097ecefead49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a25f2429bdd241bc94797d9fbff034ec, user_id=1df8ccd3cc32418b8adbf8e43fcd45b6, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:51.605309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdca73-5b8c-426f-9eac-097ecefead49 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:51.612089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8eeb5b-2a16-435a-a8ef-068cc71deab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48352e9503f841ce83021615da8e0071, user_id=eb61da8b95de4d99a4085e86774e0068, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:51.615168 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8eeb5b-2a16-435a-a8ef-068cc71deab9 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:51.628695 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 901/1829] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:51 2022] PUT /identity/v3/projects/a25f2429bdd241bc94797d9fbff034ec/users/1df8ccd3cc32418b8adbf8e43fcd45b6/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:51.643188 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b67768-63c1-47a6-9fe4-1a844b7bdc73 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:51.643295 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b67768-63c1-47a6-9fe4-1a844b7bdc73 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:51.643729 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b67768-63c1-47a6-9fe4-1a844b7bdc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:51.668468 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 929/1830] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:51 2022] PUT /identity/v3/projects/48352e9503f841ce83021615da8e0071/users/eb61da8b95de4d99a4085e86774e0068/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:51.676897 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44057f44-0327-407a-8593-8663b68d7904 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:51.677368 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44057f44-0327-407a-8593-8663b68d7904 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:51.677838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44057f44-0327-407a-8593-8663b68d7904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:51.680413 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-79b67768-63c1-47a6-9fe4-1a844b7bdc73 None None] MFA Rules not processed for user `d54521ea1dca44c98d6723d0b9fd6468`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:51.683079 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-79b67768-63c1-47a6-9fe4-1a844b7bdc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:51.696211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:51.726944 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-44057f44-0327-407a-8593-8663b68d7904 None None] MFA Rules not processed for user `1df8ccd3cc32418b8adbf8e43fcd45b6`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:51.728945 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-44057f44-0327-407a-8593-8663b68d7904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:51.801825 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:51.926106 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 930/1831] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:51.927118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44057f44-0327-407a-8593-8663b68d7904 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:51.943528 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 902/1832] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jun 23 15:51:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:51.944726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b67768-63c1-47a6-9fe4-1a844b7bdc73 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:52.005844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44057f44-0327-407a-8593-8663b68d7904 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:52.011741 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7004de-ef9c-41f6-949a-6e3d1c1e789e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:52.012527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7004de-ef9c-41f6-949a-6e3d1c1e789e admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:52.012827 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7004de-ef9c-41f6-949a-6e3d1c1e789e admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:52.013110 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7004de-ef9c-41f6-949a-6e3d1c1e789e admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:52.013928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7004de-ef9c-41f6-949a-6e3d1c1e789e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:52.015604 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7004de-ef9c-41f6-949a-6e3d1c1e789e admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:52.025310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b67768-63c1-47a6-9fe4-1a844b7bdc73 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:52.027434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 931/1833] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:52.028243 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7004de-ef9c-41f6-949a-6e3d1c1e789e admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:52.030296 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-3e7004de-ef9c-41f6-949a-6e3d1c1e789e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:52.040537 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a48fa-4517-4f9f-99ff-4d6aea222fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:52.041213 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a48fa-4517-4f9f-99ff-4d6aea222fda admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:52.041572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a48fa-4517-4f9f-99ff-4d6aea222fda admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:52.041759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4a48fa-4517-4f9f-99ff-4d6aea222fda admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:52.042497 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a48fa-4517-4f9f-99ff-4d6aea222fda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:52.044394 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4a48fa-4517-4f9f-99ff-4d6aea222fda admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:52.060380 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7004de-ef9c-41f6-949a-6e3d1c1e789e admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:52.068867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c98fe5-e3e1-4020-b11d-108b3c386aba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:52.069456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c98fe5-e3e1-4020-b11d-108b3c386aba service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:52.069725 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c98fe5-e3e1-4020-b11d-108b3c386aba service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:52.070041 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c98fe5-e3e1-4020-b11d-108b3c386aba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:52.081079 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c98fe5-e3e1-4020-b11d-108b3c386aba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:52.082193 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 903/1834] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:51 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:52.083038 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a48fa-4517-4f9f-99ff-4d6aea222fda admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:52.087186 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c98fe5-e3e1-4020-b11d-108b3c386aba service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:52.105640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 932/1835] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:52.106728 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c98fe5-e3e1-4020-b11d-108b3c386aba service nova] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:52.122236 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c98fe5-e3e1-4020-b11d-108b3c386aba service nova] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:52.198232 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4a48fa-4517-4f9f-99ff-4d6aea222fda admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:52.207819 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922d0ad-c9ab-4b5f-8d28-f8ed4bce4da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:52.209730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922d0ad-c9ab-4b5f-8d28-f8ed4bce4da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:52.210236 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922d0ad-c9ab-4b5f-8d28-f8ed4bce4da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:52.210693 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922d0ad-c9ab-4b5f-8d28-f8ed4bce4da8 admin admin] PATH_INFO: `/v3/projects/48352e9503f841ce83021615da8e0071/users/eb61da8b95de4d99a4085e86774e0068/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:52.213258 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922d0ad-c9ab-4b5f-8d28-f8ed4bce4da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48352e9503f841ce83021615da8e0071, user_id=eb61da8b95de4d99a4085e86774e0068, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:52.213386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d4ef2-6b57-4d42-b96c-46d4995710fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:52.214030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d4ef2-6b57-4d42-b96c-46d4995710fc admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:52.214327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d4ef2-6b57-4d42-b96c-46d4995710fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:52.214978 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d4ef2-6b57-4d42-b96c-46d4995710fc admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:52.215294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d4ef2-6b57-4d42-b96c-46d4995710fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:52.215995 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922d0ad-c9ab-4b5f-8d28-f8ed4bce4da8 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:52.217219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d4ef2-6b57-4d42-b96c-46d4995710fc admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:52.229217 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 904/1836] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:52 2022] PUT /identity/v3/projects/48352e9503f841ce83021615da8e0071/users/eb61da8b95de4d99a4085e86774e0068/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:52.241516 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccda71-fd5e-4b16-b13d-e883d651c152 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:52.241883 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccda71-fd5e-4b16-b13d-e883d651c152 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:52.242182 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccda71-fd5e-4b16-b13d-e883d651c152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:52.269319 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 933/1837] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:52 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:52.270802 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d4ef2-6b57-4d42-b96c-46d4995710fc admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:52.275691 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-16ccda71-fd5e-4b16-b13d-e883d651c152 None None] MFA Rules not processed for user `eb61da8b95de4d99a4085e86774e0068`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:52.276895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-16ccda71-fd5e-4b16-b13d-e883d651c152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:52.284430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d4ef2-6b57-4d42-b96c-46d4995710fc admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:52.299733 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:52.387323 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:52.404370 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5591b8f-1ea2-48a9-9136-daca9a4b9af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:52.405132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5591b8f-1ea2-48a9-9136-daca9a4b9af8 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:52.405609 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5591b8f-1ea2-48a9-9136-daca9a4b9af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:52.406160 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5591b8f-1ea2-48a9-9136-daca9a4b9af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:52.410692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5591b8f-1ea2-48a9-9136-daca9a4b9af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:52.412914 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5591b8f-1ea2-48a9-9136-daca9a4b9af8 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:52.425232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 934/1838] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:52.426498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 905/1839] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:52.441458 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5591b8f-1ea2-48a9-9136-daca9a4b9af8 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:52.441680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccda71-fd5e-4b16-b13d-e883d651c152 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:52.443204 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-16ccda71-fd5e-4b16-b13d-e883d651c152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:52.464516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5591b8f-1ea2-48a9-9136-daca9a4b9af8 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:52.473710 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837334e1-e15c-497a-b655-743978d69995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:52.475410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837334e1-e15c-497a-b655-743978d69995 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:52.475935 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837334e1-e15c-497a-b655-743978d69995 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:52.476108 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837334e1-e15c-497a-b655-743978d69995 admin admin] PATH_INFO: `/v3/projects/5b2bf67409c74913ad132710b2888ab1/users/b8b8aae81f654fecb3cf6f83e602801d/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:52.506345 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837334e1-e15c-497a-b655-743978d69995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2bf67409c74913ad132710b2888ab1, user_id=b8b8aae81f654fecb3cf6f83e602801d, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:52.511224 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837334e1-e15c-497a-b655-743978d69995 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:52.532537 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 935/1840] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:52 2022] PUT /identity/v3/projects/5b2bf67409c74913ad132710b2888ab1/users/b8b8aae81f654fecb3cf6f83e602801d/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:52.533712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837334e1-e15c-497a-b655-743978d69995 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:52.533826 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccda71-fd5e-4b16-b13d-e883d651c152 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:52.643704 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837334e1-e15c-497a-b655-743978d69995 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:52.645600 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0466a3-183e-4a20-bdae-1e029a9df9e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:52.646711 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0466a3-183e-4a20-bdae-1e029a9df9e6 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:52.647252 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0466a3-183e-4a20-bdae-1e029a9df9e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:52.647816 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0466a3-183e-4a20-bdae-1e029a9df9e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:52.650361 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52f87c-236f-447b-a7ce-0f407dd06fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:52.651368 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52f87c-236f-447b-a7ce-0f407dd06fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:52.651748 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52f87c-236f-447b-a7ce-0f407dd06fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:52.652203 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52f87c-236f-447b-a7ce-0f407dd06fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:52.653066 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52f87c-236f-447b-a7ce-0f407dd06fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:52.654991 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52f87c-236f-447b-a7ce-0f407dd06fa5 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:52.669916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 936/1841] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:52.674373 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52f87c-236f-447b-a7ce-0f407dd06fa5 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:52.688542 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52f87c-236f-447b-a7ce-0f407dd06fa5 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:52.695083 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848c442-6358-47f7-a54d-59389202c823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:52.696571 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848c442-6358-47f7-a54d-59389202c823 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:52.697796 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848c442-6358-47f7-a54d-59389202c823 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:52.697796 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848c442-6358-47f7-a54d-59389202c823 admin admin] PATH_INFO: `/v3/projects/5b2bf67409c74913ad132710b2888ab1/users/b8b8aae81f654fecb3cf6f83e602801d/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:52.700644 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848c442-6358-47f7-a54d-59389202c823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2bf67409c74913ad132710b2888ab1, user_id=b8b8aae81f654fecb3cf6f83e602801d, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:52.704207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848c442-6358-47f7-a54d-59389202c823 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:52.725909 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 937/1842] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:52 2022] PUT /identity/v3/projects/5b2bf67409c74913ad132710b2888ab1/users/b8b8aae81f654fecb3cf6f83e602801d/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:52.729426 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53c1b2-166b-447a-83b6-b7b15712f533 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:52.729723 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53c1b2-166b-447a-83b6-b7b15712f533 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:52.730034 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53c1b2-166b-447a-83b6-b7b15712f533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:52.784030 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0466a3-183e-4a20-bdae-1e029a9df9e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:52.785987 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0466a3-183e-4a20-bdae-1e029a9df9e6 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:52.796872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-da53c1b2-166b-447a-83b6-b7b15712f533 None None] MFA Rules not processed for user `b8b8aae81f654fecb3cf6f83e602801d`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:52.800096 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 906/1843] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:52.810671 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-da53c1b2-166b-447a-83b6-b7b15712f533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:52.928446 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 938/1844] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:52.942774 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0466a3-183e-4a20-bdae-1e029a9df9e6 service cinder] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:52.956363 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-2a0466a3-183e-4a20-bdae-1e029a9df9e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:52.978028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0466a3-183e-4a20-bdae-1e029a9df9e6 service cinder] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:53.006362 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:53.091328 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed2773-1ece-48d2-aeb8-24d7dc3ab11d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:53.092342 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed2773-1ece-48d2-aeb8-24d7dc3ab11d service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:53.092739 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed2773-1ece-48d2-aeb8-24d7dc3ab11d service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:53.093078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed2773-1ece-48d2-aeb8-24d7dc3ab11d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:53.117286 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed2773-1ece-48d2-aeb8-24d7dc3ab11d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:53.118957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed2773-1ece-48d2-aeb8-24d7dc3ab11d service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:53.143487 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 907/1845] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:53.257400 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53c1b2-166b-447a-83b6-b7b15712f533 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:53.274942 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53c1b2-166b-447a-83b6-b7b15712f533 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:53.283735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb770f-f0c2-484c-b6ea-85c6ee1b8793 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:53.285220 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb770f-f0c2-484c-b6ea-85c6ee1b8793 service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:53.285828 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb770f-f0c2-484c-b6ea-85c6ee1b8793 service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:53.286618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb770f-f0c2-484c-b6ea-85c6ee1b8793 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:53.363380 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:53.406963 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb770f-f0c2-484c-b6ea-85c6ee1b8793 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:53.409884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb770f-f0c2-484c-b6ea-85c6ee1b8793 service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:53.422739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 939/1846] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:51:53.776165 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed2773-1ece-48d2-aeb8-24d7dc3ab11d service cinder] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:53.871459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed2773-1ece-48d2-aeb8-24d7dc3ab11d service cinder] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:53.877319 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3fd71-9a9d-4578-8f40-f03e24e166cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:53.879323 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3fd71-9a9d-4578-8f40-f03e24e166cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:53.879632 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3fd71-9a9d-4578-8f40-f03e24e166cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:53.879911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3fd71-9a9d-4578-8f40-f03e24e166cf admin admin] PATH_INFO: `/v3/users/1df8ccd3cc32418b8adbf8e43fcd45b6` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:53.882468 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee3fd71-9a9d-4578-8f40-f03e24e166cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1df8ccd3cc32418b8adbf8e43fcd45b6)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:53.885233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee3fd71-9a9d-4578-8f40-f03e24e166cf admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:54.015549 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-cee3fd71-9a9d-4578-8f40-f03e24e166cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1df8ccd3cc32418b8adbf8e43fcd45b6'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:54.047148 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-cee3fd71-9a9d-4578-8f40-f03e24e166cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1df8ccd3cc32418b8adbf8e43fcd45b6'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:54.048679 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-cee3fd71-9a9d-4578-8f40-f03e24e166cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1df8ccd3cc32418b8adbf8e43fcd45b6'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:54.049922 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-cee3fd71-9a9d-4578-8f40-f03e24e166cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1df8ccd3cc32418b8adbf8e43fcd45b6'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:54.090929 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-cee3fd71-9a9d-4578-8f40-f03e24e166cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1df8ccd3cc32418b8adbf8e43fcd45b6'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:54.108731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 908/1847] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:51:53 2022] DELETE /identity/v3/users/1df8ccd3cc32418b8adbf8e43fcd45b6 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:54.113740 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ad8db-6d96-4a83-818a-495ea916b7a0 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:54.113740 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ad8db-6d96-4a83-818a-495ea916b7a0 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:54.114043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ad8db-6d96-4a83-818a-495ea916b7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:54.136092 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-0a1ad8db-6d96-4a83-818a-495ea916b7a0 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:54.136092 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-0a1ad8db-6d96-4a83-818a-495ea916b7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:54.248671 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 940/1848] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:54.262366 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3fd71-9a9d-4578-8f40-f03e24e166cf admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:54.263837 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-cee3fd71-9a9d-4578-8f40-f03e24e166cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:54.317115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:54.369490 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3fd71-9a9d-4578-8f40-f03e24e166cf admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:54.377434 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9b198-9b6e-412d-a5b7-17bf210980c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:54.378145 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9b198-9b6e-412d-a5b7-17bf210980c1 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:54.378436 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9b198-9b6e-412d-a5b7-17bf210980c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:54.378720 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9b198-9b6e-412d-a5b7-17bf210980c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:54.390934 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ad8db-6d96-4a83-818a-495ea916b7a0 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:54.392237 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-0a1ad8db-6d96-4a83-818a-495ea916b7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:54.407420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9b198-9b6e-412d-a5b7-17bf210980c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:54.409700 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc9b198-9b6e-412d-a5b7-17bf210980c1 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:54.422484 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 909/1849] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:54.479516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ad8db-6d96-4a83-818a-495ea916b7a0 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:54.485772 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a65524-b37a-4b63-8f6b-7fd23eac5856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:54.486929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a65524-b37a-4b63-8f6b-7fd23eac5856 service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:54.487366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a65524-b37a-4b63-8f6b-7fd23eac5856 service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:54.487852 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a65524-b37a-4b63-8f6b-7fd23eac5856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:54.491551 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-f6a65524-b37a-4b63-8f6b-7fd23eac5856 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:54.615958 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a65524-b37a-4b63-8f6b-7fd23eac5856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:54.619027 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a65524-b37a-4b63-8f6b-7fd23eac5856 service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:54.638289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 941/1850] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:54 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:54.661019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9b198-9b6e-412d-a5b7-17bf210980c1 service neutron] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:54.663608 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-ebc9b198-9b6e-412d-a5b7-17bf210980c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:54.686837 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc9b198-9b6e-412d-a5b7-17bf210980c1 service neutron] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:54.696414 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d65fd-5a3b-4255-bbd2-54703c11b078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:54.699272 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d65fd-5a3b-4255-bbd2-54703c11b078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:54.699791 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d65fd-5a3b-4255-bbd2-54703c11b078 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:54.700287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d65fd-5a3b-4255-bbd2-54703c11b078 admin admin] PATH_INFO: `/v3/users/780e25768d3441b497b3c6f8a34841bc` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:54.701814 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d65fd-5a3b-4255-bbd2-54703c11b078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=780e25768d3441b497b3c6f8a34841bc)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:54.704192 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82d65fd-5a3b-4255-bbd2-54703c11b078 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:54.784729 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a82d65fd-5a3b-4255-bbd2-54703c11b078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '780e25768d3441b497b3c6f8a34841bc'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:54.803613 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a82d65fd-5a3b-4255-bbd2-54703c11b078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '780e25768d3441b497b3c6f8a34841bc'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:54.805092 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a82d65fd-5a3b-4255-bbd2-54703c11b078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '780e25768d3441b497b3c6f8a34841bc'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:54.806436 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a82d65fd-5a3b-4255-bbd2-54703c11b078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '780e25768d3441b497b3c6f8a34841bc'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:54.824416 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a82d65fd-5a3b-4255-bbd2-54703c11b078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '780e25768d3441b497b3c6f8a34841bc'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:54.850838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 910/1851] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:51:54 2022] DELETE /identity/v3/users/780e25768d3441b497b3c6f8a34841bc => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:54.857286 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40ae35-3021-4b84-bb61-7218e50105be None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:54.858217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40ae35-3021-4b84-bb61-7218e50105be None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:54.859058 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40ae35-3021-4b84-bb61-7218e50105be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:54.884950 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-5c40ae35-3021-4b84-bb61-7218e50105be None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:54.886247 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5c40ae35-3021-4b84-bb61-7218e50105be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:54.902432 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:54.956297 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d65fd-5a3b-4255-bbd2-54703c11b078 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:54.957823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-a82d65fd-5a3b-4255-bbd2-54703c11b078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:54.989565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 942/1852] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:54.999223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40ae35-3021-4b84-bb61-7218e50105be None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:55.001735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5c40ae35-3021-4b84-bb61-7218e50105be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:55.054052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d65fd-5a3b-4255-bbd2-54703c11b078 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:55.061244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2739691-9419-41ce-a809-10138c4c9525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:55.062816 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2739691-9419-41ce-a809-10138c4c9525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:55.063403 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2739691-9419-41ce-a809-10138c4c9525 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:55.063848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2739691-9419-41ce-a809-10138c4c9525 admin admin] PATH_INFO: `/v3/projects/a25f2429bdd241bc94797d9fbff034ec` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:55.065703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2739691-9419-41ce-a809-10138c4c9525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a25f2429bdd241bc94797d9fbff034ec)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:55.069530 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2739691-9419-41ce-a809-10138c4c9525 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:55.122385 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40ae35-3021-4b84-bb61-7218e50105be None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:55.126948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5dc4e-bb2f-4af2-9462-2e2857c92263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:55.127722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5dc4e-bb2f-4af2-9462-2e2857c92263 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:55.128072 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5dc4e-bb2f-4af2-9462-2e2857c92263 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:55.128575 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5dc4e-bb2f-4af2-9462-2e2857c92263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:55.141226 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5dc4e-bb2f-4af2-9462-2e2857c92263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:55.143807 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5dc4e-bb2f-4af2-9462-2e2857c92263 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:55.150230 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-b2739691-9419-41ce-a809-10138c4c9525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a25f2429bdd241bc94797d9fbff034ec', 'request_id': 'req-b2739691-9419-41ce-a809-10138c4c9525'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:55.155935 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:55.157626 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 943/1853] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:51:55.166168 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-b2739691-9419-41ce-a809-10138c4c9525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a25f2429bdd241bc94797d9fbff034ec', 'request_id': 'req-b2739691-9419-41ce-a809-10138c4c9525'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:55.181878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-b2739691-9419-41ce-a809-10138c4c9525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a25f2429bdd241bc94797d9fbff034ec', 'request_id': 'req-b2739691-9419-41ce-a809-10138c4c9525'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:55.205765 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-b2739691-9419-41ce-a809-10138c4c9525 admin admin] The token cache is being invalidate because project a25f2429bdd241bc94797d9fbff034ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:51:55.206342 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-b2739691-9419-41ce-a809-10138c4c9525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:55.207480 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-b2739691-9419-41ce-a809-10138c4c9525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:55.209668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 911/1854] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:51:54 2022] DELETE /identity/v3/projects/a25f2429bdd241bc94797d9fbff034ec => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:51:55.214724 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5dc4e-bb2f-4af2-9462-2e2857c92263 service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:55.230369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5dc4e-bb2f-4af2-9462-2e2857c92263 service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:55.312602 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e1a4d-abb9-4432-ad5f-a8e3991bb626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:55.313492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e1a4d-abb9-4432-ad5f-a8e3991bb626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:55.313780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e1a4d-abb9-4432-ad5f-a8e3991bb626 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:55.314173 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e1a4d-abb9-4432-ad5f-a8e3991bb626 admin admin] PATH_INFO: `/v3/users/b8b8aae81f654fecb3cf6f83e602801d` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:55.315442 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e1a4d-abb9-4432-ad5f-a8e3991bb626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8b8aae81f654fecb3cf6f83e602801d)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:55.317453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e1a4d-abb9-4432-ad5f-a8e3991bb626 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:55.381741 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-a89e1a4d-abb9-4432-ad5f-a8e3991bb626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8b8aae81f654fecb3cf6f83e602801d'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:55.389658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-a89e1a4d-abb9-4432-ad5f-a8e3991bb626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8b8aae81f654fecb3cf6f83e602801d'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:55.390625 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-a89e1a4d-abb9-4432-ad5f-a8e3991bb626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8b8aae81f654fecb3cf6f83e602801d'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:55.391284 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-a89e1a4d-abb9-4432-ad5f-a8e3991bb626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8b8aae81f654fecb3cf6f83e602801d'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:55.401128 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:55.406535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-a89e1a4d-abb9-4432-ad5f-a8e3991bb626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8b8aae81f654fecb3cf6f83e602801d'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:55.429560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 944/1855] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:51:55 2022] DELETE /identity/v3/users/b8b8aae81f654fecb3cf6f83e602801d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:51:55.559416 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2739691-9419-41ce-a809-10138c4c9525 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:55.566718 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-b2739691-9419-41ce-a809-10138c4c9525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:55.605255 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2739691-9419-41ce-a809-10138c4c9525 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:55.683605 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467498df-7800-476f-b4ef-953fd7eb153d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:55.684484 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467498df-7800-476f-b4ef-953fd7eb153d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:55.684771 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467498df-7800-476f-b4ef-953fd7eb153d admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:55.685054 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467498df-7800-476f-b4ef-953fd7eb153d admin admin] PATH_INFO: `/v3/projects/cde67034f87c4efdba6b36bd4371226e` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:55.686337 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467498df-7800-476f-b4ef-953fd7eb153d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cde67034f87c4efdba6b36bd4371226e)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:55.688261 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467498df-7800-476f-b4ef-953fd7eb153d admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:55.745099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-467498df-7800-476f-b4ef-953fd7eb153d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cde67034f87c4efdba6b36bd4371226e', 'request_id': 'req-467498df-7800-476f-b4ef-953fd7eb153d'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:55.755346 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-467498df-7800-476f-b4ef-953fd7eb153d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cde67034f87c4efdba6b36bd4371226e', 'request_id': 'req-467498df-7800-476f-b4ef-953fd7eb153d'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:55.762009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-467498df-7800-476f-b4ef-953fd7eb153d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cde67034f87c4efdba6b36bd4371226e', 'request_id': 'req-467498df-7800-476f-b4ef-953fd7eb153d'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:55.774041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-467498df-7800-476f-b4ef-953fd7eb153d admin admin] The token cache is being invalidate because project cde67034f87c4efdba6b36bd4371226e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:51:55.774340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-467498df-7800-476f-b4ef-953fd7eb153d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:55.775637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-467498df-7800-476f-b4ef-953fd7eb153d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:55.778124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 912/1856] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:51:55 2022] DELETE /identity/v3/projects/cde67034f87c4efdba6b36bd4371226e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:51:55.784888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e1a4d-abb9-4432-ad5f-a8e3991bb626 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:55.791578 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-a89e1a4d-abb9-4432-ad5f-a8e3991bb626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:55.808054 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e1a4d-abb9-4432-ad5f-a8e3991bb626 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:55.908335 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24790181-751d-428d-a176-2e2430d4fce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:55.909540 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24790181-751d-428d-a176-2e2430d4fce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:55.909991 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24790181-751d-428d-a176-2e2430d4fce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:55.910373 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24790181-751d-428d-a176-2e2430d4fce0 admin admin] PATH_INFO: `/v3/users/de444e5a943b4b8f96587f38425f1917` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:55.912611 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24790181-751d-428d-a176-2e2430d4fce0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de444e5a943b4b8f96587f38425f1917)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:55.915859 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24790181-751d-428d-a176-2e2430d4fce0 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:55.917297 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467498df-7800-476f-b4ef-953fd7eb153d admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:55.919054 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-467498df-7800-476f-b4ef-953fd7eb153d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:55.944473 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467498df-7800-476f-b4ef-953fd7eb153d admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:55.959049 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb12abb-cf09-4618-bda2-6ff717fb136b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:55.960139 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb12abb-cf09-4618-bda2-6ff717fb136b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:55.960494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb12abb-cf09-4618-bda2-6ff717fb136b admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:55.960951 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb12abb-cf09-4618-bda2-6ff717fb136b admin admin] PATH_INFO: `/v3/projects/5b2bf67409c74913ad132710b2888ab1` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:55.963019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb12abb-cf09-4618-bda2-6ff717fb136b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b2bf67409c74913ad132710b2888ab1)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:55.964960 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb12abb-cf09-4618-bda2-6ff717fb136b admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:56.027870 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-24790181-751d-428d-a176-2e2430d4fce0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de444e5a943b4b8f96587f38425f1917'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:56.038825 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-24790181-751d-428d-a176-2e2430d4fce0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de444e5a943b4b8f96587f38425f1917'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:56.039688 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-24790181-751d-428d-a176-2e2430d4fce0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de444e5a943b4b8f96587f38425f1917'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:56.040398 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-24790181-751d-428d-a176-2e2430d4fce0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de444e5a943b4b8f96587f38425f1917'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:56.057430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-24790181-751d-428d-a176-2e2430d4fce0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de444e5a943b4b8f96587f38425f1917'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:56.077417 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-feb12abb-cf09-4618-bda2-6ff717fb136b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b2bf67409c74913ad132710b2888ab1', 'request_id': 'req-feb12abb-cf09-4618-bda2-6ff717fb136b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:56.090508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 945/1857] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:51:55 2022] DELETE /identity/v3/users/de444e5a943b4b8f96587f38425f1917 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:56.095653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-feb12abb-cf09-4618-bda2-6ff717fb136b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b2bf67409c74913ad132710b2888ab1', 'request_id': 'req-feb12abb-cf09-4618-bda2-6ff717fb136b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:56.108712 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-feb12abb-cf09-4618-bda2-6ff717fb136b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b2bf67409c74913ad132710b2888ab1', 'request_id': 'req-feb12abb-cf09-4618-bda2-6ff717fb136b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:56.123757 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:56.137385 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-feb12abb-cf09-4618-bda2-6ff717fb136b admin admin] The token cache is being invalidate because project 5b2bf67409c74913ad132710b2888ab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:51:56.137941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-feb12abb-cf09-4618-bda2-6ff717fb136b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:56.139267 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-feb12abb-cf09-4618-bda2-6ff717fb136b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:56.144896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 913/1858] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:51:55 2022] DELETE /identity/v3/projects/5b2bf67409c74913ad132710b2888ab1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:51:56.147066 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedb551-d21f-459d-911b-5d74cbafac88 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:56.147552 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedb551-d21f-459d-911b-5d74cbafac88 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:56.147967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedb551-d21f-459d-911b-5d74cbafac88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:56.189619 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-1fedb551-d21f-459d-911b-5d74cbafac88 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:56.191631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-1fedb551-d21f-459d-911b-5d74cbafac88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:56.282154 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 946/1859] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:56.306916 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d99815-beb0-4315-9aa2-81d8231c074e None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:56.306916 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d99815-beb0-4315-9aa2-81d8231c074e None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:56.306916 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d99815-beb0-4315-9aa2-81d8231c074e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:56.356760 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-91d99815-beb0-4315-9aa2-81d8231c074e None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:56.358547 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-91d99815-beb0-4315-9aa2-81d8231c074e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:56.379517 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 914/1860] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:56.381515 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedb551-d21f-459d-911b-5d74cbafac88 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:56.390526 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:56.401628 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedb551-d21f-459d-911b-5d74cbafac88 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:56.431694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075d469-12e0-4f2a-9279-d97076d043ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:56.432961 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075d469-12e0-4f2a-9279-d97076d043ba admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:56.433440 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075d469-12e0-4f2a-9279-d97076d043ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:56.434941 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075d469-12e0-4f2a-9279-d97076d043ba admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:56.435428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075d469-12e0-4f2a-9279-d97076d043ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:51:56.435998 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075d469-12e0-4f2a-9279-d97076d043ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:56.439229 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075d469-12e0-4f2a-9279-d97076d043ba admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:56.463558 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 947/1861] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:51:56.466903 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d99815-beb0-4315-9aa2-81d8231c074e None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:56.478606 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d99815-beb0-4315-9aa2-81d8231c074e None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:56.485062 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f31da-676a-4bdb-a044-8f5ec8fb5823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:56.485737 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f31da-676a-4bdb-a044-8f5ec8fb5823 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:56.486082 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f31da-676a-4bdb-a044-8f5ec8fb5823 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:56.486362 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f31da-676a-4bdb-a044-8f5ec8fb5823 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:56.487601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f31da-676a-4bdb-a044-8f5ec8fb5823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:56.489092 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f31da-676a-4bdb-a044-8f5ec8fb5823 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:56.522467 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 915/1862] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:56 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:56.526188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075d469-12e0-4f2a-9279-d97076d043ba admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:56.547426 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075d469-12e0-4f2a-9279-d97076d043ba admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:56.610741 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f31da-676a-4bdb-a044-8f5ec8fb5823 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:56.614106 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-ec2f31da-676a-4bdb-a044-8f5ec8fb5823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:56.681397 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1a5bc-4f32-4c13-8687-4eced85b236b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:56.682352 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1a5bc-4f32-4c13-8687-4eced85b236b admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:56.683668 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1a5bc-4f32-4c13-8687-4eced85b236b admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:56.684050 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1a5bc-4f32-4c13-8687-4eced85b236b admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:56.688438 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a1a5bc-4f32-4c13-8687-4eced85b236b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:56.690848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a1a5bc-4f32-4c13-8687-4eced85b236b admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:56.733349 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 948/1863] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:56 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:51:56.734465 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1a5bc-4f32-4c13-8687-4eced85b236b admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:56.745832 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1a5bc-4f32-4c13-8687-4eced85b236b admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:56.750483 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f31da-676a-4bdb-a044-8f5ec8fb5823 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:56.754152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d58952-526b-480e-b2fd-84911e4944da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:56.754912 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d58952-526b-480e-b2fd-84911e4944da admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:56.755252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d58952-526b-480e-b2fd-84911e4944da admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:56.755650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d58952-526b-480e-b2fd-84911e4944da admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:56.756412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d58952-526b-480e-b2fd-84911e4944da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:56.758056 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d58952-526b-480e-b2fd-84911e4944da admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:56.759814 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c19dc-e657-452a-859b-238fa7d2edb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:56.760703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c19dc-e657-452a-859b-238fa7d2edb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:56.761413 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c19dc-e657-452a-859b-238fa7d2edb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:56.761704 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c19dc-e657-452a-859b-238fa7d2edb0 admin admin] PATH_INFO: `/v3/projects/9f7576dafd374f24a71a30181ec9ac52` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:56.762978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c19dc-e657-452a-859b-238fa7d2edb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f7576dafd374f24a71a30181ec9ac52)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:56.765394 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c19dc-e657-452a-859b-238fa7d2edb0 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:56.770547 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 949/1864] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:56.775334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d58952-526b-480e-b2fd-84911e4944da admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:56.792584 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d58952-526b-480e-b2fd-84911e4944da admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:56.800333 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b716cf7-6ffb-48cf-b146-32818e17e24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:56.801684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b716cf7-6ffb-48cf-b146-32818e17e24e admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:56.801817 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b716cf7-6ffb-48cf-b146-32818e17e24e admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:56.802309 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b716cf7-6ffb-48cf-b146-32818e17e24e admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:56.803329 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b716cf7-6ffb-48cf-b146-32818e17e24e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:56.805423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b716cf7-6ffb-48cf-b146-32818e17e24e admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:56.819712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 950/1865] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 15:51:56.830755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b716cf7-6ffb-48cf-b146-32818e17e24e admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:56.842239 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b716cf7-6ffb-48cf-b146-32818e17e24e admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:56.855943 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-b70c19dc-e657-452a-859b-238fa7d2edb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f7576dafd374f24a71a30181ec9ac52', 'request_id': 'req-b70c19dc-e657-452a-859b-238fa7d2edb0'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:56.871340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-b70c19dc-e657-452a-859b-238fa7d2edb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f7576dafd374f24a71a30181ec9ac52', 'request_id': 'req-b70c19dc-e657-452a-859b-238fa7d2edb0'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:56.886623 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-b70c19dc-e657-452a-859b-238fa7d2edb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f7576dafd374f24a71a30181ec9ac52', 'request_id': 'req-b70c19dc-e657-452a-859b-238fa7d2edb0'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:56.900742 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-b70c19dc-e657-452a-859b-238fa7d2edb0 admin admin] The token cache is being invalidate because project 9f7576dafd374f24a71a30181ec9ac52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:51:56.901172 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-b70c19dc-e657-452a-859b-238fa7d2edb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:56.902062 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-b70c19dc-e657-452a-859b-238fa7d2edb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:56.907450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 916/1866] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:51:56 2022] DELETE /identity/v3/projects/9f7576dafd374f24a71a30181ec9ac52 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:51:56.908951 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df2af3-07b7-47e3-a68d-c936b409aad7 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:56.909343 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df2af3-07b7-47e3-a68d-c936b409aad7 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:56.909749 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df2af3-07b7-47e3-a68d-c936b409aad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:56.930113 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-a0df2af3-07b7-47e3-a68d-c936b409aad7 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:56.931473 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-a0df2af3-07b7-47e3-a68d-c936b409aad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:56.935192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4db598-5a01-4104-9ce8-7e8cd4080e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:56.936861 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4db598-5a01-4104-9ce8-7e8cd4080e9a admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:56.937270 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4db598-5a01-4104-9ce8-7e8cd4080e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:56.937761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4db598-5a01-4104-9ce8-7e8cd4080e9a admin admin] PATH_INFO: `/v3/projects/5473702875094b20a166c770180dd03f/users/6816f75781704595aba2e6150fc603e1/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:56.940271 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 917/1867] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:56.948874 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f2ac5-b140-4f39-942e-9438fe3572d1 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:56.949526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f2ac5-b140-4f39-942e-9438fe3572d1 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:56.949846 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f2ac5-b140-4f39-942e-9438fe3572d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:56.956801 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4db598-5a01-4104-9ce8-7e8cd4080e9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5473702875094b20a166c770180dd03f, user_id=6816f75781704595aba2e6150fc603e1, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:56.960421 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4db598-5a01-4104-9ce8-7e8cd4080e9a admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:56.977981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 951/1868] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:56 2022] PUT /identity/v3/projects/5473702875094b20a166c770180dd03f/users/6816f75781704595aba2e6150fc603e1/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:56.980781 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-069f2ac5-b140-4f39-942e-9438fe3572d1 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:56.982019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-069f2ac5-b140-4f39-942e-9438fe3572d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:56.989156 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc17c58-f637-4a4c-ae78-a9e68286093a None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:56.989583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc17c58-f637-4a4c-ae78-a9e68286093a None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:56.990004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc17c58-f637-4a4c-ae78-a9e68286093a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:57.019179 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-4fc17c58-f637-4a4c-ae78-a9e68286093a None None] MFA Rules not processed for user `6816f75781704595aba2e6150fc603e1`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:57.020498 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-4fc17c58-f637-4a4c-ae78-a9e68286093a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:57.030478 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:57.050868 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 918/1869] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:51:57.052189 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f2ac5-b140-4f39-942e-9438fe3572d1 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:57.062956 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f2ac5-b140-4f39-942e-9438fe3572d1 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:57.066501 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:57.070640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92236c06-94db-49ea-80f3-35c651bf31c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:57.071620 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92236c06-94db-49ea-80f3-35c651bf31c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:57.072047 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92236c06-94db-49ea-80f3-35c651bf31c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:57.072537 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92236c06-94db-49ea-80f3-35c651bf31c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:57.073793 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92236c06-94db-49ea-80f3-35c651bf31c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:51:57.074370 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92236c06-94db-49ea-80f3-35c651bf31c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:57.076698 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92236c06-94db-49ea-80f3-35c651bf31c5 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:57.095529 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 919/1870] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:51:57.099832 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92236c06-94db-49ea-80f3-35c651bf31c5 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:57.110497 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92236c06-94db-49ea-80f3-35c651bf31c5 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:57.115939 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25109576-270c-436f-9be1-9d1d8f153a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:57.116614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25109576-270c-436f-9be1-9d1d8f153a82 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:57.116907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25109576-270c-436f-9be1-9d1d8f153a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:57.117190 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25109576-270c-436f-9be1-9d1d8f153a82 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:57.117994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25109576-270c-436f-9be1-9d1d8f153a82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:57.119378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 952/1871] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:51:57.119935 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25109576-270c-436f-9be1-9d1d8f153a82 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:57.135146 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc17c58-f637-4a4c-ae78-a9e68286093a None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:57.137157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-4fc17c58-f637-4a4c-ae78-a9e68286093a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:57.158715 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 920/1872] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:57 2022] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:51:57.162656 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25109576-270c-436f-9be1-9d1d8f153a82 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:57.242581 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc17c58-f637-4a4c-ae78-a9e68286093a None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:57.277972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25109576-270c-436f-9be1-9d1d8f153a82 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:57.299912 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4591c8-1121-45b1-aa0d-1c86c337ae6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:57.301108 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4591c8-1121-45b1-aa0d-1c86c337ae6c admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:57.301615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4591c8-1121-45b1-aa0d-1c86c337ae6c admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:57.302196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4591c8-1121-45b1-aa0d-1c86c337ae6c admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:57.303538 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4591c8-1121-45b1-aa0d-1c86c337ae6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:57.308371 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4591c8-1121-45b1-aa0d-1c86c337ae6c admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:57.352935 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d77f6-3ad4-47dd-b0a2-1b29a7f27207 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:57.354119 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 921/1873] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:57 2022] POST /identity/v3/users => generated 285 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:51:57.355278 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d77f6-3ad4-47dd-b0a2-1b29a7f27207 service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:57.355907 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d77f6-3ad4-47dd-b0a2-1b29a7f27207 service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:57.357286 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d77f6-3ad4-47dd-b0a2-1b29a7f27207 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:57.358159 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4591c8-1121-45b1-aa0d-1c86c337ae6c admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:57.371475 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4591c8-1121-45b1-aa0d-1c86c337ae6c admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:57.378248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab9665-ff49-4e32-80a1-61dd1df6f39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:57.378939 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab9665-ff49-4e32-80a1-61dd1df6f39a admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:57.379283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab9665-ff49-4e32-80a1-61dd1df6f39a admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:57.379567 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab9665-ff49-4e32-80a1-61dd1df6f39a admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:57.380353 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab9665-ff49-4e32-80a1-61dd1df6f39a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:57.386528 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab9665-ff49-4e32-80a1-61dd1df6f39a admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:57.403661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 922/1874] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:57.410742 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab9665-ff49-4e32-80a1-61dd1df6f39a admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:57.422818 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab9665-ff49-4e32-80a1-61dd1df6f39a admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:57.428520 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee26c0-a8dd-4d12-93c2-97ed9b2d32ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:57.429340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee26c0-a8dd-4d12-93c2-97ed9b2d32ee admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:57.429581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee26c0-a8dd-4d12-93c2-97ed9b2d32ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:57.429905 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee26c0-a8dd-4d12-93c2-97ed9b2d32ee admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:57.430651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee26c0-a8dd-4d12-93c2-97ed9b2d32ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:57.433054 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee26c0-a8dd-4d12-93c2-97ed9b2d32ee admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:57.441239 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d77f6-3ad4-47dd-b0a2-1b29a7f27207 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:57.442084 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d77f6-3ad4-47dd-b0a2-1b29a7f27207 service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:57.453395 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 923/1875] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:57.459441 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee26c0-a8dd-4d12-93c2-97ed9b2d32ee admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:57.460569 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 953/1876] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:51:57.476025 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee26c0-a8dd-4d12-93c2-97ed9b2d32ee admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:57.482593 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d77f6-3ad4-47dd-b0a2-1b29a7f27207 service cinder] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:57.482752 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a98d1-c9a5-48de-bf25-0ef2a00c14a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:57.483687 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a98d1-c9a5-48de-bf25-0ef2a00c14a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:57.483986 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a98d1-c9a5-48de-bf25-0ef2a00c14a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:57.484375 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a98d1-c9a5-48de-bf25-0ef2a00c14a2 admin admin] PATH_INFO: `/v3/projects/ab35ef3260e64eda980f87ff64260046/users/67e2aa8bf047454b961c0ada0809d94a/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:57.485152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-896d77f6-3ad4-47dd-b0a2-1b29a7f27207 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:57.503284 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a98d1-c9a5-48de-bf25-0ef2a00c14a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab35ef3260e64eda980f87ff64260046, user_id=67e2aa8bf047454b961c0ada0809d94a, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:57.506093 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a98d1-c9a5-48de-bf25-0ef2a00c14a2 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:57.512593 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d77f6-3ad4-47dd-b0a2-1b29a7f27207 service cinder] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:57.519548 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949735ac-d56e-4f61-bd25-3826f641a434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:57.520598 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949735ac-d56e-4f61-bd25-3826f641a434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:57.521995 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949735ac-d56e-4f61-bd25-3826f641a434 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:57.522293 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949735ac-d56e-4f61-bd25-3826f641a434 admin admin] PATH_INFO: `/v3/users/6816f75781704595aba2e6150fc603e1` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:57.523558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 924/1877] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:57 2022] PUT /identity/v3/projects/ab35ef3260e64eda980f87ff64260046/users/67e2aa8bf047454b961c0ada0809d94a/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:51:57.523952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949735ac-d56e-4f61-bd25-3826f641a434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6816f75781704595aba2e6150fc603e1)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:57.526014 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949735ac-d56e-4f61-bd25-3826f641a434 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:57.535909 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b44219-8609-432c-bdab-a85f8aa08a27 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:57.535909 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b44219-8609-432c-bdab-a85f8aa08a27 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:57.536233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b44219-8609-432c-bdab-a85f8aa08a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:57.574833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:57.581142 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-69b44219-8609-432c-bdab-a85f8aa08a27 None None] MFA Rules not processed for user `67e2aa8bf047454b961c0ada0809d94a`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:57.582411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-69b44219-8609-432c-bdab-a85f8aa08a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:57.589224 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-949735ac-d56e-4f61-bd25-3826f641a434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6816f75781704595aba2e6150fc603e1'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:57.596770 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-949735ac-d56e-4f61-bd25-3826f641a434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6816f75781704595aba2e6150fc603e1'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:57.597537 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-949735ac-d56e-4f61-bd25-3826f641a434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6816f75781704595aba2e6150fc603e1'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:57.598241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-949735ac-d56e-4f61-bd25-3826f641a434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6816f75781704595aba2e6150fc603e1'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:57.616928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-949735ac-d56e-4f61-bd25-3826f641a434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6816f75781704595aba2e6150fc603e1'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:57.644663 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 954/1878] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:51:57 2022] DELETE /identity/v3/users/6816f75781704595aba2e6150fc603e1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:51:57.652062 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2d876-1304-40ba-9b93-63006c17a6c0 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:57.652431 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2d876-1304-40ba-9b93-63006c17a6c0 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:57.652716 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2d876-1304-40ba-9b93-63006c17a6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:57.677772 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:57.710139 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 925/1879] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:57.711050 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-4ae2d876-1304-40ba-9b93-63006c17a6c0 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:57.712384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-4ae2d876-1304-40ba-9b93-63006c17a6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:57.714893 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b44219-8609-432c-bdab-a85f8aa08a27 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:57.716251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-69b44219-8609-432c-bdab-a85f8aa08a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:57.857118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b44219-8609-432c-bdab-a85f8aa08a27 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:57.867101 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981f8e3-f250-4253-9285-084de286b3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:57.868220 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981f8e3-f250-4253-9285-084de286b3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:57.868645 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981f8e3-f250-4253-9285-084de286b3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:57.869837 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981f8e3-f250-4253-9285-084de286b3b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:57.871180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981f8e3-f250-4253-9285-084de286b3b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:57.873354 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981f8e3-f250-4253-9285-084de286b3b4 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:57.878685 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 955/1880] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:51:57.900212 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2d876-1304-40ba-9b93-63006c17a6c0 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:57.905070 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-4ae2d876-1304-40ba-9b93-63006c17a6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:57.922162 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 926/1881] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:57 2022] POST /identity/v3/projects => generated 367 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:57.926895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981f8e3-f250-4253-9285-084de286b3b4 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:57.997077 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2d876-1304-40ba-9b93-63006c17a6c0 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:58.044358 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981f8e3-f250-4253-9285-084de286b3b4 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:58.050877 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d46ea9-e004-470f-9534-432c04c3f5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:58.051576 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d46ea9-e004-470f-9534-432c04c3f5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:58.051862 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d46ea9-e004-470f-9534-432c04c3f5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:58.052325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d46ea9-e004-470f-9534-432c04c3f5f0 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:58.053050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d46ea9-e004-470f-9534-432c04c3f5f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:58.055094 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d46ea9-e004-470f-9534-432c04c3f5f0 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:58.073533 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60feb8-da6a-4b82-963a-94e92fcf2b45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:58.074477 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60feb8-da6a-4b82-963a-94e92fcf2b45 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:58.074837 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60feb8-da6a-4b82-963a-94e92fcf2b45 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:58.075420 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60feb8-da6a-4b82-963a-94e92fcf2b45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:58.087026 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 927/1882] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:57 2022] POST /identity/v3/users => generated 290 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:58.087648 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60feb8-da6a-4b82-963a-94e92fcf2b45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:58.089187 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60feb8-da6a-4b82-963a-94e92fcf2b45 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:58.089365 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d46ea9-e004-470f-9534-432c04c3f5f0 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:58.103327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 956/1883] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:58.106185 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d46ea9-e004-470f-9534-432c04c3f5f0 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:58.121043 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b61137-a9f4-4f27-8f0e-2f1a7d76736e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:58.121273 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b61137-a9f4-4f27-8f0e-2f1a7d76736e admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:58.121576 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b61137-a9f4-4f27-8f0e-2f1a7d76736e admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:58.121753 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b61137-a9f4-4f27-8f0e-2f1a7d76736e admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:58.122556 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b61137-a9f4-4f27-8f0e-2f1a7d76736e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:58.124193 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b61137-a9f4-4f27-8f0e-2f1a7d76736e admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:58.137740 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 928/1884] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:58.142912 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60feb8-da6a-4b82-963a-94e92fcf2b45 service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:58.158093 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60feb8-da6a-4b82-963a-94e92fcf2b45 service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:58.165549 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5c2c0-4a99-4a0c-9208-6f4ea2a9e2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:58.166442 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5c2c0-4a99-4a0c-9208-6f4ea2a9e2f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:58.166656 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5c2c0-4a99-4a0c-9208-6f4ea2a9e2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:58.166899 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5c2c0-4a99-4a0c-9208-6f4ea2a9e2f1 admin admin] PATH_INFO: `/v3/projects/2013d3c726c24479ab48fa18d7b19e0b/users/692c05a7ffbb40e6bbe86b68a8c48a57/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:58.178613 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:58.200084 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5c2c0-4a99-4a0c-9208-6f4ea2a9e2f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2013d3c726c24479ab48fa18d7b19e0b, user_id=692c05a7ffbb40e6bbe86b68a8c48a57, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:58.212640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5c2c0-4a99-4a0c-9208-6f4ea2a9e2f1 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:58.241206 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 957/1885] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:58 2022] PUT /identity/v3/projects/2013d3c726c24479ab48fa18d7b19e0b/users/692c05a7ffbb40e6bbe86b68a8c48a57/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:58.248670 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b61137-a9f4-4f27-8f0e-2f1a7d76736e admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:58.264766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b61137-a9f4-4f27-8f0e-2f1a7d76736e admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:58.354820 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:58.366032 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6473b3d6-3cc4-46ae-9934-c1e49d2cc383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:58.366782 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473b3d6-3cc4-46ae-9934-c1e49d2cc383 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:58.367134 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473b3d6-3cc4-46ae-9934-c1e49d2cc383 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:58.367480 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6473b3d6-3cc4-46ae-9934-c1e49d2cc383 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:58.368303 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473b3d6-3cc4-46ae-9934-c1e49d2cc383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:58.370101 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6473b3d6-3cc4-46ae-9934-c1e49d2cc383 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:58.384091 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 929/1886] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:58.388744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5c2c0-4a99-4a0c-9208-6f4ea2a9e2f1 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:58.403840 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5c2c0-4a99-4a0c-9208-6f4ea2a9e2f1 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:58.412858 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf48cc-beac-4f87-9cbe-5925a5a5f489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:58.414161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf48cc-beac-4f87-9cbe-5925a5a5f489 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:58.414540 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf48cc-beac-4f87-9cbe-5925a5a5f489 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:58.414913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf48cc-beac-4f87-9cbe-5925a5a5f489 admin admin] PATH_INFO: `/v3/projects/2013d3c726c24479ab48fa18d7b19e0b/users/692c05a7ffbb40e6bbe86b68a8c48a57/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:58.417268 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf48cc-beac-4f87-9cbe-5925a5a5f489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2013d3c726c24479ab48fa18d7b19e0b, user_id=692c05a7ffbb40e6bbe86b68a8c48a57, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:58.420567 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf48cc-beac-4f87-9cbe-5925a5a5f489 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:58.438056 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 958/1887] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:58 2022] PUT /identity/v3/projects/2013d3c726c24479ab48fa18d7b19e0b/users/692c05a7ffbb40e6bbe86b68a8c48a57/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:51:58.449070 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d4c2d-2735-4380-bb72-c5c45c156285 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:58.449383 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d4c2d-2735-4380-bb72-c5c45c156285 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:58.449652 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d4c2d-2735-4380-bb72-c5c45c156285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:58.482898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf48cc-beac-4f87-9cbe-5925a5a5f489 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:58.484788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-d4bf48cc-beac-4f87-9cbe-5925a5a5f489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:58.493561 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-f03d4c2d-2735-4380-bb72-c5c45c156285 None None] MFA Rules not processed for user `692c05a7ffbb40e6bbe86b68a8c48a57`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:58.495494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-f03d4c2d-2735-4380-bb72-c5c45c156285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:58.638820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf48cc-beac-4f87-9cbe-5925a5a5f489 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:58.649984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89eab3-9026-43ea-a094-0db634d83190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:58.651739 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 930/1888] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:58 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:58.652850 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89eab3-9026-43ea-a094-0db634d83190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:58.653442 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89eab3-9026-43ea-a094-0db634d83190 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:58.654249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89eab3-9026-43ea-a094-0db634d83190 admin admin] PATH_INFO: `/v3/projects/5473702875094b20a166c770180dd03f` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:58.656980 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb89eab3-9026-43ea-a094-0db634d83190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5473702875094b20a166c770180dd03f)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:58.661523 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb89eab3-9026-43ea-a094-0db634d83190 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:58.671373 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d4c2d-2735-4380-bb72-c5c45c156285 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:58.673398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-f03d4c2d-2735-4380-bb72-c5c45c156285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:58.781218 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-eb89eab3-9026-43ea-a094-0db634d83190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5473702875094b20a166c770180dd03f', 'request_id': 'req-eb89eab3-9026-43ea-a094-0db634d83190'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:58.792782 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d4c2d-2735-4380-bb72-c5c45c156285 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:58.793099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-eb89eab3-9026-43ea-a094-0db634d83190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5473702875094b20a166c770180dd03f', 'request_id': 'req-eb89eab3-9026-43ea-a094-0db634d83190'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:58.806969 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-eb89eab3-9026-43ea-a094-0db634d83190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5473702875094b20a166c770180dd03f', 'request_id': 'req-eb89eab3-9026-43ea-a094-0db634d83190'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:58.824002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-eb89eab3-9026-43ea-a094-0db634d83190 admin admin] The token cache is being invalidate because project 5473702875094b20a166c770180dd03f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:51:58.824480 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-eb89eab3-9026-43ea-a094-0db634d83190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:58.825425 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-eb89eab3-9026-43ea-a094-0db634d83190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:58.827243 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 959/1889] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:51:58 2022] DELETE /identity/v3/projects/5473702875094b20a166c770180dd03f => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:51:58.828338 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89eab3-9026-43ea-a094-0db634d83190 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:58.829837 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-eb89eab3-9026-43ea-a094-0db634d83190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:58.875848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b91e07-43d1-46e7-9556-57feef173894 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:58.876521 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b91e07-43d1-46e7-9556-57feef173894 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:58.876804 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b91e07-43d1-46e7-9556-57feef173894 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:58.877077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b91e07-43d1-46e7-9556-57feef173894 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:58.878974 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-64b91e07-43d1-46e7-9556-57feef173894 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:58.915439 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb89eab3-9026-43ea-a094-0db634d83190 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:58.920435 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a6ddc-6450-4639-ab65-0d17c8a2be4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:58.921325 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a6ddc-6450-4639-ab65-0d17c8a2be4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:58.921667 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a6ddc-6450-4639-ab65-0d17c8a2be4b admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:58.921925 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a6ddc-6450-4639-ab65-0d17c8a2be4b admin admin] PATH_INFO: `/v3/users/b75c32a9f7004c2cbd6a7a50c4f8ce00` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:58.923166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a6ddc-6450-4639-ab65-0d17c8a2be4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b75c32a9f7004c2cbd6a7a50c4f8ce00)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:58.925095 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a6ddc-6450-4639-ab65-0d17c8a2be4b admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:58.928893 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:58.930823 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:58.954498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b91e07-43d1-46e7-9556-57feef173894 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:58.956514 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b91e07-43d1-46e7-9556-57feef173894 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:58.973025 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 931/1890] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:58 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:51:58.974459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1a9c4-0127-46a3-9d4a-b78524e3afa6 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:58.974749 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1a9c4-0127-46a3-9d4a-b78524e3afa6 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:58.975027 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1a9c4-0127-46a3-9d4a-b78524e3afa6 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:58.976495 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 932/1891] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jun 23 15:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:51:58.977407 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8a482-04db-439b-b86e-7b099c4a3f62 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:58.977705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8a482-04db-439b-b86e-7b099c4a3f62 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:58.977996 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8a482-04db-439b-b86e-7b099c4a3f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:58.998851 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-267a6ddc-6450-4639-ab65-0d17c8a2be4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b75c32a9f7004c2cbd6a7a50c4f8ce00'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:59.006548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-3db8a482-04db-439b-b86e-7b099c4a3f62 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:59.008036 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-3db8a482-04db-439b-b86e-7b099c4a3f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:59.012267 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-267a6ddc-6450-4639-ab65-0d17c8a2be4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b75c32a9f7004c2cbd6a7a50c4f8ce00'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:59.013405 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-267a6ddc-6450-4639-ab65-0d17c8a2be4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b75c32a9f7004c2cbd6a7a50c4f8ce00'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:59.014365 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-267a6ddc-6450-4639-ab65-0d17c8a2be4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b75c32a9f7004c2cbd6a7a50c4f8ce00'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:59.022553 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 933/1892] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:59.022553 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecd517-6fab-4446-95c7-fbbddfd173f1 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:59.022553 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecd517-6fab-4446-95c7-fbbddfd173f1 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:59.022553 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecd517-6fab-4446-95c7-fbbddfd173f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:59.041933 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-267a6ddc-6450-4639-ab65-0d17c8a2be4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b75c32a9f7004c2cbd6a7a50c4f8ce00'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:51:59.043391 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-31ecd517-6fab-4446-95c7-fbbddfd173f1 None None] MFA Rules not processed for user `d54521ea1dca44c98d6723d0b9fd6468`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:59.044611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-31ecd517-6fab-4446-95c7-fbbddfd173f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:59.062501 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 960/1893] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:51:58 2022] DELETE /identity/v3/users/b75c32a9f7004c2cbd6a7a50c4f8ce00 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:59.064867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e6e2b-5d77-4d62-b4cc-1380107fc11e None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:59.065288 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e6e2b-5d77-4d62-b4cc-1380107fc11e None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:59.065659 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e6e2b-5d77-4d62-b4cc-1380107fc11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:59.090296 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-4e2e6e2b-5d77-4d62-b4cc-1380107fc11e None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:59.092241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-4e2e6e2b-5d77-4d62-b4cc-1380107fc11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:59.135201 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 934/1894] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jun 23 15:51:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:59.135971 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecd517-6fab-4446-95c7-fbbddfd173f1 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:59.137348 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-31ecd517-6fab-4446-95c7-fbbddfd173f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:59.151846 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecd517-6fab-4446-95c7-fbbddfd173f1 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:59.160303 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 961/1895] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:59.162172 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb66ea7-1169-4fda-a391-4c4d9e1fcc12 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:59.162474 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb66ea7-1169-4fda-a391-4c4d9e1fcc12 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:59.162753 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb66ea7-1169-4fda-a391-4c4d9e1fcc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:59.181389 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-bdb66ea7-1169-4fda-a391-4c4d9e1fcc12 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:51:59.182638 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-bdb66ea7-1169-4fda-a391-4c4d9e1fcc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:59.190477 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 962/1896] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:51:59.191267 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb66ea7-1169-4fda-a391-4c4d9e1fcc12 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:59.192492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-bdb66ea7-1169-4fda-a391-4c4d9e1fcc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:59.213631 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d79a6-7f79-4227-a59c-f9dd1b67894f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:59.214343 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d79a6-7f79-4227-a59c-f9dd1b67894f service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:59.214625 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d79a6-7f79-4227-a59c-f9dd1b67894f service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:59.214900 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d79a6-7f79-4227-a59c-f9dd1b67894f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:59.216719 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-d26d79a6-7f79-4227-a59c-f9dd1b67894f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:59.278561 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb66ea7-1169-4fda-a391-4c4d9e1fcc12 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:59.287638 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8f900-299d-475e-a85e-93b9c4da6042 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:59.288707 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8f900-299d-475e-a85e-93b9c4da6042 service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:59.289186 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8f900-299d-475e-a85e-93b9c4da6042 service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:59.289662 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8f900-299d-475e-a85e-93b9c4da6042 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:59.295443 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d79a6-7f79-4227-a59c-f9dd1b67894f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:59.296944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d79a6-7f79-4227-a59c-f9dd1b67894f service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:59.302918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8f900-299d-475e-a85e-93b9c4da6042 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:59.307394 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 935/1897] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:59.308240 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d79a6-7f79-4227-a59c-f9dd1b67894f service cinder] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:59.309877 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8f900-299d-475e-a85e-93b9c4da6042 service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:59.319667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d79a6-7f79-4227-a59c-f9dd1b67894f service cinder] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:59.321249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 963/1898] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:59.322126 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8f900-299d-475e-a85e-93b9c4da6042 service nova] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:59.323475 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-86d8f900-299d-475e-a85e-93b9c4da6042 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:51:59.325804 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197908c1-5a23-4935-931f-77ccc0e22d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:59.326642 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197908c1-5a23-4935-931f-77ccc0e22d09 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:59.326999 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197908c1-5a23-4935-931f-77ccc0e22d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:59.327355 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197908c1-5a23-4935-931f-77ccc0e22d09 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:59.328569 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197908c1-5a23-4935-931f-77ccc0e22d09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:51:59.328569 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197908c1-5a23-4935-931f-77ccc0e22d09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:59.329546 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:59.330460 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197908c1-5a23-4935-931f-77ccc0e22d09 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:59.345773 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 936/1899] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:51:59.351337 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197908c1-5a23-4935-931f-77ccc0e22d09 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:59.364147 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197908c1-5a23-4935-931f-77ccc0e22d09 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:59.371185 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef23762-00fb-4144-8184-6b4ccaad5b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:59.372429 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef23762-00fb-4144-8184-6b4ccaad5b1c admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:59.372823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef23762-00fb-4144-8184-6b4ccaad5b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:59.373369 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef23762-00fb-4144-8184-6b4ccaad5b1c admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:59.375065 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef23762-00fb-4144-8184-6b4ccaad5b1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:59.377143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef23762-00fb-4144-8184-6b4ccaad5b1c admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:59.382453 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:51:59.412448 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8f900-299d-475e-a85e-93b9c4da6042 service nova] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:59.428008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb0d4c-2623-4055-82b9-b2a5dcfd2cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:59.428683 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb0d4c-2623-4055-82b9-b2a5dcfd2cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:59.428997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb0d4c-2623-4055-82b9-b2a5dcfd2cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:59.429281 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb0d4c-2623-4055-82b9-b2a5dcfd2cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:59.441380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 937/1900] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:51:59 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:51:59.442442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef23762-00fb-4144-8184-6b4ccaad5b1c admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:59.448732 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb0d4c-2623-4055-82b9-b2a5dcfd2cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:59.450274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb0d4c-2623-4055-82b9-b2a5dcfd2cc9 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:59.464505 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 964/1901] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:51:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:51:59.584682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef23762-00fb-4144-8184-6b4ccaad5b1c admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:59.590810 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f906231-e28d-47fe-bb9e-ec81661331aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:59.591683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f906231-e28d-47fe-bb9e-ec81661331aa admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:59.592066 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f906231-e28d-47fe-bb9e-ec81661331aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:59.592448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f906231-e28d-47fe-bb9e-ec81661331aa admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:59.593216 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f906231-e28d-47fe-bb9e-ec81661331aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:59.595965 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f906231-e28d-47fe-bb9e-ec81661331aa admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:59.624493 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 938/1902] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:51:59 2022] POST /identity/v3/users => generated 287 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:51:59.626286 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb0d4c-2623-4055-82b9-b2a5dcfd2cc9 service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:59.637365 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb0d4c-2623-4055-82b9-b2a5dcfd2cc9 service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:59.643291 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ff08c-d826-49f2-904d-30dca354f80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:59.644227 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ff08c-d826-49f2-904d-30dca354f80a admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:59.644694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ff08c-d826-49f2-904d-30dca354f80a admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:59.645232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ff08c-d826-49f2-904d-30dca354f80a admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:59.646876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ff08c-d826-49f2-904d-30dca354f80a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:59.648860 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ff08c-d826-49f2-904d-30dca354f80a admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:59.670122 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f906231-e28d-47fe-bb9e-ec81661331aa admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:59.671769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 965/1903] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:59.699456 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f906231-e28d-47fe-bb9e-ec81661331aa admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:59.715235 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09abf3d-9178-4076-950e-e7fb49daff83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:59.715235 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09abf3d-9178-4076-950e-e7fb49daff83 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:59.715235 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09abf3d-9178-4076-950e-e7fb49daff83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:59.715235 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09abf3d-9178-4076-950e-e7fb49daff83 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:59.728919 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09abf3d-9178-4076-950e-e7fb49daff83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:59.731857 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09abf3d-9178-4076-950e-e7fb49daff83 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:59.753405 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 939/1904] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:51:59.754985 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ff08c-d826-49f2-904d-30dca354f80a admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:51:59.768291 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ff08c-d826-49f2-904d-30dca354f80a admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:51:59.785420 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5877747-faed-41b9-b212-b93e0b97289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:51:59.787055 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5877747-faed-41b9-b212-b93e0b97289d admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:59.787404 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5877747-faed-41b9-b212-b93e0b97289d admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:59.787748 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5877747-faed-41b9-b212-b93e0b97289d admin admin] PATH_INFO: `/v3/projects/16eebdfb6a744de7b0c14a476834ab4c/users/4d4eabecb1e9447ebe2c705623ade25e/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:51:59.957088 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5877747-faed-41b9-b212-b93e0b97289d admin admin] RBAC: Authorizing `identity:create_grant(project_id=16eebdfb6a744de7b0c14a476834ab4c, user_id=4d4eabecb1e9447ebe2c705623ade25e, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:51:59.962693 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5877747-faed-41b9-b212-b93e0b97289d admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:51:59.988401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 966/1905] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:51:59 2022] PUT /identity/v3/projects/16eebdfb6a744de7b0c14a476834ab4c/users/4d4eabecb1e9447ebe2c705623ade25e/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:51:59.994236 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540ba7b-1abb-427a-9257-f4b90f53aa4b None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:51:59.994690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540ba7b-1abb-427a-9257-f4b90f53aa4b None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:51:59.995226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540ba7b-1abb-427a-9257-f4b90f53aa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:00.011914 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5877747-faed-41b9-b212-b93e0b97289d admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:00.015313 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-f5877747-faed-41b9-b212-b93e0b97289d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:00.032502 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-2540ba7b-1abb-427a-9257-f4b90f53aa4b None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:00.034021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-2540ba7b-1abb-427a-9257-f4b90f53aa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:00.119145 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 940/1906] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:00.128935 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5877747-faed-41b9-b212-b93e0b97289d admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:00.130882 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540ba7b-1abb-427a-9257-f4b90f53aa4b None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:00.134552 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec1281-4701-4281-9a05-28984f2d85e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:00.135639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec1281-4701-4281-9a05-28984f2d85e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:00.135929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec1281-4701-4281-9a05-28984f2d85e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:00.136209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec1281-4701-4281-9a05-28984f2d85e9 admin admin] PATH_INFO: `/v3/projects/d03667f7ea344786985955ad1e53354d` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:00.137475 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec1281-4701-4281-9a05-28984f2d85e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d03667f7ea344786985955ad1e53354d)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:00.139441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec1281-4701-4281-9a05-28984f2d85e9 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:00.196220 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-5eec1281-4701-4281-9a05-28984f2d85e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd03667f7ea344786985955ad1e53354d', 'request_id': 'req-5eec1281-4701-4281-9a05-28984f2d85e9'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:00.202441 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540ba7b-1abb-427a-9257-f4b90f53aa4b None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:00.203505 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-5eec1281-4701-4281-9a05-28984f2d85e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd03667f7ea344786985955ad1e53354d', 'request_id': 'req-5eec1281-4701-4281-9a05-28984f2d85e9'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:00.214235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-5eec1281-4701-4281-9a05-28984f2d85e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd03667f7ea344786985955ad1e53354d', 'request_id': 'req-5eec1281-4701-4281-9a05-28984f2d85e9'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:00.222063 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:00.224752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:00.230279 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-5eec1281-4701-4281-9a05-28984f2d85e9 admin admin] The token cache is being invalidate because project d03667f7ea344786985955ad1e53354d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:00.231198 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-5eec1281-4701-4281-9a05-28984f2d85e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:00.232401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-5eec1281-4701-4281-9a05-28984f2d85e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:00.234744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 967/1907] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:00 2022] DELETE /identity/v3/projects/d03667f7ea344786985955ad1e53354d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:00.240138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec1281-4701-4281-9a05-28984f2d85e9 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:00.242507 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5eec1281-4701-4281-9a05-28984f2d85e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:00.268243 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04653937-5028-4ce7-879c-fc8a27c882d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:00.269270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04653937-5028-4ce7-879c-fc8a27c882d4 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:00.269634 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04653937-5028-4ce7-879c-fc8a27c882d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:00.270012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04653937-5028-4ce7-879c-fc8a27c882d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:00.272083 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-04653937-5028-4ce7-879c-fc8a27c882d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:00.313691 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec1281-4701-4281-9a05-28984f2d85e9 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:00.321741 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9148a-6205-4850-860b-f710f1da6d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:00.322655 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9148a-6205-4850-860b-f710f1da6d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:00.322940 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9148a-6205-4850-860b-f710f1da6d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:00.323214 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9148a-6205-4850-860b-f710f1da6d60 admin admin] PATH_INFO: `/v3/users/eb61da8b95de4d99a4085e86774e0068` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:00.324433 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9148a-6205-4850-860b-f710f1da6d60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb61da8b95de4d99a4085e86774e0068)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:00.326414 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9148a-6205-4850-860b-f710f1da6d60 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:00.360899 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04653937-5028-4ce7-879c-fc8a27c882d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:00.362648 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04653937-5028-4ce7-879c-fc8a27c882d4 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:00.374881 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 941/1908] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:52:00.383238 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-c3b9148a-6205-4850-860b-f710f1da6d60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb61da8b95de4d99a4085e86774e0068'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:00.390947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-c3b9148a-6205-4850-860b-f710f1da6d60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb61da8b95de4d99a4085e86774e0068'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:00.392527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-c3b9148a-6205-4850-860b-f710f1da6d60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb61da8b95de4d99a4085e86774e0068'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:00.395228 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-c3b9148a-6205-4850-860b-f710f1da6d60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb61da8b95de4d99a4085e86774e0068'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:00.410919 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-c3b9148a-6205-4850-860b-f710f1da6d60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb61da8b95de4d99a4085e86774e0068'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:00.431796 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 968/1909] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:52:00 2022] DELETE /identity/v3/users/eb61da8b95de4d99a4085e86774e0068 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:01.892955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04653937-5028-4ce7-879c-fc8a27c882d4 service neutron] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:01.917372 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04653937-5028-4ce7-879c-fc8a27c882d4 service neutron] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:02.096515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb97e6-7efa-4c62-945c-db25750c4af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:02.097507 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb97e6-7efa-4c62-945c-db25750c4af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:02.097887 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb97e6-7efa-4c62-945c-db25750c4af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:02.098242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb97e6-7efa-4c62-945c-db25750c4af1 admin admin] PATH_INFO: `/v3/projects/48352e9503f841ce83021615da8e0071` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:02.100044 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb97e6-7efa-4c62-945c-db25750c4af1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48352e9503f841ce83021615da8e0071)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:02.102040 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb97e6-7efa-4c62-945c-db25750c4af1 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:02.151981 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-32bb97e6-7efa-4c62-945c-db25750c4af1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48352e9503f841ce83021615da8e0071', 'request_id': 'req-32bb97e6-7efa-4c62-945c-db25750c4af1'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:02.160925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-32bb97e6-7efa-4c62-945c-db25750c4af1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48352e9503f841ce83021615da8e0071', 'request_id': 'req-32bb97e6-7efa-4c62-945c-db25750c4af1'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:02.167928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-32bb97e6-7efa-4c62-945c-db25750c4af1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48352e9503f841ce83021615da8e0071', 'request_id': 'req-32bb97e6-7efa-4c62-945c-db25750c4af1'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:02.175956 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:02.180341 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-32bb97e6-7efa-4c62-945c-db25750c4af1 admin admin] The token cache is being invalidate because project 48352e9503f841ce83021615da8e0071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:02.180844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-32bb97e6-7efa-4c62-945c-db25750c4af1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:02.182003 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-32bb97e6-7efa-4c62-945c-db25750c4af1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:02.183718 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 942/1910] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:01 2022] DELETE /identity/v3/projects/48352e9503f841ce83021615da8e0071 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:02.188777 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd7df3-806a-4a3b-8619-4fb81e13ef30 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:02.190036 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd7df3-806a-4a3b-8619-4fb81e13ef30 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:02.190507 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd7df3-806a-4a3b-8619-4fb81e13ef30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:02.211398 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-bbfd7df3-806a-4a3b-8619-4fb81e13ef30 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:02.212665 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-bbfd7df3-806a-4a3b-8619-4fb81e13ef30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:02.274128 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 969/1911] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:02.282176 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e8817-69d9-43cd-9358-3a9cdefac504 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:02.282478 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e8817-69d9-43cd-9358-3a9cdefac504 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:02.282832 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e8817-69d9-43cd-9358-3a9cdefac504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:02.302343 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-e06e8817-69d9-43cd-9358-3a9cdefac504 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:02.308889 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-e06e8817-69d9-43cd-9358-3a9cdefac504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:02.320004 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 943/1912] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:02.323878 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd7df3-806a-4a3b-8619-4fb81e13ef30 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:02.335233 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd7df3-806a-4a3b-8619-4fb81e13ef30 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:02.342107 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add60e6-3648-4846-9980-d91d0b4030b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:02.342749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add60e6-3648-4846-9980-d91d0b4030b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:02.343234 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add60e6-3648-4846-9980-d91d0b4030b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:02.343512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add60e6-3648-4846-9980-d91d0b4030b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:02.344767 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add60e6-3648-4846-9980-d91d0b4030b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:52:02.345221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add60e6-3648-4846-9980-d91d0b4030b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:02.347260 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5add60e6-3648-4846-9980-d91d0b4030b8 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:02.360512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 970/1913] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:52:02.365474 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e8817-69d9-43cd-9358-3a9cdefac504 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:02.377012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e8817-69d9-43cd-9358-3a9cdefac504 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:02.382824 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d63bcb-d587-4237-be3c-20a3df6a46d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:02.383599 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d63bcb-d587-4237-be3c-20a3df6a46d1 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:02.383953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d63bcb-d587-4237-be3c-20a3df6a46d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:02.384297 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d63bcb-d587-4237-be3c-20a3df6a46d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:02.385062 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d63bcb-d587-4237-be3c-20a3df6a46d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:02.387095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d63bcb-d587-4237-be3c-20a3df6a46d1 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:02.416783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 944/1914] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:52:02 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:02.420905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add60e6-3648-4846-9980-d91d0b4030b8 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:02.432084 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add60e6-3648-4846-9980-d91d0b4030b8 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:02.436802 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:02.508187 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f1d35-a2e8-4139-b904-12ac5ba67919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:02.508885 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f1d35-a2e8-4139-b904-12ac5ba67919 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:02.509169 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f1d35-a2e8-4139-b904-12ac5ba67919 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:02.509451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f1d35-a2e8-4139-b904-12ac5ba67919 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:02.510260 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f1d35-a2e8-4139-b904-12ac5ba67919 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:02.512215 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f1d35-a2e8-4139-b904-12ac5ba67919 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:02.540121 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d63bcb-d587-4237-be3c-20a3df6a46d1 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:02.540327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 971/1915] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:52:02 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:02.556638 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d63bcb-d587-4237-be3c-20a3df6a46d1 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:02.568836 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7506f6-c9f4-4e76-8007-1476fd8b2a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:02.569671 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7506f6-c9f4-4e76-8007-1476fd8b2a92 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:02.570816 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7506f6-c9f4-4e76-8007-1476fd8b2a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:02.570816 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7506f6-c9f4-4e76-8007-1476fd8b2a92 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:02.571858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7506f6-c9f4-4e76-8007-1476fd8b2a92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:02.575382 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7506f6-c9f4-4e76-8007-1476fd8b2a92 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:02.594680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 945/1916] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:02.598630 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f1d35-a2e8-4139-b904-12ac5ba67919 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:02.609312 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f1d35-a2e8-4139-b904-12ac5ba67919 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:02.622767 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b0ee8-18cd-46ed-9b48-b47b92ba69dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:02.623583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b0ee8-18cd-46ed-9b48-b47b92ba69dc admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:02.623946 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b0ee8-18cd-46ed-9b48-b47b92ba69dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:02.624300 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b0ee8-18cd-46ed-9b48-b47b92ba69dc admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:02.625121 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b0ee8-18cd-46ed-9b48-b47b92ba69dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:02.626867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b0ee8-18cd-46ed-9b48-b47b92ba69dc admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:02.641713 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 972/1917] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:02.646086 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7506f6-c9f4-4e76-8007-1476fd8b2a92 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:02.669316 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7506f6-c9f4-4e76-8007-1476fd8b2a92 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:02.682780 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f33098-b852-4b09-aef3-9afc4dc47922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:02.684505 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f33098-b852-4b09-aef3-9afc4dc47922 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:02.685036 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f33098-b852-4b09-aef3-9afc4dc47922 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:02.686281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f33098-b852-4b09-aef3-9afc4dc47922 admin admin] PATH_INFO: `/v3/projects/c9d453ff54714003a800d24dfa5d6ce0/users/4ff878525d7e4e978faf7434b1c4e212/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:02.742984 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f33098-b852-4b09-aef3-9afc4dc47922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d453ff54714003a800d24dfa5d6ce0, user_id=4ff878525d7e4e978faf7434b1c4e212, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:02.757728 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f33098-b852-4b09-aef3-9afc4dc47922 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:02.793962 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 946/1918] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:02 2022] PUT /identity/v3/projects/c9d453ff54714003a800d24dfa5d6ce0/users/4ff878525d7e4e978faf7434b1c4e212/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:02.796344 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34f918-7361-4f74-acaf-ce984087625a None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:02.797081 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34f918-7361-4f74-acaf-ce984087625a None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:02.797081 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34f918-7361-4f74-acaf-ce984087625a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:02.862705 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-dc34f918-7361-4f74-acaf-ce984087625a None None] MFA Rules not processed for user `4ff878525d7e4e978faf7434b1c4e212`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:02.864056 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-dc34f918-7361-4f74-acaf-ce984087625a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:02.941433 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c402167-2156-438e-b81c-e54933489c05 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:02.942227 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c402167-2156-438e-b81c-e54933489c05 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:02.942227 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c402167-2156-438e-b81c-e54933489c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:02.977826 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-5c402167-2156-438e-b81c-e54933489c05 None None] MFA Rules not processed for user `4d4eabecb1e9447ebe2c705623ade25e`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:02.979077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-5c402167-2156-438e-b81c-e54933489c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:03.008234 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 973/1919] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:03.023916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34f918-7361-4f74-acaf-ce984087625a None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:03.025936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-dc34f918-7361-4f74-acaf-ce984087625a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:03.101176 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 947/1920] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:03.143009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34f918-7361-4f74-acaf-ce984087625a None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:03.147295 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe6c7d-55c6-4907-8acc-f0366ae20f3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:03.148385 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe6c7d-55c6-4907-8acc-f0366ae20f3f service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:03.148750 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe6c7d-55c6-4907-8acc-f0366ae20f3f service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:03.149111 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe6c7d-55c6-4907-8acc-f0366ae20f3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:03.155735 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c402167-2156-438e-b81c-e54933489c05 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:03.158661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-5c402167-2156-438e-b81c-e54933489c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:03.163821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe6c7d-55c6-4907-8acc-f0366ae20f3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:03.166069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe6c7d-55c6-4907-8acc-f0366ae20f3f service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:03.173202 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c402167-2156-438e-b81c-e54933489c05 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:03.182690 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 974/1921] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:52:03.202212 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758f8b1-5315-4d3d-87fc-995ca8a3749a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:03.203867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758f8b1-5315-4d3d-87fc-995ca8a3749a service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:03.204363 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758f8b1-5315-4d3d-87fc-995ca8a3749a service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:03.205238 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758f8b1-5315-4d3d-87fc-995ca8a3749a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:03.218743 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe6c7d-55c6-4907-8acc-f0366ae20f3f service cinder] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:03.242828 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758f8b1-5315-4d3d-87fc-995ca8a3749a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:03.244370 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5758f8b1-5315-4d3d-87fc-995ca8a3749a service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:03.259672 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:03.270253 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 948/1922] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:03.320955 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe6c7d-55c6-4907-8acc-f0366ae20f3f service cinder] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:03.327040 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f856621-751c-4fd4-91bb-be2686b8c460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:03.328203 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f856621-751c-4fd4-91bb-be2686b8c460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:03.328653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f856621-751c-4fd4-91bb-be2686b8c460 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:03.329257 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f856621-751c-4fd4-91bb-be2686b8c460 admin admin] PATH_INFO: `/v3/users/4ff878525d7e4e978faf7434b1c4e212` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:03.330788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f856621-751c-4fd4-91bb-be2686b8c460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ff878525d7e4e978faf7434b1c4e212)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:03.332952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f856621-751c-4fd4-91bb-be2686b8c460 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:03.421118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8f856621-751c-4fd4-91bb-be2686b8c460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ff878525d7e4e978faf7434b1c4e212'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:03.430585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8f856621-751c-4fd4-91bb-be2686b8c460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ff878525d7e4e978faf7434b1c4e212'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:03.431529 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8f856621-751c-4fd4-91bb-be2686b8c460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ff878525d7e4e978faf7434b1c4e212'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:03.432173 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8f856621-751c-4fd4-91bb-be2686b8c460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ff878525d7e4e978faf7434b1c4e212'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:03.453843 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8f856621-751c-4fd4-91bb-be2686b8c460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ff878525d7e4e978faf7434b1c4e212'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:03.491881 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 975/1923] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:52:03 2022] DELETE /identity/v3/users/4ff878525d7e4e978faf7434b1c4e212 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:03.497356 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fa753-3f99-4994-bbc2-081c45a47088 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:03.497887 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fa753-3f99-4994-bbc2-081c45a47088 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:03.498350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fa753-3f99-4994-bbc2-081c45a47088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:03.524243 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-bd4fa753-3f99-4994-bbc2-081c45a47088 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:03.525663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-bd4fa753-3f99-4994-bbc2-081c45a47088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:03.608417 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 949/1924] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:52:03.617045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f856621-751c-4fd4-91bb-be2686b8c460 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:03.618902 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-8f856621-751c-4fd4-91bb-be2686b8c460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:03.644046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fa753-3f99-4994-bbc2-081c45a47088 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:03.645693 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-bd4fa753-3f99-4994-bbc2-081c45a47088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:03.658987 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fa753-3f99-4994-bbc2-081c45a47088 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:03.669244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52d44e-f496-4ca0-8aee-0533326aec41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:03.670392 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52d44e-f496-4ca0-8aee-0533326aec41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:03.670829 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52d44e-f496-4ca0-8aee-0533326aec41 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:03.671119 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af52d44e-f496-4ca0-8aee-0533326aec41 admin admin] PATH_INFO: `/v3/users/67e2aa8bf047454b961c0ada0809d94a` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:03.673153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af52d44e-f496-4ca0-8aee-0533326aec41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67e2aa8bf047454b961c0ada0809d94a)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:03.676041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af52d44e-f496-4ca0-8aee-0533326aec41 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:03.683039 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:03.711569 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f856621-751c-4fd4-91bb-be2686b8c460 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:03.716455 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed4c84-801c-4aa4-9eef-3d07f4fce7cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:03.717117 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed4c84-801c-4aa4-9eef-3d07f4fce7cf service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:03.717403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed4c84-801c-4aa4-9eef-3d07f4fce7cf service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:03.717675 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed4c84-801c-4aa4-9eef-3d07f4fce7cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:03.729507 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed4c84-801c-4aa4-9eef-3d07f4fce7cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:03.731451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed4c84-801c-4aa4-9eef-3d07f4fce7cf service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:03.744606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 976/1925] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:03.744854 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-af52d44e-f496-4ca0-8aee-0533326aec41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67e2aa8bf047454b961c0ada0809d94a'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:03.753516 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-af52d44e-f496-4ca0-8aee-0533326aec41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67e2aa8bf047454b961c0ada0809d94a'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:03.754325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-af52d44e-f496-4ca0-8aee-0533326aec41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67e2aa8bf047454b961c0ada0809d94a'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:03.754957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-af52d44e-f496-4ca0-8aee-0533326aec41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67e2aa8bf047454b961c0ada0809d94a'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:03.784524 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-af52d44e-f496-4ca0-8aee-0533326aec41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67e2aa8bf047454b961c0ada0809d94a'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:03.821350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 950/1926] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:52:03 2022] DELETE /identity/v3/users/67e2aa8bf047454b961c0ada0809d94a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:52:03.826544 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c7fb0-e913-48f7-82f8-c3e6be05392c None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:03.826844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c7fb0-e913-48f7-82f8-c3e6be05392c None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:03.827130 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c7fb0-e913-48f7-82f8-c3e6be05392c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:03.853332 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-c96c7fb0-e913-48f7-82f8-c3e6be05392c None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:03.854723 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-c96c7fb0-e913-48f7-82f8-c3e6be05392c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:03.900523 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:03.933755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 977/1927] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:52:03.945776 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52d44e-f496-4ca0-8aee-0533326aec41 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:03.947246 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-af52d44e-f496-4ca0-8aee-0533326aec41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:04.025477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af52d44e-f496-4ca0-8aee-0533326aec41 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:04.030321 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c6d4c-0e07-4e88-a68c-a7e1aca3ec22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:04.030987 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c6d4c-0e07-4e88-a68c-a7e1aca3ec22 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:04.031266 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c6d4c-0e07-4e88-a68c-a7e1aca3ec22 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:04.031539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c6d4c-0e07-4e88-a68c-a7e1aca3ec22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:04.042175 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c6d4c-0e07-4e88-a68c-a7e1aca3ec22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:04.043521 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c6d4c-0e07-4e88-a68c-a7e1aca3ec22 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:04.054721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 951/1928] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:04.345462 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c7fb0-e913-48f7-82f8-c3e6be05392c None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:04.347481 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-c96c7fb0-e913-48f7-82f8-c3e6be05392c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:04.371310 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c7fb0-e913-48f7-82f8-c3e6be05392c None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:04.376173 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b836c83-fee4-4628-bd54-d7759235908d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:04.377104 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b836c83-fee4-4628-bd54-d7759235908d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:04.377299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b836c83-fee4-4628-bd54-d7759235908d admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:04.377764 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b836c83-fee4-4628-bd54-d7759235908d admin admin] PATH_INFO: `/v3/projects/c9d453ff54714003a800d24dfa5d6ce0` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:04.379030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b836c83-fee4-4628-bd54-d7759235908d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d453ff54714003a800d24dfa5d6ce0)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:04.381519 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b836c83-fee4-4628-bd54-d7759235908d admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:04.459384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6b836c83-fee4-4628-bd54-d7759235908d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d453ff54714003a800d24dfa5d6ce0', 'request_id': 'req-6b836c83-fee4-4628-bd54-d7759235908d'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:04.469648 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6b836c83-fee4-4628-bd54-d7759235908d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d453ff54714003a800d24dfa5d6ce0', 'request_id': 'req-6b836c83-fee4-4628-bd54-d7759235908d'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:04.481729 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6b836c83-fee4-4628-bd54-d7759235908d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d453ff54714003a800d24dfa5d6ce0', 'request_id': 'req-6b836c83-fee4-4628-bd54-d7759235908d'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:04.496900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6b836c83-fee4-4628-bd54-d7759235908d admin admin] The token cache is being invalidate because project c9d453ff54714003a800d24dfa5d6ce0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:04.497308 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6b836c83-fee4-4628-bd54-d7759235908d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:04.498062 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6b836c83-fee4-4628-bd54-d7759235908d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:04.500259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 978/1929] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:04 2022] DELETE /identity/v3/projects/c9d453ff54714003a800d24dfa5d6ce0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:04.505676 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e13c3-d65c-4884-9975-e1181c0157e2 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:04.505940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e13c3-d65c-4884-9975-e1181c0157e2 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:04.506225 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e13c3-d65c-4884-9975-e1181c0157e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:04.536849 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-1e4e13c3-d65c-4884-9975-e1181c0157e2 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:04.538266 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-1e4e13c3-d65c-4884-9975-e1181c0157e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:04.629485 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b836c83-fee4-4628-bd54-d7759235908d admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:04.631004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-6b836c83-fee4-4628-bd54-d7759235908d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:04.638097 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 952/1930] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:04.642473 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f86009-e47a-4db5-b747-39e06197ac67 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:04.642768 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f86009-e47a-4db5-b747-39e06197ac67 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:04.643051 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f86009-e47a-4db5-b747-39e06197ac67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:04.656151 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b836c83-fee4-4628-bd54-d7759235908d admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:04.666716 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad9711-457a-4146-89cd-f1608bde5846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:04.668405 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad9711-457a-4146-89cd-f1608bde5846 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:04.668799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad9711-457a-4146-89cd-f1608bde5846 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:04.669239 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad9711-457a-4146-89cd-f1608bde5846 admin admin] PATH_INFO: `/v3/projects/ab35ef3260e64eda980f87ff64260046` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:04.671450 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad9711-457a-4146-89cd-f1608bde5846 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab35ef3260e64eda980f87ff64260046)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:04.674252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad9711-457a-4146-89cd-f1608bde5846 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:04.682404 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-65f86009-e47a-4db5-b747-39e06197ac67 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:04.684015 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-65f86009-e47a-4db5-b747-39e06197ac67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:04.697795 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 953/1931] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:52:04.702025 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f86009-e47a-4db5-b747-39e06197ac67 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:04.713822 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f86009-e47a-4db5-b747-39e06197ac67 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:04.718767 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f00792-57c4-4705-803f-78af5a46a9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:04.719554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f00792-57c4-4705-803f-78af5a46a9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:04.719901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f00792-57c4-4705-803f-78af5a46a9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:04.720256 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f00792-57c4-4705-803f-78af5a46a9c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:04.721083 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f00792-57c4-4705-803f-78af5a46a9c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:52:04.721460 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f00792-57c4-4705-803f-78af5a46a9c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:04.723395 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f00792-57c4-4705-803f-78af5a46a9c2 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:04.741086 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 954/1932] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:52:04.745313 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f00792-57c4-4705-803f-78af5a46a9c2 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:04.761348 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f00792-57c4-4705-803f-78af5a46a9c2 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:04.766877 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c09be-e5ca-4519-bf0b-67d988085ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:04.767711 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c09be-e5ca-4519-bf0b-67d988085ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:04.768136 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c09be-e5ca-4519-bf0b-67d988085ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:04.768518 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c09be-e5ca-4519-bf0b-67d988085ff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:04.769345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c09be-e5ca-4519-bf0b-67d988085ff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:04.772006 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c09be-e5ca-4519-bf0b-67d988085ff8 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:04.785298 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:04.797551 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d2ad9711-457a-4146-89cd-f1608bde5846 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab35ef3260e64eda980f87ff64260046', 'request_id': 'req-d2ad9711-457a-4146-89cd-f1608bde5846'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:04.813561 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d2ad9711-457a-4146-89cd-f1608bde5846 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab35ef3260e64eda980f87ff64260046', 'request_id': 'req-d2ad9711-457a-4146-89cd-f1608bde5846'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:04.827634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d2ad9711-457a-4146-89cd-f1608bde5846 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab35ef3260e64eda980f87ff64260046', 'request_id': 'req-d2ad9711-457a-4146-89cd-f1608bde5846'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:04.828690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 955/1933] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:52:04 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:52:04.834843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c09be-e5ca-4519-bf0b-67d988085ff8 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:04.880627 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d2ad9711-457a-4146-89cd-f1608bde5846 admin admin] The token cache is being invalidate because project ab35ef3260e64eda980f87ff64260046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:04.881198 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d2ad9711-457a-4146-89cd-f1608bde5846 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:04.882268 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d2ad9711-457a-4146-89cd-f1608bde5846 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:04.888728 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 979/1934] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:04 2022] DELETE /identity/v3/projects/ab35ef3260e64eda980f87ff64260046 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:04.891998 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192d645-2636-4061-8349-b29518d731dc None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:04.891998 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192d645-2636-4061-8349-b29518d731dc None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:04.891998 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192d645-2636-4061-8349-b29518d731dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:04.923892 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-4192d645-2636-4061-8349-b29518d731dc None None] MFA Rules not processed for user `4d4eabecb1e9447ebe2c705623ade25e`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:04.926272 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-4192d645-2636-4061-8349-b29518d731dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:04.960354 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c09be-e5ca-4519-bf0b-67d988085ff8 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:04.965892 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281b3cc-87b2-4342-84d8-5fbee0f1b230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:04.966600 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281b3cc-87b2-4342-84d8-5fbee0f1b230 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:04.966896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281b3cc-87b2-4342-84d8-5fbee0f1b230 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:04.967325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281b3cc-87b2-4342-84d8-5fbee0f1b230 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:04.967874 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281b3cc-87b2-4342-84d8-5fbee0f1b230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:04.970122 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281b3cc-87b2-4342-84d8-5fbee0f1b230 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:04.994842 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 956/1935] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:52:04 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:04.996328 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281b3cc-87b2-4342-84d8-5fbee0f1b230 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:05.000106 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-2281b3cc-87b2-4342-84d8-5fbee0f1b230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:05.014964 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281b3cc-87b2-4342-84d8-5fbee0f1b230 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:05.020419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eae560-4c46-4593-b4cc-23af3e04a076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:05.021938 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eae560-4c46-4593-b4cc-23af3e04a076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:05.022253 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eae560-4c46-4593-b4cc-23af3e04a076 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:05.022542 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eae560-4c46-4593-b4cc-23af3e04a076 admin admin] PATH_INFO: `/v3/users/692c05a7ffbb40e6bbe86b68a8c48a57` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:05.023870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eae560-4c46-4593-b4cc-23af3e04a076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=692c05a7ffbb40e6bbe86b68a8c48a57)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:05.025819 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:05.026155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eae560-4c46-4593-b4cc-23af3e04a076 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:05.054234 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 980/1936] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:05.054974 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192d645-2636-4061-8349-b29518d731dc None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:05.056869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-4192d645-2636-4061-8349-b29518d731dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:05.102645 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192d645-2636-4061-8349-b29518d731dc None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:05.108318 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc1ae3-1efb-4306-ac16-e7eb3db6060d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:05.109004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc1ae3-1efb-4306-ac16-e7eb3db6060d admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:05.109291 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc1ae3-1efb-4306-ac16-e7eb3db6060d admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:05.109704 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc1ae3-1efb-4306-ac16-e7eb3db6060d admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:05.110498 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc1ae3-1efb-4306-ac16-e7eb3db6060d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:05.112106 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc1ae3-1efb-4306-ac16-e7eb3db6060d admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:05.125843 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 981/1937] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:05.130866 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc1ae3-1efb-4306-ac16-e7eb3db6060d admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:05.132939 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-14eae560-4c46-4593-b4cc-23af3e04a076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '692c05a7ffbb40e6bbe86b68a8c48a57'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:05.142580 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-14eae560-4c46-4593-b4cc-23af3e04a076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '692c05a7ffbb40e6bbe86b68a8c48a57'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:05.143486 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-14eae560-4c46-4593-b4cc-23af3e04a076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '692c05a7ffbb40e6bbe86b68a8c48a57'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:05.151503 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc1ae3-1efb-4306-ac16-e7eb3db6060d admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:05.158324 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-14eae560-4c46-4593-b4cc-23af3e04a076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '692c05a7ffbb40e6bbe86b68a8c48a57'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:05.166612 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ff0f6-4142-4990-9396-021b706d4a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:05.167300 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ff0f6-4142-4990-9396-021b706d4a95 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:05.167588 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ff0f6-4142-4990-9396-021b706d4a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:05.167905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ff0f6-4142-4990-9396-021b706d4a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:05.169246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ff0f6-4142-4990-9396-021b706d4a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:05.170944 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ff0f6-4142-4990-9396-021b706d4a95 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:05.190966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 982/1938] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:05.192090 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ff0f6-4142-4990-9396-021b706d4a95 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:05.195041 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e65ff0f6-4142-4990-9396-021b706d4a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:05.203963 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-14eae560-4c46-4593-b4cc-23af3e04a076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '692c05a7ffbb40e6bbe86b68a8c48a57'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:05.215109 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ff0f6-4142-4990-9396-021b706d4a95 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:05.225569 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef07cf2-7041-4525-914c-a1bc8b5cd890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:05.226399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef07cf2-7041-4525-914c-a1bc8b5cd890 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:05.226700 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef07cf2-7041-4525-914c-a1bc8b5cd890 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:05.226988 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef07cf2-7041-4525-914c-a1bc8b5cd890 admin admin] PATH_INFO: `/v3/projects/277752fcfb1645979f179b5f8017a5d9/users/b1d59aa661324761a643b185891f9e5d/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:05.230780 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 957/1939] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:52:04 2022] DELETE /identity/v3/users/692c05a7ffbb40e6bbe86b68a8c48a57 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:05.245635 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef07cf2-7041-4525-914c-a1bc8b5cd890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=277752fcfb1645979f179b5f8017a5d9, user_id=b1d59aa661324761a643b185891f9e5d, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:05.248444 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef07cf2-7041-4525-914c-a1bc8b5cd890 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:05.266534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 983/1940] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:05 2022] PUT /identity/v3/projects/277752fcfb1645979f179b5f8017a5d9/users/b1d59aa661324761a643b185891f9e5d/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:05.278719 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8e3fc-ed9b-483f-8f0b-1c47afdf20eb None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:05.279153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8e3fc-ed9b-483f-8f0b-1c47afdf20eb None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:05.279555 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8e3fc-ed9b-483f-8f0b-1c47afdf20eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:05.310777 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-d2c8e3fc-ed9b-483f-8f0b-1c47afdf20eb None None] MFA Rules not processed for user `b1d59aa661324761a643b185891f9e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:05.311965 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-d2c8e3fc-ed9b-483f-8f0b-1c47afdf20eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:05.355995 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:05.391024 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 958/1941] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:05.398549 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef07cf2-7041-4525-914c-a1bc8b5cd890 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:05.400433 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-7ef07cf2-7041-4525-914c-a1bc8b5cd890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:05.486283 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef07cf2-7041-4525-914c-a1bc8b5cd890 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:05.491772 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2417712-6fc9-4aad-beb7-bebb8ca324f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:05.492523 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2417712-6fc9-4aad-beb7-bebb8ca324f4 service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:05.492873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2417712-6fc9-4aad-beb7-bebb8ca324f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:05.493215 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2417712-6fc9-4aad-beb7-bebb8ca324f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:05.503949 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2417712-6fc9-4aad-beb7-bebb8ca324f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:05.506252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2417712-6fc9-4aad-beb7-bebb8ca324f4 service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:05.525918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 984/1942] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:05.904848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8e3fc-ed9b-483f-8f0b-1c47afdf20eb None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:05.907079 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-d2c8e3fc-ed9b-483f-8f0b-1c47afdf20eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:06.021246 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8e3fc-ed9b-483f-8f0b-1c47afdf20eb None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:06.028444 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3457a-786c-40a0-900d-22df7e81584a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:06.029330 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3457a-786c-40a0-900d-22df7e81584a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:06.030018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3457a-786c-40a0-900d-22df7e81584a admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:06.030018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3457a-786c-40a0-900d-22df7e81584a admin admin] PATH_INFO: `/v3/projects/2013d3c726c24479ab48fa18d7b19e0b` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:06.031200 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3457a-786c-40a0-900d-22df7e81584a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2013d3c726c24479ab48fa18d7b19e0b)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:06.033370 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3457a-786c-40a0-900d-22df7e81584a admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:06.101914 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-afd3457a-786c-40a0-900d-22df7e81584a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2013d3c726c24479ab48fa18d7b19e0b', 'request_id': 'req-afd3457a-786c-40a0-900d-22df7e81584a'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:06.113474 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-afd3457a-786c-40a0-900d-22df7e81584a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2013d3c726c24479ab48fa18d7b19e0b', 'request_id': 'req-afd3457a-786c-40a0-900d-22df7e81584a'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:06.123399 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-afd3457a-786c-40a0-900d-22df7e81584a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2013d3c726c24479ab48fa18d7b19e0b', 'request_id': 'req-afd3457a-786c-40a0-900d-22df7e81584a'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:06.134322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-afd3457a-786c-40a0-900d-22df7e81584a admin admin] The token cache is being invalidate because project 2013d3c726c24479ab48fa18d7b19e0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:06.134625 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-afd3457a-786c-40a0-900d-22df7e81584a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:06.135309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-afd3457a-786c-40a0-900d-22df7e81584a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:06.137128 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 959/1943] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:05 2022] DELETE /identity/v3/projects/2013d3c726c24479ab48fa18d7b19e0b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:06.142128 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03eed36-af7a-468b-9fda-43dbf5192309 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:06.142582 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03eed36-af7a-468b-9fda-43dbf5192309 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:06.142862 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03eed36-af7a-468b-9fda-43dbf5192309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:06.165705 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-a03eed36-af7a-468b-9fda-43dbf5192309 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:06.167019 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-a03eed36-af7a-468b-9fda-43dbf5192309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:06.247035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 985/1944] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:52:06.259952 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8dadf-6dbf-4e41-a970-3b21aad103fc None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:06.260713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8dadf-6dbf-4e41-a970-3b21aad103fc None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:06.261187 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8dadf-6dbf-4e41-a970-3b21aad103fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:06.286795 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-acc8dadf-6dbf-4e41-a970-3b21aad103fc None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:06.288340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-acc8dadf-6dbf-4e41-a970-3b21aad103fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:06.299361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 960/1945] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:06.303447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03eed36-af7a-468b-9fda-43dbf5192309 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:06.324777 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03eed36-af7a-468b-9fda-43dbf5192309 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:06.329745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9e7d2-dc18-4de8-9e6c-43ba52d6b29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:06.330564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9e7d2-dc18-4de8-9e6c-43ba52d6b29b admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:06.330956 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9e7d2-dc18-4de8-9e6c-43ba52d6b29b admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:06.331330 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9e7d2-dc18-4de8-9e6c-43ba52d6b29b admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:06.332186 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9e7d2-dc18-4de8-9e6c-43ba52d6b29b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:52:06.333886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9e7d2-dc18-4de8-9e6c-43ba52d6b29b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:06.334984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9e7d2-dc18-4de8-9e6c-43ba52d6b29b admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:06.354129 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 986/1946] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:52:06.355436 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8dadf-6dbf-4e41-a970-3b21aad103fc None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:06.365793 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8dadf-6dbf-4e41-a970-3b21aad103fc None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:06.371808 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43522ae-174f-4c80-ad9d-f91f758ac6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:06.372577 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43522ae-174f-4c80-ad9d-f91f758ac6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:06.372925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43522ae-174f-4c80-ad9d-f91f758ac6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:06.373269 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43522ae-174f-4c80-ad9d-f91f758ac6f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:06.374097 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43522ae-174f-4c80-ad9d-f91f758ac6f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:06.376148 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43522ae-174f-4c80-ad9d-f91f758ac6f1 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:06.405893 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 961/1947] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:52:06 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:52:06.409231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9e7d2-dc18-4de8-9e6c-43ba52d6b29b admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:06.421114 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9e7d2-dc18-4de8-9e6c-43ba52d6b29b admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:06.472372 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:06.499895 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1414e5d-aa27-4e45-9380-f43805f5d2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:06.501347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1414e5d-aa27-4e45-9380-f43805f5d2fc admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:06.502199 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1414e5d-aa27-4e45-9380-f43805f5d2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:06.502759 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1414e5d-aa27-4e45-9380-f43805f5d2fc admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:06.503746 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1414e5d-aa27-4e45-9380-f43805f5d2fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:06.506506 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1414e5d-aa27-4e45-9380-f43805f5d2fc admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:06.533813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 987/1948] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:52:06 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:52:06.538565 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43522ae-174f-4c80-ad9d-f91f758ac6f1 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:06.556891 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43522ae-174f-4c80-ad9d-f91f758ac6f1 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:06.571316 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2745d5-0bec-4de3-b8c4-cb774e0fa74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:06.572010 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2745d5-0bec-4de3-b8c4-cb774e0fa74c admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:06.572387 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2745d5-0bec-4de3-b8c4-cb774e0fa74c admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:06.572668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2745d5-0bec-4de3-b8c4-cb774e0fa74c admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:06.573463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2745d5-0bec-4de3-b8c4-cb774e0fa74c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:06.575249 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2745d5-0bec-4de3-b8c4-cb774e0fa74c admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:06.588135 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 962/1949] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 15:52:06.592194 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1414e5d-aa27-4e45-9380-f43805f5d2fc admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:06.603388 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1414e5d-aa27-4e45-9380-f43805f5d2fc admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:06.608502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9fd06-29cb-48c2-97d3-553846c8157b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:06.609337 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9fd06-29cb-48c2-97d3-553846c8157b admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:06.610557 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9fd06-29cb-48c2-97d3-553846c8157b admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:06.610955 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9fd06-29cb-48c2-97d3-553846c8157b admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:06.611827 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9fd06-29cb-48c2-97d3-553846c8157b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:06.613716 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9fd06-29cb-48c2-97d3-553846c8157b admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:06.629634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 988/1950] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:06.631405 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2745d5-0bec-4de3-b8c4-cb774e0fa74c admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:06.644062 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2745d5-0bec-4de3-b8c4-cb774e0fa74c admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:06.651002 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94785861-2b81-488f-8247-4cc5df4e10b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:06.652614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94785861-2b81-488f-8247-4cc5df4e10b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:06.652978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94785861-2b81-488f-8247-4cc5df4e10b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:06.653324 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94785861-2b81-488f-8247-4cc5df4e10b9 admin admin] PATH_INFO: `/v3/projects/92edc615a2524450a816820ac8fbf690/users/bc1095f472e9449c9a991c73b6c6e2d7/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:06.671163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94785861-2b81-488f-8247-4cc5df4e10b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92edc615a2524450a816820ac8fbf690, user_id=bc1095f472e9449c9a991c73b6c6e2d7, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:06.674177 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94785861-2b81-488f-8247-4cc5df4e10b9 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:06.697805 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 963/1951] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:06 2022] PUT /identity/v3/projects/92edc615a2524450a816820ac8fbf690/users/bc1095f472e9449c9a991c73b6c6e2d7/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:06.699765 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19df6e9-4158-4eb8-9ecc-4239daddc318 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:06.700166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19df6e9-4158-4eb8-9ecc-4239daddc318 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:06.700451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19df6e9-4158-4eb8-9ecc-4239daddc318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:06.728255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-b19df6e9-4158-4eb8-9ecc-4239daddc318 None None] MFA Rules not processed for user `bc1095f472e9449c9a991c73b6c6e2d7`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:06.729544 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-b19df6e9-4158-4eb8-9ecc-4239daddc318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:06.796508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 989/1952] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:06.800888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94785861-2b81-488f-8247-4cc5df4e10b9 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:06.807174 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:06.868075 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94785861-2b81-488f-8247-4cc5df4e10b9 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:06.873565 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3c547-3428-45a7-938f-19ba131c671d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:06.874281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3c547-3428-45a7-938f-19ba131c671d admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:06.874731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3c547-3428-45a7-938f-19ba131c671d admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:06.875019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3c547-3428-45a7-938f-19ba131c671d admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:06.876034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3c547-3428-45a7-938f-19ba131c671d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:06.879396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3c547-3428-45a7-938f-19ba131c671d admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:06.919730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 964/1953] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:52:06 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:06.921247 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19df6e9-4158-4eb8-9ecc-4239daddc318 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:06.935620 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19df6e9-4158-4eb8-9ecc-4239daddc318 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:07.041112 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9853e-b206-4a72-bd8d-8a26fd2e3c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:07.041995 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9853e-b206-4a72-bd8d-8a26fd2e3c31 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:07.042368 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9853e-b206-4a72-bd8d-8a26fd2e3c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:07.042713 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9853e-b206-4a72-bd8d-8a26fd2e3c31 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:07.043516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9853e-b206-4a72-bd8d-8a26fd2e3c31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:07.045582 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c9853e-b206-4a72-bd8d-8a26fd2e3c31 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:07.072537 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 990/1954] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:52:06 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:07.076975 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3c547-3428-45a7-938f-19ba131c671d admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:07.090349 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3c547-3428-45a7-938f-19ba131c671d admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:07.096289 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025678a-b312-4e63-8fdc-2c64a0761524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:07.097040 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025678a-b312-4e63-8fdc-2c64a0761524 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:07.097497 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025678a-b312-4e63-8fdc-2c64a0761524 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:07.097968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025678a-b312-4e63-8fdc-2c64a0761524 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:07.098812 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025678a-b312-4e63-8fdc-2c64a0761524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:07.101243 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025678a-b312-4e63-8fdc-2c64a0761524 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:07.113524 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 965/1955] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:07.119156 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9853e-b206-4a72-bd8d-8a26fd2e3c31 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:07.134881 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c9853e-b206-4a72-bd8d-8a26fd2e3c31 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:07.140791 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827a345-d929-4ac3-befa-797c7d26de7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:07.141471 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827a345-d929-4ac3-befa-797c7d26de7f admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:07.141806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827a345-d929-4ac3-befa-797c7d26de7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:07.142134 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827a345-d929-4ac3-befa-797c7d26de7f admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:07.142877 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827a345-d929-4ac3-befa-797c7d26de7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:07.144639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827a345-d929-4ac3-befa-797c7d26de7f admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:07.158340 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 991/1956] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:07.162749 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025678a-b312-4e63-8fdc-2c64a0761524 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:07.179342 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025678a-b312-4e63-8fdc-2c64a0761524 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:07.184473 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fb029-ae70-4b56-a789-2049e672a195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:07.185368 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fb029-ae70-4b56-a789-2049e672a195 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:07.185655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fb029-ae70-4b56-a789-2049e672a195 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:07.185957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fb029-ae70-4b56-a789-2049e672a195 admin admin] PATH_INFO: `/v3/projects/fcb4849bb2474b889b7a40a964a46ce7/users/bcbb62cbb71847088bde99c6405a42f4/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:07.209370 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fb029-ae70-4b56-a789-2049e672a195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb4849bb2474b889b7a40a964a46ce7, user_id=bcbb62cbb71847088bde99c6405a42f4, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:07.215408 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fb029-ae70-4b56-a789-2049e672a195 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:07.236534 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 966/1957] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:07 2022] PUT /identity/v3/projects/fcb4849bb2474b889b7a40a964a46ce7/users/bcbb62cbb71847088bde99c6405a42f4/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:52:07.248202 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61c13b-88da-4bfd-846c-5d82a19d484e None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:07.248529 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61c13b-88da-4bfd-846c-5d82a19d484e None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:07.249147 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc61c13b-88da-4bfd-846c-5d82a19d484e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:07.284787 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-fc61c13b-88da-4bfd-846c-5d82a19d484e None None] MFA Rules not processed for user `bcbb62cbb71847088bde99c6405a42f4`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:07.286236 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-fc61c13b-88da-4bfd-846c-5d82a19d484e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:07.296710 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:07.376761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 992/1958] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:52:07.378558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fb029-ae70-4b56-a789-2049e672a195 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:07.448048 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fb029-ae70-4b56-a789-2049e672a195 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:07.454047 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab325be7-926d-4ba1-b5bb-a0b57b3b51be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:07.454831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab325be7-926d-4ba1-b5bb-a0b57b3b51be admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:07.455211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab325be7-926d-4ba1-b5bb-a0b57b3b51be admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:07.455583 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab325be7-926d-4ba1-b5bb-a0b57b3b51be admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:07.456382 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab325be7-926d-4ba1-b5bb-a0b57b3b51be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:07.458744 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab325be7-926d-4ba1-b5bb-a0b57b3b51be admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:07.537508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 967/1959] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:52:07 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:07.541770 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61c13b-88da-4bfd-846c-5d82a19d484e None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:07.567284 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc61c13b-88da-4bfd-846c-5d82a19d484e None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:07.658365 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408da5f-9a81-4fe7-8cff-97e892b8411e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:07.659162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408da5f-9a81-4fe7-8cff-97e892b8411e admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:07.659504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408da5f-9a81-4fe7-8cff-97e892b8411e admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:07.659794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408da5f-9a81-4fe7-8cff-97e892b8411e admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:07.660561 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408da5f-9a81-4fe7-8cff-97e892b8411e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:07.663287 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408da5f-9a81-4fe7-8cff-97e892b8411e admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:07.716082 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 993/1960] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:52:07 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:07.717731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab325be7-926d-4ba1-b5bb-a0b57b3b51be admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:07.749108 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab325be7-926d-4ba1-b5bb-a0b57b3b51be admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:07.763351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb37797-de61-41f9-9af4-9a946fcb1aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:07.766366 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb37797-de61-41f9-9af4-9a946fcb1aaa admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:07.766659 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb37797-de61-41f9-9af4-9a946fcb1aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:07.769099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb37797-de61-41f9-9af4-9a946fcb1aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:07.770186 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb37797-de61-41f9-9af4-9a946fcb1aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:07.789996 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb37797-de61-41f9-9af4-9a946fcb1aaa admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:07.813482 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 968/1961] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 15:52:07.818177 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408da5f-9a81-4fe7-8cff-97e892b8411e admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:07.837723 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408da5f-9a81-4fe7-8cff-97e892b8411e admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:07.845394 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9c7e1-824a-4693-9e6d-a5cb736fc074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:07.846560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9c7e1-824a-4693-9e6d-a5cb736fc074 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:07.846996 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9c7e1-824a-4693-9e6d-a5cb736fc074 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:07.847430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9c7e1-824a-4693-9e6d-a5cb736fc074 admin admin] PATH_INFO: `/v3/projects/3df9923b8962401bb99182ee4fb250ed/users/aad7cdd61fec49019ee6085d35ffd704/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:07.866499 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9c7e1-824a-4693-9e6d-a5cb736fc074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df9923b8962401bb99182ee4fb250ed, user_id=aad7cdd61fec49019ee6085d35ffd704, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:07.869302 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9c7e1-824a-4693-9e6d-a5cb736fc074 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:07.889169 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 994/1962] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:07 2022] PUT /identity/v3/projects/3df9923b8962401bb99182ee4fb250ed/users/aad7cdd61fec49019ee6085d35ffd704/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:07.892914 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb37797-de61-41f9-9af4-9a946fcb1aaa admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:07.904514 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb37797-de61-41f9-9af4-9a946fcb1aaa admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:07.937480 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:07.994831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838f86a-06c5-41ea-8f52-97ae1c24638c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:07.995789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838f86a-06c5-41ea-8f52-97ae1c24638c admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:07.996201 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838f86a-06c5-41ea-8f52-97ae1c24638c admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:07.996727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838f86a-06c5-41ea-8f52-97ae1c24638c admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:07.997711 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838f86a-06c5-41ea-8f52-97ae1c24638c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:08.000055 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838f86a-06c5-41ea-8f52-97ae1c24638c admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:08.014896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 969/1963] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:08.019171 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9c7e1-824a-4693-9e6d-a5cb736fc074 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:08.030437 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9c7e1-824a-4693-9e6d-a5cb736fc074 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:08.035626 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047c991-b8e4-4594-a2cc-12c2d8098f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:08.037428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047c991-b8e4-4594-a2cc-12c2d8098f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:08.037428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047c991-b8e4-4594-a2cc-12c2d8098f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:08.037832 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047c991-b8e4-4594-a2cc-12c2d8098f99 admin admin] PATH_INFO: `/v3/projects/3df9923b8962401bb99182ee4fb250ed/users/aad7cdd61fec49019ee6085d35ffd704/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:08.044999 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047c991-b8e4-4594-a2cc-12c2d8098f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df9923b8962401bb99182ee4fb250ed, user_id=aad7cdd61fec49019ee6085d35ffd704, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:08.048175 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1047c991-b8e4-4594-a2cc-12c2d8098f99 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:08.059421 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 995/1964] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:08 2022] PUT /identity/v3/projects/3df9923b8962401bb99182ee4fb250ed/users/aad7cdd61fec49019ee6085d35ffd704/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:08.070635 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb05f03-56b8-44a9-9719-a4d3e30a8f4f None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:08.070930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb05f03-56b8-44a9-9719-a4d3e30a8f4f None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:08.071912 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb05f03-56b8-44a9-9719-a4d3e30a8f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:08.100616 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-efb05f03-56b8-44a9-9719-a4d3e30a8f4f None None] MFA Rules not processed for user `aad7cdd61fec49019ee6085d35ffd704`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:08.101849 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-efb05f03-56b8-44a9-9719-a4d3e30a8f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:08.182093 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 970/1965] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:08.195219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047c991-b8e4-4594-a2cc-12c2d8098f99 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:08.201156 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-1047c991-b8e4-4594-a2cc-12c2d8098f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:08.266035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1047c991-b8e4-4594-a2cc-12c2d8098f99 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:08.270055 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81f9f1-5a3f-4ccc-82cd-1efa29956ec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:08.271260 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81f9f1-5a3f-4ccc-82cd-1efa29956ec1 service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:08.271587 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81f9f1-5a3f-4ccc-82cd-1efa29956ec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:08.271880 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81f9f1-5a3f-4ccc-82cd-1efa29956ec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:08.287464 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81f9f1-5a3f-4ccc-82cd-1efa29956ec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:08.288929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81f9f1-5a3f-4ccc-82cd-1efa29956ec1 service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:08.302083 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 996/1966] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:09.119006 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb05f03-56b8-44a9-9719-a4d3e30a8f4f None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:09.121015 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-efb05f03-56b8-44a9-9719-a4d3e30a8f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:09.138092 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb05f03-56b8-44a9-9719-a4d3e30a8f4f None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:09.143537 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0123c-b295-49d6-a247-2dc3a65967fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:09.144383 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0123c-b295-49d6-a247-2dc3a65967fd service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:09.146242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0123c-b295-49d6-a247-2dc3a65967fd service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:09.146700 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0123c-b295-49d6-a247-2dc3a65967fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:09.220932 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0123c-b295-49d6-a247-2dc3a65967fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:09.222555 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0123c-b295-49d6-a247-2dc3a65967fd service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:09.237509 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 971/1967] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:11.240882 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81f9f1-5a3f-4ccc-82cd-1efa29956ec1 service cinder] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:11.242407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-4e81f9f1-5a3f-4ccc-82cd-1efa29956ec1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:11.252582 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:11.312355 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81f9f1-5a3f-4ccc-82cd-1efa29956ec1 service cinder] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:11.316954 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a43c55-a1b6-4a20-b362-e69e17651749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:11.317872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a43c55-a1b6-4a20-b362-e69e17651749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:11.318162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a43c55-a1b6-4a20-b362-e69e17651749 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:11.318442 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a43c55-a1b6-4a20-b362-e69e17651749 admin admin] PATH_INFO: `/v3/users/b1d59aa661324761a643b185891f9e5d` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:11.319634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a43c55-a1b6-4a20-b362-e69e17651749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1d59aa661324761a643b185891f9e5d)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:11.321550 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a43c55-a1b6-4a20-b362-e69e17651749 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:11.376962 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d0a43c55-a1b6-4a20-b362-e69e17651749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1d59aa661324761a643b185891f9e5d'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:11.384412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d0a43c55-a1b6-4a20-b362-e69e17651749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1d59aa661324761a643b185891f9e5d'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:11.386058 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d0a43c55-a1b6-4a20-b362-e69e17651749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1d59aa661324761a643b185891f9e5d'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:11.386354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d0a43c55-a1b6-4a20-b362-e69e17651749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1d59aa661324761a643b185891f9e5d'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:11.407887 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d0a43c55-a1b6-4a20-b362-e69e17651749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1d59aa661324761a643b185891f9e5d'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:11.429947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 997/1968] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:52:11 2022] DELETE /identity/v3/users/b1d59aa661324761a643b185891f9e5d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:52:11.432340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9ff81-d6b3-482c-8bb6-d863c52b6a30 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:11.433542 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9ff81-d6b3-482c-8bb6-d863c52b6a30 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:11.433950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe9ff81-d6b3-482c-8bb6-d863c52b6a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:11.463999 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-ebe9ff81-d6b3-482c-8bb6-d863c52b6a30 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:11.465587 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-ebe9ff81-d6b3-482c-8bb6-d863c52b6a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:11.516870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:11.536704 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 972/1969] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:11.551814 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a43c55-a1b6-4a20-b362-e69e17651749 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:11.553610 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-d0a43c55-a1b6-4a20-b362-e69e17651749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:11.636971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a43c55-a1b6-4a20-b362-e69e17651749 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:11.640658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047c4a9-a218-472b-9111-cf78c6ed757c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:11.641457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047c4a9-a218-472b-9111-cf78c6ed757c service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:11.641746 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047c4a9-a218-472b-9111-cf78c6ed757c service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:11.642051 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047c4a9-a218-472b-9111-cf78c6ed757c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:11.652422 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047c4a9-a218-472b-9111-cf78c6ed757c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:11.653843 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047c4a9-a218-472b-9111-cf78c6ed757c service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:11.666329 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 998/1970] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:12.002223 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9ff81-d6b3-482c-8bb6-d863c52b6a30 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:12.002223 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-ebe9ff81-d6b3-482c-8bb6-d863c52b6a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:12.017198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe9ff81-d6b3-482c-8bb6-d863c52b6a30 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:12.024565 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d7b0b-e472-45cd-81d9-24096c79cc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:12.025602 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d7b0b-e472-45cd-81d9-24096c79cc20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:12.025979 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d7b0b-e472-45cd-81d9-24096c79cc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:12.026377 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d7b0b-e472-45cd-81d9-24096c79cc20 admin admin] PATH_INFO: `/v3/projects/277752fcfb1645979f179b5f8017a5d9` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:12.028481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d7b0b-e472-45cd-81d9-24096c79cc20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=277752fcfb1645979f179b5f8017a5d9)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:12.030673 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d7b0b-e472-45cd-81d9-24096c79cc20 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:12.094168 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-880d7b0b-e472-45cd-81d9-24096c79cc20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '277752fcfb1645979f179b5f8017a5d9', 'request_id': 'req-880d7b0b-e472-45cd-81d9-24096c79cc20'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:12.103399 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-880d7b0b-e472-45cd-81d9-24096c79cc20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '277752fcfb1645979f179b5f8017a5d9', 'request_id': 'req-880d7b0b-e472-45cd-81d9-24096c79cc20'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:12.112533 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-880d7b0b-e472-45cd-81d9-24096c79cc20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '277752fcfb1645979f179b5f8017a5d9', 'request_id': 'req-880d7b0b-e472-45cd-81d9-24096c79cc20'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:12.124711 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-880d7b0b-e472-45cd-81d9-24096c79cc20 admin admin] The token cache is being invalidate because project 277752fcfb1645979f179b5f8017a5d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:12.125021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-880d7b0b-e472-45cd-81d9-24096c79cc20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:12.125667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-880d7b0b-e472-45cd-81d9-24096c79cc20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:12.127368 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 973/1971] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:11 2022] DELETE /identity/v3/projects/277752fcfb1645979f179b5f8017a5d9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:52:12.134295 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c42580-97ba-4aea-a066-a94a067e2629 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:12.134712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c42580-97ba-4aea-a066-a94a067e2629 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:12.135945 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c42580-97ba-4aea-a066-a94a067e2629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:12.159919 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-74c42580-97ba-4aea-a066-a94a067e2629 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:12.161354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-74c42580-97ba-4aea-a066-a94a067e2629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:12.219549 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:12.264421 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 999/1972] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:12.276690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039e3d1-8a47-4ffc-b96f-962ffb699822 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:12.277150 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039e3d1-8a47-4ffc-b96f-962ffb699822 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:12.278136 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039e3d1-8a47-4ffc-b96f-962ffb699822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:12.333740 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-8039e3d1-8a47-4ffc-b96f-962ffb699822 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:12.335056 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-8039e3d1-8a47-4ffc-b96f-962ffb699822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:12.358976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 974/1973] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:12.360529 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c42580-97ba-4aea-a066-a94a067e2629 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:12.372383 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c42580-97ba-4aea-a066-a94a067e2629 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:12.392318 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323753d-1a9e-4225-b881-434d8e4fb384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:12.393005 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323753d-1a9e-4225-b881-434d8e4fb384 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:12.393289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323753d-1a9e-4225-b881-434d8e4fb384 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:12.393572 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323753d-1a9e-4225-b881-434d8e4fb384 admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:12.394493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323753d-1a9e-4225-b881-434d8e4fb384 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:52:12.394785 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323753d-1a9e-4225-b881-434d8e4fb384 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:12.396429 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323753d-1a9e-4225-b881-434d8e4fb384 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:12.425997 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039e3d1-8a47-4ffc-b96f-962ffb699822 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:12.426244 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1000/1974] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:52:12.439764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039e3d1-8a47-4ffc-b96f-962ffb699822 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:12.447782 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acff7d2-776c-4567-a6fa-4d73fe513611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:12.448600 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acff7d2-776c-4567-a6fa-4d73fe513611 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:12.449131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acff7d2-776c-4567-a6fa-4d73fe513611 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:12.450386 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acff7d2-776c-4567-a6fa-4d73fe513611 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:12.452173 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acff7d2-776c-4567-a6fa-4d73fe513611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:12.455535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acff7d2-776c-4567-a6fa-4d73fe513611 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:12.495318 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 975/1975] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:52:12 2022] POST /identity/v3/projects => generated 375 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:52:12.499992 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323753d-1a9e-4225-b881-434d8e4fb384 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:12.511424 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323753d-1a9e-4225-b881-434d8e4fb384 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:12.578195 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1bfff-8060-4c70-8393-5ba6e4f82895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:12.580656 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1bfff-8060-4c70-8393-5ba6e4f82895 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:12.580656 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1bfff-8060-4c70-8393-5ba6e4f82895 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:12.581314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1bfff-8060-4c70-8393-5ba6e4f82895 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:12.583175 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1bfff-8060-4c70-8393-5ba6e4f82895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:12.585635 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1bfff-8060-4c70-8393-5ba6e4f82895 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:12.608246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1001/1976] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:52:12 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:12.612445 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acff7d2-776c-4567-a6fa-4d73fe513611 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:12.623709 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acff7d2-776c-4567-a6fa-4d73fe513611 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:12.628348 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896f290-8ebc-4749-baa6-d46a045bc314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:12.629242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896f290-8ebc-4749-baa6-d46a045bc314 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:12.629530 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896f290-8ebc-4749-baa6-d46a045bc314 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:12.630396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896f290-8ebc-4749-baa6-d46a045bc314 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:12.631273 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896f290-8ebc-4749-baa6-d46a045bc314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:12.632874 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2896f290-8ebc-4749-baa6-d46a045bc314 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:12.644993 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 976/1977] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:12.649365 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1bfff-8060-4c70-8393-5ba6e4f82895 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:12.662182 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1bfff-8060-4c70-8393-5ba6e4f82895 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:12.668763 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e50cb-8f50-4474-8dac-e8a18e1b2902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:12.669433 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e50cb-8f50-4474-8dac-e8a18e1b2902 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:12.669724 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e50cb-8f50-4474-8dac-e8a18e1b2902 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:12.670033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e50cb-8f50-4474-8dac-e8a18e1b2902 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:12.670929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e50cb-8f50-4474-8dac-e8a18e1b2902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:12.672851 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e50cb-8f50-4474-8dac-e8a18e1b2902 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:12.685184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1002/1978] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:12.689157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896f290-8ebc-4749-baa6-d46a045bc314 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:12.701260 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896f290-8ebc-4749-baa6-d46a045bc314 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:12.706711 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25d4f5-eef5-4030-a81b-99370e88d921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:12.707698 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25d4f5-eef5-4030-a81b-99370e88d921 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:12.708284 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25d4f5-eef5-4030-a81b-99370e88d921 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:12.708478 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25d4f5-eef5-4030-a81b-99370e88d921 admin admin] PATH_INFO: `/v3/projects/bc717605ce704eca827a34dc2b116103/users/8d37a3b47bba4377a06e13918e2fbae6/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:12.725999 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25d4f5-eef5-4030-a81b-99370e88d921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc717605ce704eca827a34dc2b116103, user_id=8d37a3b47bba4377a06e13918e2fbae6, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:12.729046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25d4f5-eef5-4030-a81b-99370e88d921 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:12.750601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 977/1979] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:12 2022] PUT /identity/v3/projects/bc717605ce704eca827a34dc2b116103/users/8d37a3b47bba4377a06e13918e2fbae6/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:52:12.761659 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28928624-c77a-45c7-abd3-e91b54dc83e7 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:12.762068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28928624-c77a-45c7-abd3-e91b54dc83e7 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:12.762419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28928624-c77a-45c7-abd3-e91b54dc83e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:12.806755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-28928624-c77a-45c7-abd3-e91b54dc83e7 None None] MFA Rules not processed for user `8d37a3b47bba4377a06e13918e2fbae6`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:12.809008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-28928624-c77a-45c7-abd3-e91b54dc83e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:12.932770 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1003/1980] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:12.937945 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25d4f5-eef5-4030-a81b-99370e88d921 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:13.044437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25d4f5-eef5-4030-a81b-99370e88d921 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:13.051073 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e4cb1-6aba-4b4c-a91a-8941d9ba1ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:13.051773 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e4cb1-6aba-4b4c-a91a-8941d9ba1ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:13.052059 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e4cb1-6aba-4b4c-a91a-8941d9ba1ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:13.052342 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e4cb1-6aba-4b4c-a91a-8941d9ba1ff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:13.053046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e4cb1-6aba-4b4c-a91a-8941d9ba1ff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:13.055264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e4cb1-6aba-4b4c-a91a-8941d9ba1ff6 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:13.074555 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:13.107300 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 978/1981] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:52:12 2022] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:13.107493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28928624-c77a-45c7-abd3-e91b54dc83e7 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:13.132430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28928624-c77a-45c7-abd3-e91b54dc83e7 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:13.173788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:13.223142 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c04146-56a6-4125-abe0-a4892de4ea16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:13.224418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c04146-56a6-4125-abe0-a4892de4ea16 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:13.224959 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c04146-56a6-4125-abe0-a4892de4ea16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:13.225249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c04146-56a6-4125-abe0-a4892de4ea16 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:13.225999 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c04146-56a6-4125-abe0-a4892de4ea16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:13.228220 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c04146-56a6-4125-abe0-a4892de4ea16 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:13.253778 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1004/1982] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:52:13 2022] POST /identity/v3/users => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:52:13.259222 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e4cb1-6aba-4b4c-a91a-8941d9ba1ff6 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:13.275973 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e4cb1-6aba-4b4c-a91a-8941d9ba1ff6 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:13.284072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a581c3-7013-414a-80f8-56c412f7c7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:13.285764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a581c3-7013-414a-80f8-56c412f7c7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:13.286781 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a581c3-7013-414a-80f8-56c412f7c7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:13.287167 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a581c3-7013-414a-80f8-56c412f7c7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:13.288148 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a581c3-7013-414a-80f8-56c412f7c7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:13.290313 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a581c3-7013-414a-80f8-56c412f7c7c3 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:13.314641 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 979/1983] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:13.320851 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c04146-56a6-4125-abe0-a4892de4ea16 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:13.333699 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c04146-56a6-4125-abe0-a4892de4ea16 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:13.339924 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6100ff8-0081-4d00-93c7-f85b2b2aa441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:13.340620 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6100ff8-0081-4d00-93c7-f85b2b2aa441 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:13.341462 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6100ff8-0081-4d00-93c7-f85b2b2aa441 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:13.341462 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6100ff8-0081-4d00-93c7-f85b2b2aa441 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:13.342093 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6100ff8-0081-4d00-93c7-f85b2b2aa441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:13.343701 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6100ff8-0081-4d00-93c7-f85b2b2aa441 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:13.357975 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1005/1984] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:13.359610 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a581c3-7013-414a-80f8-56c412f7c7c3 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:13.373534 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a581c3-7013-414a-80f8-56c412f7c7c3 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:13.380774 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c728a-23c4-4ec7-ac61-cf6e61d0f1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:13.383922 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c728a-23c4-4ec7-ac61-cf6e61d0f1dc admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:13.384227 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c728a-23c4-4ec7-ac61-cf6e61d0f1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:13.384515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c728a-23c4-4ec7-ac61-cf6e61d0f1dc admin admin] PATH_INFO: `/v3/projects/7a753cb96bb5492eb288fa39a1615d83/users/342ad6989d1e44b890e4873895467551/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:13.424401 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c728a-23c4-4ec7-ac61-cf6e61d0f1dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a753cb96bb5492eb288fa39a1615d83, user_id=342ad6989d1e44b890e4873895467551, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:13.427282 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c728a-23c4-4ec7-ac61-cf6e61d0f1dc admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:13.453022 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 980/1985] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:13 2022] PUT /identity/v3/projects/7a753cb96bb5492eb288fa39a1615d83/users/342ad6989d1e44b890e4873895467551/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:13.464476 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6cc3a-0c07-45b0-b800-8e221fcc28d6 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:13.464774 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6cc3a-0c07-45b0-b800-8e221fcc28d6 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:13.465066 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6cc3a-0c07-45b0-b800-8e221fcc28d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:13.556643 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-5cb6cc3a-0c07-45b0-b800-8e221fcc28d6 None None] MFA Rules not processed for user `342ad6989d1e44b890e4873895467551`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:13.559804 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5cb6cc3a-0c07-45b0-b800-8e221fcc28d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:13.677062 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c728a-23c4-4ec7-ac61-cf6e61d0f1dc admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:13.685139 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-8d9c728a-23c4-4ec7-ac61-cf6e61d0f1dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:13.745914 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1006/1986] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:13.750008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6cc3a-0c07-45b0-b800-8e221fcc28d6 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:13.825151 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c728a-23c4-4ec7-ac61-cf6e61d0f1dc admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:13.834800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c986f-f684-4dcd-a2b5-0763421f5957 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:13.835426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c986f-f684-4dcd-a2b5-0763421f5957 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:13.835718 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c986f-f684-4dcd-a2b5-0763421f5957 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:13.836000 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c986f-f684-4dcd-a2b5-0763421f5957 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:13.840698 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-3f0c986f-f684-4dcd-a2b5-0763421f5957 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:13.893330 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6cc3a-0c07-45b0-b800-8e221fcc28d6 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:13.907708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290090f3-dc85-4bf6-85e5-2eb68973743b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:13.908399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290090f3-dc85-4bf6-85e5-2eb68973743b admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:13.908687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290090f3-dc85-4bf6-85e5-2eb68973743b admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:13.909870 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290090f3-dc85-4bf6-85e5-2eb68973743b admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:13.910836 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290090f3-dc85-4bf6-85e5-2eb68973743b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:13.919959 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290090f3-dc85-4bf6-85e5-2eb68973743b admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:13.979687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1007/1987] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:52:13 2022] POST /identity/v3/projects => generated 377 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:13.984080 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290090f3-dc85-4bf6-85e5-2eb68973743b admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:13.994168 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c986f-f684-4dcd-a2b5-0763421f5957 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:13.995710 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c986f-f684-4dcd-a2b5-0763421f5957 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:14.018942 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 981/1988] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:14.024982 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:14.100427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290090f3-dc85-4bf6-85e5-2eb68973743b admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:14.111892 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac74a1-c126-425e-8798-e4180efea44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:14.112219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac74a1-c126-425e-8798-e4180efea44d admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:14.112656 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac74a1-c126-425e-8798-e4180efea44d admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:14.112941 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac74a1-c126-425e-8798-e4180efea44d admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:14.113665 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac74a1-c126-425e-8798-e4180efea44d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:14.118503 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac74a1-c126-425e-8798-e4180efea44d admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:14.161689 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c986f-f684-4dcd-a2b5-0763421f5957 service cinder] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:14.161964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1008/1989] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:52:13 2022] POST /identity/v3/users => generated 295 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:14.176412 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c986f-f684-4dcd-a2b5-0763421f5957 service cinder] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:14.184146 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb521c-c86e-44e4-9c26-5de50d45b872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:14.185123 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb521c-c86e-44e4-9c26-5de50d45b872 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:14.185420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb521c-c86e-44e4-9c26-5de50d45b872 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:14.185737 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb521c-c86e-44e4-9c26-5de50d45b872 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:14.186580 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb521c-c86e-44e4-9c26-5de50d45b872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:14.189308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bb521c-c86e-44e4-9c26-5de50d45b872 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:14.208813 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 982/1990] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 15:52:14.210382 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac74a1-c126-425e-8798-e4180efea44d admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:14.233313 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac74a1-c126-425e-8798-e4180efea44d admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:14.242182 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753170d9-6364-490c-a391-36c024c9cf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:14.243296 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753170d9-6364-490c-a391-36c024c9cf47 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:14.243676 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753170d9-6364-490c-a391-36c024c9cf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:14.245771 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753170d9-6364-490c-a391-36c024c9cf47 admin admin] PATH_INFO: `/v3/projects/40a53e0d764846eaaea4bc1e38072368/users/b615b2ef1dd04daa9380980516c751b7/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:14.273812 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753170d9-6364-490c-a391-36c024c9cf47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40a53e0d764846eaaea4bc1e38072368, user_id=b615b2ef1dd04daa9380980516c751b7, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:14.277829 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753170d9-6364-490c-a391-36c024c9cf47 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:14.308371 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1009/1991] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:14 2022] PUT /identity/v3/projects/40a53e0d764846eaaea4bc1e38072368/users/b615b2ef1dd04daa9380980516c751b7/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:14.309816 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb521c-c86e-44e4-9c26-5de50d45b872 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:14.323170 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb521c-c86e-44e4-9c26-5de50d45b872 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:14.411339 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3d38f-34f7-4ffe-827b-2b4a99096842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:14.412977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3d38f-34f7-4ffe-827b-2b4a99096842 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:14.413510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3d38f-34f7-4ffe-827b-2b4a99096842 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:14.413798 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3d38f-34f7-4ffe-827b-2b4a99096842 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:14.414624 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3d38f-34f7-4ffe-827b-2b4a99096842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:14.419958 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3d38f-34f7-4ffe-827b-2b4a99096842 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:14.424340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:14.441967 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 983/1992] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:14.444025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753170d9-6364-490c-a391-36c024c9cf47 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:14.461401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753170d9-6364-490c-a391-36c024c9cf47 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:14.466397 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dcc06-ff77-4371-80d4-efe19df7d951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:14.467301 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dcc06-ff77-4371-80d4-efe19df7d951 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:14.467585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dcc06-ff77-4371-80d4-efe19df7d951 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:14.467863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237dcc06-ff77-4371-80d4-efe19df7d951 admin admin] PATH_INFO: `/v3/projects/40a53e0d764846eaaea4bc1e38072368/users/b615b2ef1dd04daa9380980516c751b7/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:14.470679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237dcc06-ff77-4371-80d4-efe19df7d951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40a53e0d764846eaaea4bc1e38072368, user_id=b615b2ef1dd04daa9380980516c751b7, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:14.473023 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237dcc06-ff77-4371-80d4-efe19df7d951 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:14.485572 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1010/1993] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:14 2022] PUT /identity/v3/projects/40a53e0d764846eaaea4bc1e38072368/users/b615b2ef1dd04daa9380980516c751b7/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:14.500781 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e7bf0-63b1-4349-94a2-4aa550d48d77 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:14.501415 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e7bf0-63b1-4349-94a2-4aa550d48d77 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:14.501415 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e7bf0-63b1-4349-94a2-4aa550d48d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:14.530791 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-f08e7bf0-63b1-4349-94a2-4aa550d48d77 None None] MFA Rules not processed for user `b615b2ef1dd04daa9380980516c751b7`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:14.532327 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-f08e7bf0-63b1-4349-94a2-4aa550d48d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:14.617495 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 984/1994] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:14.628934 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dcc06-ff77-4371-80d4-efe19df7d951 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:14.630992 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-237dcc06-ff77-4371-80d4-efe19df7d951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:14.693354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237dcc06-ff77-4371-80d4-efe19df7d951 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:14.697535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738938cf-af79-46be-b03f-2705feece26a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:14.698418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738938cf-af79-46be-b03f-2705feece26a service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:14.698806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738938cf-af79-46be-b03f-2705feece26a service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:14.699374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738938cf-af79-46be-b03f-2705feece26a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:14.772854 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738938cf-af79-46be-b03f-2705feece26a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:14.774760 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738938cf-af79-46be-b03f-2705feece26a service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:14.799019 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1011/1995] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:16.552901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e7bf0-63b1-4349-94a2-4aa550d48d77 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:16.569945 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e7bf0-63b1-4349-94a2-4aa550d48d77 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:16.573561 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f270db0-be1e-48f2-a238-ef588ac757f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:16.574303 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f270db0-be1e-48f2-a238-ef588ac757f3 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:16.574589 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f270db0-be1e-48f2-a238-ef588ac757f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:16.574870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f270db0-be1e-48f2-a238-ef588ac757f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:16.643820 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f270db0-be1e-48f2-a238-ef588ac757f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:16.645780 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f270db0-be1e-48f2-a238-ef588ac757f3 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:16.657072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 985/1996] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:17.027621 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738938cf-af79-46be-b03f-2705feece26a service cinder] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:17.029249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-738938cf-af79-46be-b03f-2705feece26a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:17.076870 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:17.139354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738938cf-af79-46be-b03f-2705feece26a service cinder] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:17.148078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b194ba-d6ae-4098-ab0c-c22f003a83c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:17.149175 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b194ba-d6ae-4098-ab0c-c22f003a83c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:17.149459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b194ba-d6ae-4098-ab0c-c22f003a83c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:17.149740 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b194ba-d6ae-4098-ab0c-c22f003a83c0 admin admin] PATH_INFO: `/v3/users/bc1095f472e9449c9a991c73b6c6e2d7` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:17.152643 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b194ba-d6ae-4098-ab0c-c22f003a83c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc1095f472e9449c9a991c73b6c6e2d7)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:17.154633 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b194ba-d6ae-4098-ab0c-c22f003a83c0 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:17.204673 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-51b194ba-d6ae-4098-ab0c-c22f003a83c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc1095f472e9449c9a991c73b6c6e2d7'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:17.216225 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-51b194ba-d6ae-4098-ab0c-c22f003a83c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc1095f472e9449c9a991c73b6c6e2d7'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:17.217042 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-51b194ba-d6ae-4098-ab0c-c22f003a83c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc1095f472e9449c9a991c73b6c6e2d7'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:17.217818 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-51b194ba-d6ae-4098-ab0c-c22f003a83c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc1095f472e9449c9a991c73b6c6e2d7'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:17.237099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-51b194ba-d6ae-4098-ab0c-c22f003a83c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc1095f472e9449c9a991c73b6c6e2d7'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:17.255778 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1012/1997] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:52:17 2022] DELETE /identity/v3/users/bc1095f472e9449c9a991c73b6c6e2d7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:17.272212 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c07e4-4d62-48f8-b27f-d1d1e7d0cc8b None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:17.272476 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c07e4-4d62-48f8-b27f-d1d1e7d0cc8b None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:17.272813 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c07e4-4d62-48f8-b27f-d1d1e7d0cc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:17.296929 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-b98c07e4-4d62-48f8-b27f-d1d1e7d0cc8b None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:17.298326 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-b98c07e4-4d62-48f8-b27f-d1d1e7d0cc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:17.370643 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 986/1998] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:17.382238 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b194ba-d6ae-4098-ab0c-c22f003a83c0 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:17.383768 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-51b194ba-d6ae-4098-ab0c-c22f003a83c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:17.448889 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c07e4-4d62-48f8-b27f-d1d1e7d0cc8b None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:17.450399 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-b98c07e4-4d62-48f8-b27f-d1d1e7d0cc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:17.460974 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b194ba-d6ae-4098-ab0c-c22f003a83c0 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:17.464861 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ca7f6-661a-4c48-87ae-d19a685e91ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:17.465515 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ca7f6-661a-4c48-87ae-d19a685e91ab service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:17.465808 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ca7f6-661a-4c48-87ae-d19a685e91ab service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:17.466127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ca7f6-661a-4c48-87ae-d19a685e91ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:17.476235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ca7f6-661a-4c48-87ae-d19a685e91ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:17.477712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ca7f6-661a-4c48-87ae-d19a685e91ab service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:17.481112 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:17.489908 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1013/1999] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:17.518460 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c07e4-4d62-48f8-b27f-d1d1e7d0cc8b None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:17.522330 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e8115-5a3b-4a20-b6fe-489a6ccfed32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:17.523187 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e8115-5a3b-4a20-b6fe-489a6ccfed32 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:17.523569 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e8115-5a3b-4a20-b6fe-489a6ccfed32 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:17.523950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e8115-5a3b-4a20-b6fe-489a6ccfed32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:17.525886 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-2c1e8115-5a3b-4a20-b6fe-489a6ccfed32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:17.599368 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e8115-5a3b-4a20-b6fe-489a6ccfed32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:17.600819 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e8115-5a3b-4a20-b6fe-489a6ccfed32 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:17.611457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 987/2000] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:52:17.779007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ca7f6-661a-4c48-87ae-d19a685e91ab service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:17.781050 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-6e0ca7f6-661a-4c48-87ae-d19a685e91ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:17.813777 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ca7f6-661a-4c48-87ae-d19a685e91ab service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:17.855621 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822b264-291d-46d4-b762-96ff69501b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:17.856803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822b264-291d-46d4-b762-96ff69501b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:17.857094 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822b264-291d-46d4-b762-96ff69501b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:17.857499 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822b264-291d-46d4-b762-96ff69501b27 admin admin] PATH_INFO: `/v3/projects/92edc615a2524450a816820ac8fbf690` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:17.858894 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1822b264-291d-46d4-b762-96ff69501b27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92edc615a2524450a816820ac8fbf690)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:17.861291 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1822b264-291d-46d4-b762-96ff69501b27 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:17.915121 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:17.925246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1822b264-291d-46d4-b762-96ff69501b27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92edc615a2524450a816820ac8fbf690', 'request_id': 'req-1822b264-291d-46d4-b762-96ff69501b27'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:17.936153 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1822b264-291d-46d4-b762-96ff69501b27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92edc615a2524450a816820ac8fbf690', 'request_id': 'req-1822b264-291d-46d4-b762-96ff69501b27'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:17.944669 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1822b264-291d-46d4-b762-96ff69501b27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92edc615a2524450a816820ac8fbf690', 'request_id': 'req-1822b264-291d-46d4-b762-96ff69501b27'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:17.956914 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1822b264-291d-46d4-b762-96ff69501b27 admin admin] The token cache is being invalidate because project 92edc615a2524450a816820ac8fbf690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:17.957463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1822b264-291d-46d4-b762-96ff69501b27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:17.958385 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1822b264-291d-46d4-b762-96ff69501b27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:17.959962 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1014/2001] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:17 2022] DELETE /identity/v3/projects/92edc615a2524450a816820ac8fbf690 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:52:17.964871 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e8115-5a3b-4a20-b6fe-489a6ccfed32 service cinder] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:17.976606 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e8115-5a3b-4a20-b6fe-489a6ccfed32 service cinder] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:18.050141 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b0e71-58b7-4433-9183-7a86df3e069c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:18.051024 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b0e71-58b7-4433-9183-7a86df3e069c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:18.051307 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b0e71-58b7-4433-9183-7a86df3e069c admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:18.052145 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b0e71-58b7-4433-9183-7a86df3e069c admin admin] PATH_INFO: `/v3/users/bcbb62cbb71847088bde99c6405a42f4` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:18.053390 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b0e71-58b7-4433-9183-7a86df3e069c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcbb62cbb71847088bde99c6405a42f4)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:18.055495 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b0e71-58b7-4433-9183-7a86df3e069c admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:18.113368 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-9f5b0e71-58b7-4433-9183-7a86df3e069c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcbb62cbb71847088bde99c6405a42f4'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:18.121872 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-9f5b0e71-58b7-4433-9183-7a86df3e069c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcbb62cbb71847088bde99c6405a42f4'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:18.122603 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-9f5b0e71-58b7-4433-9183-7a86df3e069c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcbb62cbb71847088bde99c6405a42f4'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:18.123216 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-9f5b0e71-58b7-4433-9183-7a86df3e069c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcbb62cbb71847088bde99c6405a42f4'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:18.148599 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-9f5b0e71-58b7-4433-9183-7a86df3e069c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcbb62cbb71847088bde99c6405a42f4'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:18.152065 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:18.191095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 988/2002] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:52:17 2022] DELETE /identity/v3/users/bcbb62cbb71847088bde99c6405a42f4 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:52:18.821194 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822b264-291d-46d4-b762-96ff69501b27 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:18.826432 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-1822b264-291d-46d4-b762-96ff69501b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:18.845063 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822b264-291d-46d4-b762-96ff69501b27 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:18.966820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9896d1a-03e2-4bf8-8a6d-9e9597c285fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:18.968118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9896d1a-03e2-4bf8-8a6d-9e9597c285fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:18.968674 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9896d1a-03e2-4bf8-8a6d-9e9597c285fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:18.969035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9896d1a-03e2-4bf8-8a6d-9e9597c285fa admin admin] PATH_INFO: `/v3/projects/fcb4849bb2474b889b7a40a964a46ce7` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:18.970859 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9896d1a-03e2-4bf8-8a6d-9e9597c285fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcb4849bb2474b889b7a40a964a46ce7)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:18.972969 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9896d1a-03e2-4bf8-8a6d-9e9597c285fa admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:19.074687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-c9896d1a-03e2-4bf8-8a6d-9e9597c285fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcb4849bb2474b889b7a40a964a46ce7', 'request_id': 'req-c9896d1a-03e2-4bf8-8a6d-9e9597c285fa'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:19.083640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-c9896d1a-03e2-4bf8-8a6d-9e9597c285fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcb4849bb2474b889b7a40a964a46ce7', 'request_id': 'req-c9896d1a-03e2-4bf8-8a6d-9e9597c285fa'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:19.116120 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-c9896d1a-03e2-4bf8-8a6d-9e9597c285fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcb4849bb2474b889b7a40a964a46ce7', 'request_id': 'req-c9896d1a-03e2-4bf8-8a6d-9e9597c285fa'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:19.133304 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-c9896d1a-03e2-4bf8-8a6d-9e9597c285fa admin admin] The token cache is being invalidate because project fcb4849bb2474b889b7a40a964a46ce7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:19.133600 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-c9896d1a-03e2-4bf8-8a6d-9e9597c285fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:19.134479 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-c9896d1a-03e2-4bf8-8a6d-9e9597c285fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:19.137351 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1015/2003] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:18 2022] DELETE /identity/v3/projects/fcb4849bb2474b889b7a40a964a46ce7 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:19.142160 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b0e71-58b7-4433-9183-7a86df3e069c admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:19.144176 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-9f5b0e71-58b7-4433-9183-7a86df3e069c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:19.159262 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b0e71-58b7-4433-9183-7a86df3e069c admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:19.264162 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361add2-c01c-4a52-ad24-ceec80c1bfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:19.265564 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361add2-c01c-4a52-ad24-ceec80c1bfad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:19.266107 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361add2-c01c-4a52-ad24-ceec80c1bfad admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:19.266678 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361add2-c01c-4a52-ad24-ceec80c1bfad admin admin] PATH_INFO: `/v3/users/aad7cdd61fec49019ee6085d35ffd704` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:19.268276 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361add2-c01c-4a52-ad24-ceec80c1bfad admin admin] RBAC: Authorizing `identity:delete_user(user_id=aad7cdd61fec49019ee6085d35ffd704)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:19.271429 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361add2-c01c-4a52-ad24-ceec80c1bfad admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:19.343255 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-6361add2-c01c-4a52-ad24-ceec80c1bfad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aad7cdd61fec49019ee6085d35ffd704'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:19.358766 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-6361add2-c01c-4a52-ad24-ceec80c1bfad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aad7cdd61fec49019ee6085d35ffd704'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:19.360096 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-6361add2-c01c-4a52-ad24-ceec80c1bfad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aad7cdd61fec49019ee6085d35ffd704'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:19.360704 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-6361add2-c01c-4a52-ad24-ceec80c1bfad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aad7cdd61fec49019ee6085d35ffd704'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:19.386147 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-6361add2-c01c-4a52-ad24-ceec80c1bfad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aad7cdd61fec49019ee6085d35ffd704'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:19.406254 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 989/2004] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:52:19 2022] DELETE /identity/v3/users/aad7cdd61fec49019ee6085d35ffd704 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:20.474436 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9896d1a-03e2-4bf8-8a6d-9e9597c285fa admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:20.475944 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-c9896d1a-03e2-4bf8-8a6d-9e9597c285fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:20.490835 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9896d1a-03e2-4bf8-8a6d-9e9597c285fa admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:20.609076 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6ebc95-d01a-4863-92a5-9f22b92d9273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:20.610340 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ebc95-d01a-4863-92a5-9f22b92d9273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:20.610713 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ebc95-d01a-4863-92a5-9f22b92d9273 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:20.611281 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ebc95-d01a-4863-92a5-9f22b92d9273 admin admin] PATH_INFO: `/v3/projects/3df9923b8962401bb99182ee4fb250ed` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:20.612900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ebc95-d01a-4863-92a5-9f22b92d9273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3df9923b8962401bb99182ee4fb250ed)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:20.616278 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6ebc95-d01a-4863-92a5-9f22b92d9273 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:20.618595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:20.722717 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-5e6ebc95-d01a-4863-92a5-9f22b92d9273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3df9923b8962401bb99182ee4fb250ed', 'request_id': 'req-5e6ebc95-d01a-4863-92a5-9f22b92d9273'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:20.732469 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-5e6ebc95-d01a-4863-92a5-9f22b92d9273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3df9923b8962401bb99182ee4fb250ed', 'request_id': 'req-5e6ebc95-d01a-4863-92a5-9f22b92d9273'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:20.745258 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-5e6ebc95-d01a-4863-92a5-9f22b92d9273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3df9923b8962401bb99182ee4fb250ed', 'request_id': 'req-5e6ebc95-d01a-4863-92a5-9f22b92d9273'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:20.762196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-5e6ebc95-d01a-4863-92a5-9f22b92d9273 admin admin] The token cache is being invalidate because project 3df9923b8962401bb99182ee4fb250ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:20.762196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-5e6ebc95-d01a-4863-92a5-9f22b92d9273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:20.762646 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-5e6ebc95-d01a-4863-92a5-9f22b92d9273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:20.765959 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1016/2005] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:20 2022] DELETE /identity/v3/projects/3df9923b8962401bb99182ee4fb250ed => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:20.771932 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f169f-3f4b-44e4-9712-80b276278b8e None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:20.772931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f169f-3f4b-44e4-9712-80b276278b8e None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:20.773454 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f169f-3f4b-44e4-9712-80b276278b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:20.816411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-327f169f-3f4b-44e4-9712-80b276278b8e None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:20.818044 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-327f169f-3f4b-44e4-9712-80b276278b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:20.893525 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 990/2006] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:52:20.902663 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0eb681-afe9-41fc-abea-a0e8cd821b38 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:20.902945 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0eb681-afe9-41fc-abea-a0e8cd821b38 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:20.903300 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0eb681-afe9-41fc-abea-a0e8cd821b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:20.922283 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-7d0eb681-afe9-41fc-abea-a0e8cd821b38 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:20.923614 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-7d0eb681-afe9-41fc-abea-a0e8cd821b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:20.932049 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1017/2007] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:52:20.936793 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f169f-3f4b-44e4-9712-80b276278b8e None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:20.947801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f169f-3f4b-44e4-9712-80b276278b8e None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:20.952715 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6b0ac-1b1e-456e-8255-55a1d38685f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:20.953393 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6b0ac-1b1e-456e-8255-55a1d38685f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:20.953681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6b0ac-1b1e-456e-8255-55a1d38685f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:20.953994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6b0ac-1b1e-456e-8255-55a1d38685f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:20.954733 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6b0ac-1b1e-456e-8255-55a1d38685f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:52:20.955049 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6b0ac-1b1e-456e-8255-55a1d38685f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:20.956734 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6b0ac-1b1e-456e-8255-55a1d38685f7 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:20.965058 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:20.971982 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 991/2008] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:52:20.976910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0eb681-afe9-41fc-abea-a0e8cd821b38 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:20.989275 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0eb681-afe9-41fc-abea-a0e8cd821b38 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:20.994283 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d66574-5a90-42ad-a840-e32e53bea8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:20.994961 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d66574-5a90-42ad-a840-e32e53bea8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:20.995250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d66574-5a90-42ad-a840-e32e53bea8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:20.995553 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d66574-5a90-42ad-a840-e32e53bea8a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:20.996399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d66574-5a90-42ad-a840-e32e53bea8a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:20.998390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d66574-5a90-42ad-a840-e32e53bea8a0 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:21.032323 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1018/2009] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:52:20 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:21.036849 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6b0ac-1b1e-456e-8255-55a1d38685f7 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:21.051102 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6b0ac-1b1e-456e-8255-55a1d38685f7 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:21.125609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553891da-6970-4da6-b549-99ffb1cdb141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:21.126312 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553891da-6970-4da6-b549-99ffb1cdb141 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:21.126594 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553891da-6970-4da6-b549-99ffb1cdb141 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:21.126870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553891da-6970-4da6-b549-99ffb1cdb141 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:21.127574 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553891da-6970-4da6-b549-99ffb1cdb141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:21.130055 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553891da-6970-4da6-b549-99ffb1cdb141 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:21.155196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 992/2010] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:52:21 2022] POST /identity/v3/users => generated 291 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:21.159836 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d66574-5a90-42ad-a840-e32e53bea8a0 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:21.172462 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d66574-5a90-42ad-a840-e32e53bea8a0 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:21.178455 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65654949-3d0f-4c13-bcb2-ff6db7c3baec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:21.179472 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65654949-3d0f-4c13-bcb2-ff6db7c3baec admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:21.179910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65654949-3d0f-4c13-bcb2-ff6db7c3baec admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:21.180338 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65654949-3d0f-4c13-bcb2-ff6db7c3baec admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:21.181516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65654949-3d0f-4c13-bcb2-ff6db7c3baec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:21.183974 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65654949-3d0f-4c13-bcb2-ff6db7c3baec admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:21.202590 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1019/2011] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:21.206669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553891da-6970-4da6-b549-99ffb1cdb141 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:21.218369 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553891da-6970-4da6-b549-99ffb1cdb141 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:21.223059 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd58a6-982d-4f8a-8c6b-b3aa0c85e56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:21.223769 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd58a6-982d-4f8a-8c6b-b3aa0c85e56c admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:21.224055 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd58a6-982d-4f8a-8c6b-b3aa0c85e56c admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:21.224331 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd58a6-982d-4f8a-8c6b-b3aa0c85e56c admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:21.225066 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd58a6-982d-4f8a-8c6b-b3aa0c85e56c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:21.226698 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd58a6-982d-4f8a-8c6b-b3aa0c85e56c admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:21.247260 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65654949-3d0f-4c13-bcb2-ff6db7c3baec admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:21.248033 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 993/2012] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 15:52:21.259253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65654949-3d0f-4c13-bcb2-ff6db7c3baec admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:21.264454 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069fb55-effd-4ecb-b769-5ea65f480a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:21.265452 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069fb55-effd-4ecb-b769-5ea65f480a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:21.265739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069fb55-effd-4ecb-b769-5ea65f480a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:21.266054 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069fb55-effd-4ecb-b769-5ea65f480a8f admin admin] PATH_INFO: `/v3/projects/b8230d3765ce4a7e92481f01fceeafab/users/87488902f1b9468ebba719b7000edc2c/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:21.282930 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069fb55-effd-4ecb-b769-5ea65f480a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8230d3765ce4a7e92481f01fceeafab, user_id=87488902f1b9468ebba719b7000edc2c, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:21.286855 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069fb55-effd-4ecb-b769-5ea65f480a8f admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:21.309944 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1020/2013] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:21 2022] PUT /identity/v3/projects/b8230d3765ce4a7e92481f01fceeafab/users/87488902f1b9468ebba719b7000edc2c/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:21.319317 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d467ff2-9eed-47c9-a90a-a18e4ada805c None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:21.319608 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d467ff2-9eed-47c9-a90a-a18e4ada805c None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:21.319894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d467ff2-9eed-47c9-a90a-a18e4ada805c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:21.352274 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-7d467ff2-9eed-47c9-a90a-a18e4ada805c None None] MFA Rules not processed for user `87488902f1b9468ebba719b7000edc2c`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:21.354487 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-7d467ff2-9eed-47c9-a90a-a18e4ada805c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:21.451681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 994/2014] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:21.456301 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069fb55-effd-4ecb-b769-5ea65f480a8f admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:21.525471 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069fb55-effd-4ecb-b769-5ea65f480a8f admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:21.530360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b86c6-a2fc-41f9-93b7-b97a51756e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:21.531041 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b86c6-a2fc-41f9-93b7-b97a51756e61 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:21.531326 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b86c6-a2fc-41f9-93b7-b97a51756e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:21.531602 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b86c6-a2fc-41f9-93b7-b97a51756e61 admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:21.532566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b86c6-a2fc-41f9-93b7-b97a51756e61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:21.534712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b86c6-a2fc-41f9-93b7-b97a51756e61 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:21.573655 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1021/2015] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:52:21 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:52:21.578018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d467ff2-9eed-47c9-a90a-a18e4ada805c None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:21.592684 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d467ff2-9eed-47c9-a90a-a18e4ada805c None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:21.661426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7bb91-12d2-4c0f-a645-a3f49c5e73c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:21.662146 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7bb91-12d2-4c0f-a645-a3f49c5e73c2 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:21.662433 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7bb91-12d2-4c0f-a645-a3f49c5e73c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:21.662719 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7bb91-12d2-4c0f-a645-a3f49c5e73c2 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:21.663418 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd7bb91-12d2-4c0f-a645-a3f49c5e73c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:21.665336 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd7bb91-12d2-4c0f-a645-a3f49c5e73c2 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:21.675996 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:21.694471 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 995/2016] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:52:21 2022] POST /identity/v3/users => generated 297 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:52:21.695372 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b86c6-a2fc-41f9-93b7-b97a51756e61 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:21.706589 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b86c6-a2fc-41f9-93b7-b97a51756e61 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:21.712711 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f6861-892f-4add-9430-31852536d6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:21.713585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f6861-892f-4add-9430-31852536d6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:21.713901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f6861-892f-4add-9430-31852536d6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:21.714189 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f6861-892f-4add-9430-31852536d6c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:21.714927 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f6861-892f-4add-9430-31852536d6c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:21.716572 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f6861-892f-4add-9430-31852536d6c8 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:21.722598 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:21.729319 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1022/2017] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 15:52:21.735321 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7bb91-12d2-4c0f-a645-a3f49c5e73c2 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:21.746247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7bb91-12d2-4c0f-a645-a3f49c5e73c2 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:21.751346 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240d295-74c1-4d6b-96f5-2c3266ce32fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:21.752265 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240d295-74c1-4d6b-96f5-2c3266ce32fa admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:21.752553 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240d295-74c1-4d6b-96f5-2c3266ce32fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:21.752832 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240d295-74c1-4d6b-96f5-2c3266ce32fa admin admin] PATH_INFO: `/v3/projects/ac2260fff5374e9bacd65c39a0e81d2a/users/1231d2d5ce254b449d98b77e0b274e7f/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:21.773973 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240d295-74c1-4d6b-96f5-2c3266ce32fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac2260fff5374e9bacd65c39a0e81d2a, user_id=1231d2d5ce254b449d98b77e0b274e7f, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:21.776844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240d295-74c1-4d6b-96f5-2c3266ce32fa admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:21.795504 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 996/2018] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:21 2022] PUT /identity/v3/projects/ac2260fff5374e9bacd65c39a0e81d2a/users/1231d2d5ce254b449d98b77e0b274e7f/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:21.800131 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f6861-892f-4add-9430-31852536d6c8 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:21.812218 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f6861-892f-4add-9430-31852536d6c8 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:21.884459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65770d37-6267-498e-b495-179fb0f49a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:21.884991 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65770d37-6267-498e-b495-179fb0f49a14 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:21.886099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65770d37-6267-498e-b495-179fb0f49a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:21.886215 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65770d37-6267-498e-b495-179fb0f49a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:21.887079 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65770d37-6267-498e-b495-179fb0f49a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:21.889232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65770d37-6267-498e-b495-179fb0f49a14 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:21.906597 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1023/2019] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:21.908014 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240d295-74c1-4d6b-96f5-2c3266ce32fa admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:21.924529 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240d295-74c1-4d6b-96f5-2c3266ce32fa admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:21.936663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788336f-3c7b-46ed-abb3-f2b5889002b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:21.937799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788336f-3c7b-46ed-abb3-f2b5889002b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:21.948098 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788336f-3c7b-46ed-abb3-f2b5889002b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:21.948465 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788336f-3c7b-46ed-abb3-f2b5889002b0 admin admin] PATH_INFO: `/v3/projects/ac2260fff5374e9bacd65c39a0e81d2a/users/1231d2d5ce254b449d98b77e0b274e7f/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:21.958958 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788336f-3c7b-46ed-abb3-f2b5889002b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac2260fff5374e9bacd65c39a0e81d2a, user_id=1231d2d5ce254b449d98b77e0b274e7f, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:21.961673 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788336f-3c7b-46ed-abb3-f2b5889002b0 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:21.972007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65770d37-6267-498e-b495-179fb0f49a14 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:21.974268 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-65770d37-6267-498e-b495-179fb0f49a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:21.976847 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 997/2020] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:21 2022] PUT /identity/v3/projects/ac2260fff5374e9bacd65c39a0e81d2a/users/1231d2d5ce254b449d98b77e0b274e7f/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:21.987044 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f66c80-59bf-4725-9f29-735edc2deb81 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:21.987421 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f66c80-59bf-4725-9f29-735edc2deb81 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:21.987787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f66c80-59bf-4725-9f29-735edc2deb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:22.002727 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65770d37-6267-498e-b495-179fb0f49a14 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:22.033098 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-91f66c80-59bf-4725-9f29-735edc2deb81 None None] MFA Rules not processed for user `1231d2d5ce254b449d98b77e0b274e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:22.035858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-91f66c80-59bf-4725-9f29-735edc2deb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:22.143550 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa642a51-f0cf-471a-a5b8-82a497f4fc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:22.146190 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa642a51-f0cf-471a-a5b8-82a497f4fc68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:22.147743 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa642a51-f0cf-471a-a5b8-82a497f4fc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:22.148132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa642a51-f0cf-471a-a5b8-82a497f4fc68 admin admin] PATH_INFO: `/v3/users/8d37a3b47bba4377a06e13918e2fbae6` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:22.149939 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa642a51-f0cf-471a-a5b8-82a497f4fc68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d37a3b47bba4377a06e13918e2fbae6)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:22.152133 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa642a51-f0cf-471a-a5b8-82a497f4fc68 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:22.183310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 998/2021] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:52:22.191197 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f66c80-59bf-4725-9f29-735edc2deb81 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:22.193349 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-91f66c80-59bf-4725-9f29-735edc2deb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:22.263933 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-aa642a51-f0cf-471a-a5b8-82a497f4fc68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d37a3b47bba4377a06e13918e2fbae6'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:22.276231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-aa642a51-f0cf-471a-a5b8-82a497f4fc68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d37a3b47bba4377a06e13918e2fbae6'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:22.280275 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-aa642a51-f0cf-471a-a5b8-82a497f4fc68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d37a3b47bba4377a06e13918e2fbae6'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:22.281123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-aa642a51-f0cf-471a-a5b8-82a497f4fc68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d37a3b47bba4377a06e13918e2fbae6'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:22.287854 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f66c80-59bf-4725-9f29-735edc2deb81 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:22.293362 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6655c-acc3-425f-9f36-6dbb448ab93c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:22.294381 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6655c-acc3-425f-9f36-6dbb448ab93c service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:22.294670 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6655c-acc3-425f-9f36-6dbb448ab93c service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:22.294954 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6655c-acc3-425f-9f36-6dbb448ab93c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:22.297097 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-ebb6655c-acc3-425f-9f36-6dbb448ab93c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:22.299491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-aa642a51-f0cf-471a-a5b8-82a497f4fc68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d37a3b47bba4377a06e13918e2fbae6'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:22.314217 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6655c-acc3-425f-9f36-6dbb448ab93c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:22.316112 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6655c-acc3-425f-9f36-6dbb448ab93c service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:22.319957 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1024/2022] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:52:21 2022] DELETE /identity/v3/users/8d37a3b47bba4377a06e13918e2fbae6 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:22.325110 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4247c09-acce-4fdd-b065-3e6c24568120 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:22.325513 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4247c09-acce-4fdd-b065-3e6c24568120 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:22.325878 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4247c09-acce-4fdd-b065-3e6c24568120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:22.330516 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 999/2023] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:22.345502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-e4247c09-acce-4fdd-b065-3e6c24568120 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:22.347055 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e4247c09-acce-4fdd-b065-3e6c24568120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:22.384585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:22.477003 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6655c-acc3-425f-9f36-6dbb448ab93c service cinder] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:22.481967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1025/2024] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:22.482322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-ebb6655c-acc3-425f-9f36-6dbb448ab93c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:22.495659 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6655c-acc3-425f-9f36-6dbb448ab93c service cinder] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:22.498675 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4247c09-acce-4fdd-b065-3e6c24568120 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:22.500386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e4247c09-acce-4fdd-b065-3e6c24568120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:22.557759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:22.576194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f00378-bd30-4ff1-bf6c-4aa5b9240115 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:22.577194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f00378-bd30-4ff1-bf6c-4aa5b9240115 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:22.577739 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f00378-bd30-4ff1-bf6c-4aa5b9240115 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:22.578407 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f00378-bd30-4ff1-bf6c-4aa5b9240115 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:22.581676 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-63f00378-bd30-4ff1-bf6c-4aa5b9240115 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:22.613659 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4247c09-acce-4fdd-b065-3e6c24568120 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:22.629023 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a987ea4-92c2-4547-88a4-a35873c4e940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:22.631043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a987ea4-92c2-4547-88a4-a35873c4e940 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:22.631338 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a987ea4-92c2-4547-88a4-a35873c4e940 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:22.631618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a987ea4-92c2-4547-88a4-a35873c4e940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:22.653933 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a987ea4-92c2-4547-88a4-a35873c4e940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:22.655721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a987ea4-92c2-4547-88a4-a35873c4e940 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:22.675358 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1026/2025] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:52:22.685407 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f00378-bd30-4ff1-bf6c-4aa5b9240115 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:22.686892 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f00378-bd30-4ff1-bf6c-4aa5b9240115 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:22.697058 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1000/2026] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:52:23.445304 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a987ea4-92c2-4547-88a4-a35873c4e940 service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:23.446990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5a987ea4-92c2-4547-88a4-a35873c4e940 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:23.472684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a987ea4-92c2-4547-88a4-a35873c4e940 service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:23.478436 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e7910-9cfd-4623-b1a3-a8b6f3caa8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:23.479389 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e7910-9cfd-4623-b1a3-a8b6f3caa8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:23.479745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e7910-9cfd-4623-b1a3-a8b6f3caa8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:23.480143 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e7910-9cfd-4623-b1a3-a8b6f3caa8f2 admin admin] PATH_INFO: `/v3/projects/bc717605ce704eca827a34dc2b116103` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:23.481543 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e7910-9cfd-4623-b1a3-a8b6f3caa8f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc717605ce704eca827a34dc2b116103)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:23.483332 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e7910-9cfd-4623-b1a3-a8b6f3caa8f2 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:23.541061 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-ed6e7910-9cfd-4623-b1a3-a8b6f3caa8f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc717605ce704eca827a34dc2b116103', 'request_id': 'req-ed6e7910-9cfd-4623-b1a3-a8b6f3caa8f2'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:23.548131 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-ed6e7910-9cfd-4623-b1a3-a8b6f3caa8f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc717605ce704eca827a34dc2b116103', 'request_id': 'req-ed6e7910-9cfd-4623-b1a3-a8b6f3caa8f2'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:23.557663 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-ed6e7910-9cfd-4623-b1a3-a8b6f3caa8f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc717605ce704eca827a34dc2b116103', 'request_id': 'req-ed6e7910-9cfd-4623-b1a3-a8b6f3caa8f2'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:23.571443 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-ed6e7910-9cfd-4623-b1a3-a8b6f3caa8f2 admin admin] The token cache is being invalidate because project bc717605ce704eca827a34dc2b116103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:23.571778 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-ed6e7910-9cfd-4623-b1a3-a8b6f3caa8f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:23.572396 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-ed6e7910-9cfd-4623-b1a3-a8b6f3caa8f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:23.573975 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1027/2027] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:23 2022] DELETE /identity/v3/projects/bc717605ce704eca827a34dc2b116103 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:23.578652 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f00378-bd30-4ff1-bf6c-4aa5b9240115 service cinder] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:23.592250 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f00378-bd30-4ff1-bf6c-4aa5b9240115 service cinder] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:23.685038 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8c6e5-93dd-4b64-8698-721f5bd546ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:23.686642 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8c6e5-93dd-4b64-8698-721f5bd546ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:23.687145 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8c6e5-93dd-4b64-8698-721f5bd546ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:23.693005 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8c6e5-93dd-4b64-8698-721f5bd546ed admin admin] PATH_INFO: `/v3/users/342ad6989d1e44b890e4873895467551` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:23.693309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8c6e5-93dd-4b64-8698-721f5bd546ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=342ad6989d1e44b890e4873895467551)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:23.696267 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8c6e5-93dd-4b64-8698-721f5bd546ed admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:23.810011 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c6c8c6e5-93dd-4b64-8698-721f5bd546ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '342ad6989d1e44b890e4873895467551'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:23.823034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c6c8c6e5-93dd-4b64-8698-721f5bd546ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '342ad6989d1e44b890e4873895467551'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:23.823820 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c6c8c6e5-93dd-4b64-8698-721f5bd546ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '342ad6989d1e44b890e4873895467551'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:23.825059 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c6c8c6e5-93dd-4b64-8698-721f5bd546ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '342ad6989d1e44b890e4873895467551'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:23.849972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c6c8c6e5-93dd-4b64-8698-721f5bd546ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '342ad6989d1e44b890e4873895467551'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:23.873969 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1001/2028] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:52:23 2022] DELETE /identity/v3/users/342ad6989d1e44b890e4873895467551 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:25.068427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e7910-9cfd-4623-b1a3-a8b6f3caa8f2 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:25.071889 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ed6e7910-9cfd-4623-b1a3-a8b6f3caa8f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:25.086783 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e7910-9cfd-4623-b1a3-a8b6f3caa8f2 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:25.149250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:25.174039 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c25be6-516d-4c2a-b1c2-ed478ec74f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:25.174932 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c25be6-516d-4c2a-b1c2-ed478ec74f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:25.175224 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c25be6-516d-4c2a-b1c2-ed478ec74f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:25.175503 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c25be6-516d-4c2a-b1c2-ed478ec74f37 admin admin] PATH_INFO: `/v3/projects/7a753cb96bb5492eb288fa39a1615d83` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:25.176804 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c25be6-516d-4c2a-b1c2-ed478ec74f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a753cb96bb5492eb288fa39a1615d83)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:25.178794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c25be6-516d-4c2a-b1c2-ed478ec74f37 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:25.234149 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-08c25be6-516d-4c2a-b1c2-ed478ec74f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a753cb96bb5492eb288fa39a1615d83', 'request_id': 'req-08c25be6-516d-4c2a-b1c2-ed478ec74f37'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:25.241150 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-08c25be6-516d-4c2a-b1c2-ed478ec74f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a753cb96bb5492eb288fa39a1615d83', 'request_id': 'req-08c25be6-516d-4c2a-b1c2-ed478ec74f37'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:25.250071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-08c25be6-516d-4c2a-b1c2-ed478ec74f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a753cb96bb5492eb288fa39a1615d83', 'request_id': 'req-08c25be6-516d-4c2a-b1c2-ed478ec74f37'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:25.262819 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-08c25be6-516d-4c2a-b1c2-ed478ec74f37 admin admin] The token cache is being invalidate because project 7a753cb96bb5492eb288fa39a1615d83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:25.263160 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-08c25be6-516d-4c2a-b1c2-ed478ec74f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:25.263822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-08c25be6-516d-4c2a-b1c2-ed478ec74f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:25.265411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1028/2029] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:25 2022] DELETE /identity/v3/projects/7a753cb96bb5492eb288fa39a1615d83 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:25.269503 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8c6e5-93dd-4b64-8698-721f5bd546ed admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:25.272608 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-c6c8c6e5-93dd-4b64-8698-721f5bd546ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:25.287887 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8c6e5-93dd-4b64-8698-721f5bd546ed admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:25.306677 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:25.368643 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947feae7-1b9b-4759-8bb0-faa7d502dac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:25.369641 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947feae7-1b9b-4759-8bb0-faa7d502dac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:25.369987 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947feae7-1b9b-4759-8bb0-faa7d502dac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:25.370365 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947feae7-1b9b-4759-8bb0-faa7d502dac6 admin admin] PATH_INFO: `/v3/users/b615b2ef1dd04daa9380980516c751b7` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:25.371651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947feae7-1b9b-4759-8bb0-faa7d502dac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b615b2ef1dd04daa9380980516c751b7)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:25.373628 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947feae7-1b9b-4759-8bb0-faa7d502dac6 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:25.443829 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-947feae7-1b9b-4759-8bb0-faa7d502dac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b615b2ef1dd04daa9380980516c751b7'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:25.455349 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-947feae7-1b9b-4759-8bb0-faa7d502dac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b615b2ef1dd04daa9380980516c751b7'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:25.456130 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-947feae7-1b9b-4759-8bb0-faa7d502dac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b615b2ef1dd04daa9380980516c751b7'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:25.456939 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-947feae7-1b9b-4759-8bb0-faa7d502dac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b615b2ef1dd04daa9380980516c751b7'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:25.480015 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c25be6-516d-4c2a-b1c2-ed478ec74f37 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:25.482158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-08c25be6-516d-4c2a-b1c2-ed478ec74f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:25.486225 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-947feae7-1b9b-4759-8bb0-faa7d502dac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b615b2ef1dd04daa9380980516c751b7'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:25.501770 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c25be6-516d-4c2a-b1c2-ed478ec74f37 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:25.503954 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1002/2030] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:52:25 2022] DELETE /identity/v3/users/b615b2ef1dd04daa9380980516c751b7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:25.618837 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1352ea-27b2-4743-a25b-9325a32970ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:25.619817 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1352ea-27b2-4743-a25b-9325a32970ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:25.620118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1352ea-27b2-4743-a25b-9325a32970ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:25.620411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1352ea-27b2-4743-a25b-9325a32970ec admin admin] PATH_INFO: `/v3/users/87488902f1b9468ebba719b7000edc2c` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:25.621796 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1352ea-27b2-4743-a25b-9325a32970ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=87488902f1b9468ebba719b7000edc2c)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:25.623872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1352ea-27b2-4743-a25b-9325a32970ec admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:25.717812 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-5a1352ea-27b2-4743-a25b-9325a32970ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87488902f1b9468ebba719b7000edc2c'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:25.732552 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-5a1352ea-27b2-4743-a25b-9325a32970ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87488902f1b9468ebba719b7000edc2c'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:25.733357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-5a1352ea-27b2-4743-a25b-9325a32970ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87488902f1b9468ebba719b7000edc2c'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:25.734062 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-5a1352ea-27b2-4743-a25b-9325a32970ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87488902f1b9468ebba719b7000edc2c'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:25.751250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-5a1352ea-27b2-4743-a25b-9325a32970ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87488902f1b9468ebba719b7000edc2c'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:25.754377 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:25.780877 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1029/2031] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:52:25 2022] DELETE /identity/v3/users/87488902f1b9468ebba719b7000edc2c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:52:25.786538 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164a3bd-2678-4d4b-8349-a0d0df1491a5 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:25.786750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164a3bd-2678-4d4b-8349-a0d0df1491a5 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:25.787030 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164a3bd-2678-4d4b-8349-a0d0df1491a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:25.808189 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-4164a3bd-2678-4d4b-8349-a0d0df1491a5 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:25.809432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-4164a3bd-2678-4d4b-8349-a0d0df1491a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:25.888434 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1003/2032] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:25.920507 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1352ea-27b2-4743-a25b-9325a32970ec admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:25.922246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5a1352ea-27b2-4743-a25b-9325a32970ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:25.974003 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164a3bd-2678-4d4b-8349-a0d0df1491a5 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:25.976014 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-4164a3bd-2678-4d4b-8349-a0d0df1491a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:26.002073 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164a3bd-2678-4d4b-8349-a0d0df1491a5 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:26.018620 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf3194-3713-48f2-92c3-6d8349eb0987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:26.019506 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf3194-3713-48f2-92c3-6d8349eb0987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:26.019874 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf3194-3713-48f2-92c3-6d8349eb0987 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:26.020712 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf3194-3713-48f2-92c3-6d8349eb0987 admin admin] PATH_INFO: `/v3/projects/40a53e0d764846eaaea4bc1e38072368` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:26.023877 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf3194-3713-48f2-92c3-6d8349eb0987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40a53e0d764846eaaea4bc1e38072368)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:26.025831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf3194-3713-48f2-92c3-6d8349eb0987 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:26.044815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1352ea-27b2-4743-a25b-9325a32970ec admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:26.053108 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd14cb-377f-4be4-8f3f-064aa9444d6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:26.057053 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd14cb-377f-4be4-8f3f-064aa9444d6d service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:26.057364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd14cb-377f-4be4-8f3f-064aa9444d6d service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:26.057647 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd14cb-377f-4be4-8f3f-064aa9444d6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:26.077423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd14cb-377f-4be4-8f3f-064aa9444d6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:26.078349 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd14cb-377f-4be4-8f3f-064aa9444d6d service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:26.090431 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1030/2033] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:26.102822 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:26.117950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ecdf3194-3713-48f2-92c3-6d8349eb0987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40a53e0d764846eaaea4bc1e38072368', 'request_id': 'req-ecdf3194-3713-48f2-92c3-6d8349eb0987'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:26.128036 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ecdf3194-3713-48f2-92c3-6d8349eb0987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40a53e0d764846eaaea4bc1e38072368', 'request_id': 'req-ecdf3194-3713-48f2-92c3-6d8349eb0987'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:26.136691 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ecdf3194-3713-48f2-92c3-6d8349eb0987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40a53e0d764846eaaea4bc1e38072368', 'request_id': 'req-ecdf3194-3713-48f2-92c3-6d8349eb0987'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:26.149904 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ecdf3194-3713-48f2-92c3-6d8349eb0987 admin admin] The token cache is being invalidate because project 40a53e0d764846eaaea4bc1e38072368 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:26.150106 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ecdf3194-3713-48f2-92c3-6d8349eb0987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:26.150714 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ecdf3194-3713-48f2-92c3-6d8349eb0987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:26.152609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1004/2034] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:25 2022] DELETE /identity/v3/projects/40a53e0d764846eaaea4bc1e38072368 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:26.157791 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cadaf-9e4d-4cdb-a508-2c948a6ef61f None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:26.158111 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cadaf-9e4d-4cdb-a508-2c948a6ef61f None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:26.158395 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6cadaf-9e4d-4cdb-a508-2c948a6ef61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:26.183211 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-ab6cadaf-9e4d-4cdb-a508-2c948a6ef61f None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:26.184759 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ab6cadaf-9e4d-4cdb-a508-2c948a6ef61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:26.259617 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1031/2035] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:26.268067 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c70ee-bdd3-4796-ba48-7ef5ab3cd789 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:26.268361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c70ee-bdd3-4796-ba48-7ef5ab3cd789 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:26.268665 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c70ee-bdd3-4796-ba48-7ef5ab3cd789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:26.314538 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-ac6c70ee-bdd3-4796-ba48-7ef5ab3cd789 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:26.315788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-ac6c70ee-bdd3-4796-ba48-7ef5ab3cd789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:26.329612 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1005/2036] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:26.331435 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cadaf-9e4d-4cdb-a508-2c948a6ef61f None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:26.365501 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6cadaf-9e4d-4cdb-a508-2c948a6ef61f None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:26.372711 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087cc6c-a282-493c-9831-61678a972fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:26.373591 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087cc6c-a282-493c-9831-61678a972fbf admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:26.374011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087cc6c-a282-493c-9831-61678a972fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:26.374387 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087cc6c-a282-493c-9831-61678a972fbf admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:26.375442 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087cc6c-a282-493c-9831-61678a972fbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:52:26.375770 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087cc6c-a282-493c-9831-61678a972fbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:26.377653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087cc6c-a282-493c-9831-61678a972fbf admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:26.397014 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1032/2037] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:52:26.398799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c70ee-bdd3-4796-ba48-7ef5ab3cd789 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:26.411872 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c70ee-bdd3-4796-ba48-7ef5ab3cd789 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:26.418491 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae6e71-e42a-413f-9e53-202e26360d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:26.419183 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae6e71-e42a-413f-9e53-202e26360d00 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:26.419575 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae6e71-e42a-413f-9e53-202e26360d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:26.419862 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae6e71-e42a-413f-9e53-202e26360d00 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:26.420604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae6e71-e42a-413f-9e53-202e26360d00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:26.423780 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae6e71-e42a-413f-9e53-202e26360d00 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:26.481964 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1006/2038] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:52:26 2022] POST /identity/v3/projects => generated 375 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:26.486280 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087cc6c-a282-493c-9831-61678a972fbf admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:26.506232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087cc6c-a282-493c-9831-61678a972fbf admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:26.620914 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae6e71-e42a-413f-9e53-202e26360d00 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:26.623367 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-caae6e71-e42a-413f-9e53-202e26360d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:26.658130 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93595b6a-a2e7-4b8a-be01-019651cbaf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:26.658826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93595b6a-a2e7-4b8a-be01-019651cbaf58 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:26.659116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93595b6a-a2e7-4b8a-be01-019651cbaf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:26.659399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93595b6a-a2e7-4b8a-be01-019651cbaf58 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:26.660113 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93595b6a-a2e7-4b8a-be01-019651cbaf58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:26.662677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93595b6a-a2e7-4b8a-be01-019651cbaf58 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:26.689573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1033/2039] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:52:26 2022] POST /identity/v3/users => generated 288 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:26.694964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93595b6a-a2e7-4b8a-be01-019651cbaf58 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:26.709922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93595b6a-a2e7-4b8a-be01-019651cbaf58 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:26.712985 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ab25b-67b7-4944-afb3-c3e67fa965b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:26.713677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ab25b-67b7-4944-afb3-c3e67fa965b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:26.714140 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ab25b-67b7-4944-afb3-c3e67fa965b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:26.714432 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ab25b-67b7-4944-afb3-c3e67fa965b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:26.715182 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ab25b-67b7-4944-afb3-c3e67fa965b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:26.716809 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73ab25b-67b7-4944-afb3-c3e67fa965b5 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:26.723678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:26.733026 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1034/2040] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 15:52:26.734140 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ab25b-67b7-4944-afb3-c3e67fa965b5 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:26.739959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae6e71-e42a-413f-9e53-202e26360d00 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:26.747682 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ab25b-67b7-4944-afb3-c3e67fa965b5 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:26.750324 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1c95d-74b2-4d60-b98a-24df3da2c9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:26.752404 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1c95d-74b2-4d60-b98a-24df3da2c9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:26.753119 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1c95d-74b2-4d60-b98a-24df3da2c9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:26.753822 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1c95d-74b2-4d60-b98a-24df3da2c9a3 admin admin] PATH_INFO: `/v3/projects/b8230d3765ce4a7e92481f01fceeafab` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:26.754696 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b786e1-7715-4488-a2b7-2a4c02dc890e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:26.755556 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b786e1-7715-4488-a2b7-2a4c02dc890e admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:26.755816 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b786e1-7715-4488-a2b7-2a4c02dc890e admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:26.756121 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b786e1-7715-4488-a2b7-2a4c02dc890e admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:26.756871 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b786e1-7715-4488-a2b7-2a4c02dc890e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:26.757569 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1c95d-74b2-4d60-b98a-24df3da2c9a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8230d3765ce4a7e92481f01fceeafab)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:26.758550 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b786e1-7715-4488-a2b7-2a4c02dc890e admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:26.761981 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1c95d-74b2-4d60-b98a-24df3da2c9a3 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:26.774088 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1035/2041] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:26.776530 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b786e1-7715-4488-a2b7-2a4c02dc890e admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:26.790960 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b786e1-7715-4488-a2b7-2a4c02dc890e admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:26.796437 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7cf83a-70d8-4b46-bf59-4e7af9bfc63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:26.797565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cf83a-70d8-4b46-bf59-4e7af9bfc63c admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:26.797925 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cf83a-70d8-4b46-bf59-4e7af9bfc63c admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:26.798208 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7cf83a-70d8-4b46-bf59-4e7af9bfc63c admin admin] PATH_INFO: `/v3/projects/e31ac098b7f74c1ea896007fdd9f2a6a/users/dbdf8cfd2ef442d98dfd225a3c750dd3/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:26.818301 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cf83a-70d8-4b46-bf59-4e7af9bfc63c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e31ac098b7f74c1ea896007fdd9f2a6a, user_id=dbdf8cfd2ef442d98dfd225a3c750dd3, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:26.821737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7cf83a-70d8-4b46-bf59-4e7af9bfc63c admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:26.841967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1036/2042] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:26 2022] PUT /identity/v3/projects/e31ac098b7f74c1ea896007fdd9f2a6a/users/dbdf8cfd2ef442d98dfd225a3c750dd3/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:52:26.850998 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33ea93-5293-4961-bcd9-f1247d807f70 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:26.851321 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33ea93-5293-4961-bcd9-f1247d807f70 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:26.851834 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33ea93-5293-4961-bcd9-f1247d807f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:26.861094 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-8ab1c95d-74b2-4d60-b98a-24df3da2c9a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8230d3765ce4a7e92481f01fceeafab', 'request_id': 'req-8ab1c95d-74b2-4d60-b98a-24df3da2c9a3'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:26.877527 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-8ab1c95d-74b2-4d60-b98a-24df3da2c9a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8230d3765ce4a7e92481f01fceeafab', 'request_id': 'req-8ab1c95d-74b2-4d60-b98a-24df3da2c9a3'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:26.889386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-5e33ea93-5293-4961-bcd9-f1247d807f70 None None] MFA Rules not processed for user `dbdf8cfd2ef442d98dfd225a3c750dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:26.890746 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5e33ea93-5293-4961-bcd9-f1247d807f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:26.897140 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-8ab1c95d-74b2-4d60-b98a-24df3da2c9a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8230d3765ce4a7e92481f01fceeafab', 'request_id': 'req-8ab1c95d-74b2-4d60-b98a-24df3da2c9a3'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:26.926076 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-8ab1c95d-74b2-4d60-b98a-24df3da2c9a3 admin admin] The token cache is being invalidate because project b8230d3765ce4a7e92481f01fceeafab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:26.926472 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-8ab1c95d-74b2-4d60-b98a-24df3da2c9a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:26.927625 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-8ab1c95d-74b2-4d60-b98a-24df3da2c9a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:26.931710 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1007/2043] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:26 2022] DELETE /identity/v3/projects/b8230d3765ce4a7e92481f01fceeafab => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:26.936016 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1c95d-74b2-4d60-b98a-24df3da2c9a3 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:26.940528 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-8ab1c95d-74b2-4d60-b98a-24df3da2c9a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:27.019317 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:27.056083 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1037/2044] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:27.068876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33ea93-5293-4961-bcd9-f1247d807f70 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:27.070543 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5e33ea93-5293-4961-bcd9-f1247d807f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:27.083644 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1c95d-74b2-4d60-b98a-24df3da2c9a3 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:27.088962 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcc8aa-d726-4089-8dfc-860b1c10b8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:27.089896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcc8aa-d726-4089-8dfc-860b1c10b8f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:27.090187 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcc8aa-d726-4089-8dfc-860b1c10b8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:27.090472 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcc8aa-d726-4089-8dfc-860b1c10b8f1 admin admin] PATH_INFO: `/v3/users/1231d2d5ce254b449d98b77e0b274e7f` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:27.091778 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcc8aa-d726-4089-8dfc-860b1c10b8f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1231d2d5ce254b449d98b77e0b274e7f)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:27.093718 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcc8aa-d726-4089-8dfc-860b1c10b8f1 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:27.137503 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e33ea93-5293-4961-bcd9-f1247d807f70 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:27.141596 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1d82f-6195-422a-a907-9d2b156fba20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:27.142309 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1d82f-6195-422a-a907-9d2b156fba20 service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:27.142834 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1d82f-6195-422a-a907-9d2b156fba20 service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:27.143124 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1d82f-6195-422a-a907-9d2b156fba20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:27.154706 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1d82f-6195-422a-a907-9d2b156fba20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:27.156181 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1d82f-6195-422a-a907-9d2b156fba20 service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:27.169791 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1038/2045] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:52:27.228492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-42dcc8aa-d726-4089-8dfc-860b1c10b8f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1231d2d5ce254b449d98b77e0b274e7f'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:27.247069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-42dcc8aa-d726-4089-8dfc-860b1c10b8f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1231d2d5ce254b449d98b77e0b274e7f'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:27.248499 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-42dcc8aa-d726-4089-8dfc-860b1c10b8f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1231d2d5ce254b449d98b77e0b274e7f'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:27.248952 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-42dcc8aa-d726-4089-8dfc-860b1c10b8f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1231d2d5ce254b449d98b77e0b274e7f'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:27.279306 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-42dcc8aa-d726-4089-8dfc-860b1c10b8f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1231d2d5ce254b449d98b77e0b274e7f'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:27.305576 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1008/2046] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:52:26 2022] DELETE /identity/v3/users/1231d2d5ce254b449d98b77e0b274e7f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:28.203479 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1d82f-6195-422a-a907-9d2b156fba20 service cinder] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:28.229103 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1d82f-6195-422a-a907-9d2b156fba20 service cinder] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:28.294952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:28.302760 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ef4ec-4ce4-47d8-8f26-9055c837db05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:28.304386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ef4ec-4ce4-47d8-8f26-9055c837db05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:28.304874 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ef4ec-4ce4-47d8-8f26-9055c837db05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:28.305580 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ef4ec-4ce4-47d8-8f26-9055c837db05 admin admin] PATH_INFO: `/v3/projects/ac2260fff5374e9bacd65c39a0e81d2a` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:28.307531 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ef4ec-4ce4-47d8-8f26-9055c837db05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac2260fff5374e9bacd65c39a0e81d2a)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:28.309972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ef4ec-4ce4-47d8-8f26-9055c837db05 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:28.400330 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-477ef4ec-4ce4-47d8-8f26-9055c837db05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac2260fff5374e9bacd65c39a0e81d2a', 'request_id': 'req-477ef4ec-4ce4-47d8-8f26-9055c837db05'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:28.414585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-477ef4ec-4ce4-47d8-8f26-9055c837db05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac2260fff5374e9bacd65c39a0e81d2a', 'request_id': 'req-477ef4ec-4ce4-47d8-8f26-9055c837db05'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:28.426610 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-477ef4ec-4ce4-47d8-8f26-9055c837db05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac2260fff5374e9bacd65c39a0e81d2a', 'request_id': 'req-477ef4ec-4ce4-47d8-8f26-9055c837db05'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:28.443908 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-477ef4ec-4ce4-47d8-8f26-9055c837db05 admin admin] The token cache is being invalidate because project ac2260fff5374e9bacd65c39a0e81d2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:28.444198 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-477ef4ec-4ce4-47d8-8f26-9055c837db05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:28.444899 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-477ef4ec-4ce4-47d8-8f26-9055c837db05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:28.446523 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1039/2047] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:28 2022] DELETE /identity/v3/projects/ac2260fff5374e9bacd65c39a0e81d2a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:52:28.451773 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3537bd-0ab0-4dfb-be48-bfe0dabdd401 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:28.452292 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3537bd-0ab0-4dfb-be48-bfe0dabdd401 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:28.452377 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3537bd-0ab0-4dfb-be48-bfe0dabdd401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:28.473570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-8c3537bd-0ab0-4dfb-be48-bfe0dabdd401 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:28.474918 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-8c3537bd-0ab0-4dfb-be48-bfe0dabdd401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:28.544523 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1009/2048] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:28.552438 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b67cf-6a1f-41cc-be00-c849c9af08e1 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:28.552842 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b67cf-6a1f-41cc-be00-c849c9af08e1 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:28.553136 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b67cf-6a1f-41cc-be00-c849c9af08e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:28.577020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-c55b67cf-6a1f-41cc-be00-c849c9af08e1 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:28.578394 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-c55b67cf-6a1f-41cc-be00-c849c9af08e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:28.592035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1040/2049] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:28.593900 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3537bd-0ab0-4dfb-be48-bfe0dabdd401 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:28.606598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3537bd-0ab0-4dfb-be48-bfe0dabdd401 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:28.611880 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badeadb3-4637-4450-abc3-c14ebc1cb0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:28.612549 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badeadb3-4637-4450-abc3-c14ebc1cb0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:28.612964 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badeadb3-4637-4450-abc3-c14ebc1cb0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:28.613452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badeadb3-4637-4450-abc3-c14ebc1cb0a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:28.614245 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badeadb3-4637-4450-abc3-c14ebc1cb0a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:52:28.614586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badeadb3-4637-4450-abc3-c14ebc1cb0a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:28.620266 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badeadb3-4637-4450-abc3-c14ebc1cb0a9 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:28.639078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1010/2050] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:52:28.641518 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b67cf-6a1f-41cc-be00-c849c9af08e1 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:28.654826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b67cf-6a1f-41cc-be00-c849c9af08e1 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:28.660387 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3465a06-6896-453f-b541-dcb281c113fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:28.661251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3465a06-6896-453f-b541-dcb281c113fe admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:28.661536 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3465a06-6896-453f-b541-dcb281c113fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:28.661818 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3465a06-6896-453f-b541-dcb281c113fe admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:28.662747 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3465a06-6896-453f-b541-dcb281c113fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:28.665256 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3465a06-6896-453f-b541-dcb281c113fe admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:28.711544 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1041/2051] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:52:28 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:28.715872 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badeadb3-4637-4450-abc3-c14ebc1cb0a9 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:28.736902 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badeadb3-4637-4450-abc3-c14ebc1cb0a9 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:28.778945 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:28.821487 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d72c46-a8e2-4de6-ba3d-e77b0e0bdaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:28.822622 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d72c46-a8e2-4de6-ba3d-e77b0e0bdaf6 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:28.823137 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d72c46-a8e2-4de6-ba3d-e77b0e0bdaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:28.823640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d72c46-a8e2-4de6-ba3d-e77b0e0bdaf6 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:28.824990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d72c46-a8e2-4de6-ba3d-e77b0e0bdaf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:28.828954 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d72c46-a8e2-4de6-ba3d-e77b0e0bdaf6 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:28.857810 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1011/2052] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:52:28 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:28.864459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3465a06-6896-453f-b541-dcb281c113fe admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:28.882915 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3465a06-6896-453f-b541-dcb281c113fe admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:28.890625 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e40cc-f93f-417d-913d-f8c658f0cf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:28.891687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e40cc-f93f-417d-913d-f8c658f0cf31 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:28.892114 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e40cc-f93f-417d-913d-f8c658f0cf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:28.892534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e40cc-f93f-417d-913d-f8c658f0cf31 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:28.893782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e40cc-f93f-417d-913d-f8c658f0cf31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:28.896547 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e40cc-f93f-417d-913d-f8c658f0cf31 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:28.906442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0b1cb-695e-47d7-84b5-9d1627ccf7bb None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:28.907197 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0b1cb-695e-47d7-84b5-9d1627ccf7bb None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:28.907607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac0b1cb-695e-47d7-84b5-9d1627ccf7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:28.918921 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1042/2053] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:28.920649 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e40cc-f93f-417d-913d-f8c658f0cf31 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:28.932851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-fac0b1cb-695e-47d7-84b5-9d1627ccf7bb None None] MFA Rules not processed for user `dbdf8cfd2ef442d98dfd225a3c750dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:28.934305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-fac0b1cb-695e-47d7-84b5-9d1627ccf7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:28.937080 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e40cc-f93f-417d-913d-f8c658f0cf31 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:28.944614 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63cea96-6d78-4392-8ae0-aaff0ef5872e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:28.945650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cea96-6d78-4392-8ae0-aaff0ef5872e admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:28.946186 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cea96-6d78-4392-8ae0-aaff0ef5872e admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:28.946687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cea96-6d78-4392-8ae0-aaff0ef5872e admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:28.948056 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63cea96-6d78-4392-8ae0-aaff0ef5872e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:28.951191 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63cea96-6d78-4392-8ae0-aaff0ef5872e admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:28.969258 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1043/2054] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 15:52:28.974450 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63cea96-6d78-4392-8ae0-aaff0ef5872e admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:28.999648 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63cea96-6d78-4392-8ae0-aaff0ef5872e admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:29.023788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb468ec6-3504-4077-9a2f-6ceea54f6a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:29.024495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb468ec6-3504-4077-9a2f-6ceea54f6a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:29.024878 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb468ec6-3504-4077-9a2f-6ceea54f6a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:29.025260 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb468ec6-3504-4077-9a2f-6ceea54f6a11 admin admin] PATH_INFO: `/v3/projects/8f5f1587a4054a93b86bb2cac3f55cb6/users/f2c974301b4f415285b6761316a6d8f8/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:29.065967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb468ec6-3504-4077-9a2f-6ceea54f6a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f5f1587a4054a93b86bb2cac3f55cb6, user_id=f2c974301b4f415285b6761316a6d8f8, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:29.073398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1012/2055] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:52:29.074506 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb468ec6-3504-4077-9a2f-6ceea54f6a11 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:29.110184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1044/2056] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:28 2022] PUT /identity/v3/projects/8f5f1587a4054a93b86bb2cac3f55cb6/users/f2c974301b4f415285b6761316a6d8f8/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:52:29.123218 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca4c8a-d038-46a6-a927-451931a66e10 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:29.123733 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca4c8a-d038-46a6-a927-451931a66e10 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:29.124229 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca4c8a-d038-46a6-a927-451931a66e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:29.180208 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-b0ca4c8a-d038-46a6-a927-451931a66e10 None None] MFA Rules not processed for user `f2c974301b4f415285b6761316a6d8f8`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:29.181436 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-b0ca4c8a-d038-46a6-a927-451931a66e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:29.304917 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1013/2057] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:29.321258 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb468ec6-3504-4077-9a2f-6ceea54f6a11 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:29.323790 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-bb468ec6-3504-4077-9a2f-6ceea54f6a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:29.398338 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb468ec6-3504-4077-9a2f-6ceea54f6a11 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:29.402948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ecb94-1c3a-4c7d-a4f2-5f0b55c54e36 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79239c95306c43f0a1a0b51715440009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:29.404373 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ecb94-1c3a-4c7d-a4f2-5f0b55c54e36 service glance] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:29.404848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ecb94-1c3a-4c7d-a4f2-5f0b55c54e36 service glance] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:29.405242 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ecb94-1c3a-4c7d-a4f2-5f0b55c54e36 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:29.426940 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ecb94-1c3a-4c7d-a4f2-5f0b55c54e36 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:29.428735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ecb94-1c3a-4c7d-a4f2-5f0b55c54e36 service glance] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:29.439641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1045/2058] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:39.298003 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=72,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:39.434673 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:39.608404 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf33f24-fe20-4f8e-90dc-1e2e889624b0 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:39.608802 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf33f24-fe20-4f8e-90dc-1e2e889624b0 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:39.609268 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf33f24-fe20-4f8e-90dc-1e2e889624b0 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:39.611033 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1014/2059] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jun 23 15:52:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:52:39.624607 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708915cb-9b75-4a3c-b0e5-013d1275bf0f None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:39.624898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708915cb-9b75-4a3c-b0e5-013d1275bf0f None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:39.625477 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708915cb-9b75-4a3c-b0e5-013d1275bf0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:39.646779 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-708915cb-9b75-4a3c-b0e5-013d1275bf0f None None] MFA Rules not processed for user `9300c3a803e94f9a93442f551fc9646f`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:39.648041 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-708915cb-9b75-4a3c-b0e5-013d1275bf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:39.705729 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf33f24-fe20-4f8e-90dc-1e2e889624b0 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:39.713124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-fbf33f24-fe20-4f8e-90dc-1e2e889624b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:39.732626 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1046/2060] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jun 23 15:52:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:39.747215 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708915cb-9b75-4a3c-b0e5-013d1275bf0f None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:39.748661 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-708915cb-9b75-4a3c-b0e5-013d1275bf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:39.762213 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708915cb-9b75-4a3c-b0e5-013d1275bf0f None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:39.767369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaeca35-0acd-4110-93b0-8027a316cfb2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9300c3a803e94f9a93442f551fc9646f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:39.768014 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeca35-0acd-4110-93b0-8027a316cfb2 service placement] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:39.768295 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeca35-0acd-4110-93b0-8027a316cfb2 service placement] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:39.768567 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaeca35-0acd-4110-93b0-8027a316cfb2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:39.778140 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaeca35-0acd-4110-93b0-8027a316cfb2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:39.779766 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaeca35-0acd-4110-93b0-8027a316cfb2 service placement] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:39.790111 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1047/2061] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:52:39.794034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf33f24-fe20-4f8e-90dc-1e2e889624b0 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:39.801214 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50653f-0f90-4ae5-aa73-8ccd6df4c47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:39.802171 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50653f-0f90-4ae5-aa73-8ccd6df4c47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:39.802450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50653f-0f90-4ae5-aa73-8ccd6df4c47a admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:39.802711 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50653f-0f90-4ae5-aa73-8ccd6df4c47a admin admin] PATH_INFO: `/v3/users/65a232a57388409091409128d7dbb56f` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:39.803938 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50653f-0f90-4ae5-aa73-8ccd6df4c47a admin admin] RBAC: Authorizing `identity:delete_user(user_id=65a232a57388409091409128d7dbb56f)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:39.805946 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50653f-0f90-4ae5-aa73-8ccd6df4c47a admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:39.867875 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-7d50653f-0f90-4ae5-aa73-8ccd6df4c47a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65a232a57388409091409128d7dbb56f'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:39.877572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-7d50653f-0f90-4ae5-aa73-8ccd6df4c47a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65a232a57388409091409128d7dbb56f'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:39.878330 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-7d50653f-0f90-4ae5-aa73-8ccd6df4c47a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65a232a57388409091409128d7dbb56f'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:39.879485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-7d50653f-0f90-4ae5-aa73-8ccd6df4c47a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65a232a57388409091409128d7dbb56f'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:39.891128 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-7d50653f-0f90-4ae5-aa73-8ccd6df4c47a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65a232a57388409091409128d7dbb56f'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:39.905522 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1015/2062] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:52:39 2022] DELETE /identity/v3/users/65a232a57388409091409128d7dbb56f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:52:40.102007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaeca35-0acd-4110-93b0-8027a316cfb2 service placement] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:40.130021 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaeca35-0acd-4110-93b0-8027a316cfb2 service placement] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:40.201184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51fe0a-da10-452e-8eea-5d3aff0bdd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:40.202079 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51fe0a-da10-452e-8eea-5d3aff0bdd6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:40.202385 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51fe0a-da10-452e-8eea-5d3aff0bdd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:40.202642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51fe0a-da10-452e-8eea-5d3aff0bdd6b admin admin] PATH_INFO: `/v3/projects/825be9e78f5041f18a9f204f9be507f8` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:40.204114 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51fe0a-da10-452e-8eea-5d3aff0bdd6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=825be9e78f5041f18a9f204f9be507f8)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:40.205885 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51fe0a-da10-452e-8eea-5d3aff0bdd6b admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:40.263627 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-0d51fe0a-da10-452e-8eea-5d3aff0bdd6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '825be9e78f5041f18a9f204f9be507f8', 'request_id': 'req-0d51fe0a-da10-452e-8eea-5d3aff0bdd6b'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:40.270652 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-0d51fe0a-da10-452e-8eea-5d3aff0bdd6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '825be9e78f5041f18a9f204f9be507f8', 'request_id': 'req-0d51fe0a-da10-452e-8eea-5d3aff0bdd6b'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:40.278476 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-0d51fe0a-da10-452e-8eea-5d3aff0bdd6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '825be9e78f5041f18a9f204f9be507f8', 'request_id': 'req-0d51fe0a-da10-452e-8eea-5d3aff0bdd6b'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:40.291688 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-0d51fe0a-da10-452e-8eea-5d3aff0bdd6b admin admin] The token cache is being invalidate because project 825be9e78f5041f18a9f204f9be507f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:40.291980 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-0d51fe0a-da10-452e-8eea-5d3aff0bdd6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:40.292662 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-0d51fe0a-da10-452e-8eea-5d3aff0bdd6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:40.294277 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1048/2063] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:40 2022] DELETE /identity/v3/projects/825be9e78f5041f18a9f204f9be507f8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:40.299776 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a580b-def7-4ba5-8705-64900f162533 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:40.299776 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a580b-def7-4ba5-8705-64900f162533 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:40.300252 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a580b-def7-4ba5-8705-64900f162533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:40.319884 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-d13a580b-def7-4ba5-8705-64900f162533 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:40.321122 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-d13a580b-def7-4ba5-8705-64900f162533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:40.388077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1016/2064] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:40.396452 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882fcd0-f518-4098-8a26-4e9d83c5e177 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:40.396776 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882fcd0-f518-4098-8a26-4e9d83c5e177 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:40.397140 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882fcd0-f518-4098-8a26-4e9d83c5e177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:40.416624 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-4882fcd0-f518-4098-8a26-4e9d83c5e177 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:40.417451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-4882fcd0-f518-4098-8a26-4e9d83c5e177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:40.426624 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1049/2065] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:40.431104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a580b-def7-4ba5-8705-64900f162533 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:40.444608 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a580b-def7-4ba5-8705-64900f162533 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:40.449518 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa22f8-7b71-498e-8d73-16390fee3f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:40.450291 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa22f8-7b71-498e-8d73-16390fee3f22 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:40.450649 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa22f8-7b71-498e-8d73-16390fee3f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:40.450999 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa22f8-7b71-498e-8d73-16390fee3f22 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:40.451803 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa22f8-7b71-498e-8d73-16390fee3f22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:52:40.452200 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa22f8-7b71-498e-8d73-16390fee3f22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:40.453890 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa22f8-7b71-498e-8d73-16390fee3f22 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:40.470284 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1017/2066] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:52:40.471438 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882fcd0-f518-4098-8a26-4e9d83c5e177 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:40.480712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882fcd0-f518-4098-8a26-4e9d83c5e177 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:40.486955 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be3ba3-641a-4e37-af84-6e1816624eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:40.487128 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be3ba3-641a-4e37-af84-6e1816624eac admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:40.487295 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be3ba3-641a-4e37-af84-6e1816624eac admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:40.487568 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be3ba3-641a-4e37-af84-6e1816624eac admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:40.488297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be3ba3-641a-4e37-af84-6e1816624eac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:40.490891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be3ba3-641a-4e37-af84-6e1816624eac admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:40.493708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:40.522033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1050/2067] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:52:40 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:40.525944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa22f8-7b71-498e-8d73-16390fee3f22 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:40.537568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa22f8-7b71-498e-8d73-16390fee3f22 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:40.560800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:40.648009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29abc65-31e9-4f50-b82a-a48358c4fea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:40.648851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29abc65-31e9-4f50-b82a-a48358c4fea3 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:40.649143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29abc65-31e9-4f50-b82a-a48358c4fea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:40.649457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29abc65-31e9-4f50-b82a-a48358c4fea3 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:40.650191 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29abc65-31e9-4f50-b82a-a48358c4fea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:40.652519 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29abc65-31e9-4f50-b82a-a48358c4fea3 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:40.696424 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1018/2068] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:52:40 2022] POST /identity/v3/users => generated 282 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:40.700748 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be3ba3-641a-4e37-af84-6e1816624eac admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:40.730712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be3ba3-641a-4e37-af84-6e1816624eac admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:40.742040 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6df7d8-16a0-448d-9008-8b51761a0d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:40.742755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6df7d8-16a0-448d-9008-8b51761a0d82 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:40.743042 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6df7d8-16a0-448d-9008-8b51761a0d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:40.743324 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6df7d8-16a0-448d-9008-8b51761a0d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:40.744083 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6df7d8-16a0-448d-9008-8b51761a0d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:40.745740 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6df7d8-16a0-448d-9008-8b51761a0d82 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:40.766560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1051/2069] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:40.767658 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29abc65-31e9-4f50-b82a-a48358c4fea3 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:40.780260 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29abc65-31e9-4f50-b82a-a48358c4fea3 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:40.793928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e0eb5-d811-43af-a4d3-f08433e9d24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:40.795165 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e0eb5-d811-43af-a4d3-f08433e9d24e admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:40.795858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e0eb5-d811-43af-a4d3-f08433e9d24e admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:40.796230 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e0eb5-d811-43af-a4d3-f08433e9d24e admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:40.797058 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e0eb5-d811-43af-a4d3-f08433e9d24e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:40.799180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e0eb5-d811-43af-a4d3-f08433e9d24e admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:40.817484 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1019/2070] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:40.821578 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6df7d8-16a0-448d-9008-8b51761a0d82 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:40.838971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6df7d8-16a0-448d-9008-8b51761a0d82 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:40.843870 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3710e-cf80-4e64-b595-5f50caa761b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:40.844904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3710e-cf80-4e64-b595-5f50caa761b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:40.845304 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3710e-cf80-4e64-b595-5f50caa761b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:40.845896 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3710e-cf80-4e64-b595-5f50caa761b9 admin admin] PATH_INFO: `/v3/projects/5db98f3481734e5b83529dd684dbedff/users/895cd8a0c38748c9b55be67b55f588dd/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:40.899218 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3710e-cf80-4e64-b595-5f50caa761b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db98f3481734e5b83529dd684dbedff, user_id=895cd8a0c38748c9b55be67b55f588dd, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:40.912257 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3710e-cf80-4e64-b595-5f50caa761b9 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:40.954508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1052/2071] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:40 2022] PUT /identity/v3/projects/5db98f3481734e5b83529dd684dbedff/users/895cd8a0c38748c9b55be67b55f588dd/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:40.964836 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29601c5-9f6c-4b81-8bf2-42f753924b73 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:40.965378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29601c5-9f6c-4b81-8bf2-42f753924b73 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:40.965795 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29601c5-9f6c-4b81-8bf2-42f753924b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:41.015355 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-a29601c5-9f6c-4b81-8bf2-42f753924b73 None None] MFA Rules not processed for user `895cd8a0c38748c9b55be67b55f588dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:41.020057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-a29601c5-9f6c-4b81-8bf2-42f753924b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:41.096926 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1020/2072] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:40 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:41.101364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3710e-cf80-4e64-b595-5f50caa761b9 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:41.167276 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3710e-cf80-4e64-b595-5f50caa761b9 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:41.172195 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe3d8c-bd09-485c-b797-b94f4e4a695e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:41.172851 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe3d8c-bd09-485c-b797-b94f4e4a695e admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:41.173135 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe3d8c-bd09-485c-b797-b94f4e4a695e admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:41.173413 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe3d8c-bd09-485c-b797-b94f4e4a695e admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:41.174174 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe3d8c-bd09-485c-b797-b94f4e4a695e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:41.176705 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe3d8c-bd09-485c-b797-b94f4e4a695e admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:41.202550 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1053/2073] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:52:41 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:41.206563 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29601c5-9f6c-4b81-8bf2-42f753924b73 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:41.217352 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29601c5-9f6c-4b81-8bf2-42f753924b73 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:41.276485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0039ae-51b2-4447-a222-9a045349fdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:41.277173 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0039ae-51b2-4447-a222-9a045349fdb2 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:41.277457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0039ae-51b2-4447-a222-9a045349fdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:41.277733 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0039ae-51b2-4447-a222-9a045349fdb2 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:41.278490 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0039ae-51b2-4447-a222-9a045349fdb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:41.280404 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0039ae-51b2-4447-a222-9a045349fdb2 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:41.303710 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1021/2074] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:52:41 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:41.305744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe3d8c-bd09-485c-b797-b94f4e4a695e admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:41.316103 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe3d8c-bd09-485c-b797-b94f4e4a695e admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:41.320699 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711735e-100a-4813-b7f8-de084d66367a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:41.321358 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711735e-100a-4813-b7f8-de084d66367a admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:41.321658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711735e-100a-4813-b7f8-de084d66367a admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:41.321956 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711735e-100a-4813-b7f8-de084d66367a admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:41.322686 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f711735e-100a-4813-b7f8-de084d66367a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:41.324249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f711735e-100a-4813-b7f8-de084d66367a admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:41.335291 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1054/2075] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:41.339472 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0039ae-51b2-4447-a222-9a045349fdb2 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:41.345849 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:41.351487 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0039ae-51b2-4447-a222-9a045349fdb2 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:41.357808 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d204c6f-7f3d-48cd-b342-eab531114614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:41.358750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d204c6f-7f3d-48cd-b342-eab531114614 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:41.359036 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d204c6f-7f3d-48cd-b342-eab531114614 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:41.359314 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d204c6f-7f3d-48cd-b342-eab531114614 admin admin] PATH_INFO: `/v3/projects/674c486f9f7b4fd0adaaaffb90116455/users/1ede2b6e8cd24c03a0b9be52030f44af/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:41.375141 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d204c6f-7f3d-48cd-b342-eab531114614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=674c486f9f7b4fd0adaaaffb90116455, user_id=1ede2b6e8cd24c03a0b9be52030f44af, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:41.377799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d204c6f-7f3d-48cd-b342-eab531114614 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:41.391084 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1022/2076] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:41 2022] PUT /identity/v3/projects/674c486f9f7b4fd0adaaaffb90116455/users/1ede2b6e8cd24c03a0b9be52030f44af/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:41.395181 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711735e-100a-4813-b7f8-de084d66367a admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:41.406030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711735e-100a-4813-b7f8-de084d66367a admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:41.467276 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98173da-e3dc-4f23-97a8-03fad6feb5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:41.467949 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98173da-e3dc-4f23-97a8-03fad6feb5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:41.468233 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98173da-e3dc-4f23-97a8-03fad6feb5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:41.468512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98173da-e3dc-4f23-97a8-03fad6feb5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:41.469238 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98173da-e3dc-4f23-97a8-03fad6feb5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:41.470994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98173da-e3dc-4f23-97a8-03fad6feb5a1 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:41.481994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1055/2077] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:41.486224 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d204c6f-7f3d-48cd-b342-eab531114614 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:41.497245 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d204c6f-7f3d-48cd-b342-eab531114614 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:41.501938 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f118de8-5182-43cc-855c-6e69c51a97e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:41.502825 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f118de8-5182-43cc-855c-6e69c51a97e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:41.503112 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f118de8-5182-43cc-855c-6e69c51a97e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:41.503393 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f118de8-5182-43cc-855c-6e69c51a97e0 admin admin] PATH_INFO: `/v3/projects/674c486f9f7b4fd0adaaaffb90116455/users/1ede2b6e8cd24c03a0b9be52030f44af/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:41.505413 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f118de8-5182-43cc-855c-6e69c51a97e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=674c486f9f7b4fd0adaaaffb90116455, user_id=1ede2b6e8cd24c03a0b9be52030f44af, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:41.508070 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f118de8-5182-43cc-855c-6e69c51a97e0 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:41.518574 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1023/2078] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:41 2022] PUT /identity/v3/projects/674c486f9f7b4fd0adaaaffb90116455/users/1ede2b6e8cd24c03a0b9be52030f44af/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:41.530075 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9932ce1-23df-4875-ae00-548a8a621057 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:41.530369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9932ce1-23df-4875-ae00-548a8a621057 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:41.530650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9932ce1-23df-4875-ae00-548a8a621057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:41.560135 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-e9932ce1-23df-4875-ae00-548a8a621057 None None] MFA Rules not processed for user `1ede2b6e8cd24c03a0b9be52030f44af`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:41.562066 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e9932ce1-23df-4875-ae00-548a8a621057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:41.572004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:41.642027 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1056/2079] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:41 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:41.654183 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f118de8-5182-43cc-855c-6e69c51a97e0 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:41.656554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-5f118de8-5182-43cc-855c-6e69c51a97e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:41.724134 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f118de8-5182-43cc-855c-6e69c51a97e0 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:41.729228 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8368c-8926-432d-8d2f-b3dfa58971a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:41.729947 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8368c-8926-432d-8d2f-b3dfa58971a0 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:41.730238 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8368c-8926-432d-8d2f-b3dfa58971a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:41.730522 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8368c-8926-432d-8d2f-b3dfa58971a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:41.740440 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8368c-8926-432d-8d2f-b3dfa58971a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:41.741914 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8368c-8926-432d-8d2f-b3dfa58971a0 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:41.752887 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1024/2080] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:41 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:42.328013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9932ce1-23df-4875-ae00-548a8a621057 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:42.405674 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9932ce1-23df-4875-ae00-548a8a621057 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:42.412279 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7494ede-1dfb-4109-8871-e76d61770503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:42.413230 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7494ede-1dfb-4109-8871-e76d61770503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:42.413534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7494ede-1dfb-4109-8871-e76d61770503 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:42.414059 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7494ede-1dfb-4109-8871-e76d61770503 admin admin] PATH_INFO: `/v3/users/895cd8a0c38748c9b55be67b55f588dd` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:42.415359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7494ede-1dfb-4109-8871-e76d61770503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=895cd8a0c38748c9b55be67b55f588dd)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:42.417524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7494ede-1dfb-4109-8871-e76d61770503 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:42.494677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d7494ede-1dfb-4109-8871-e76d61770503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '895cd8a0c38748c9b55be67b55f588dd'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:42.502699 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d7494ede-1dfb-4109-8871-e76d61770503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '895cd8a0c38748c9b55be67b55f588dd'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:42.503434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d7494ede-1dfb-4109-8871-e76d61770503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '895cd8a0c38748c9b55be67b55f588dd'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:42.504058 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d7494ede-1dfb-4109-8871-e76d61770503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '895cd8a0c38748c9b55be67b55f588dd'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:42.520585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d7494ede-1dfb-4109-8871-e76d61770503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '895cd8a0c38748c9b55be67b55f588dd'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:42.539086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1057/2081] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:52:42 2022] DELETE /identity/v3/users/895cd8a0c38748c9b55be67b55f588dd => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:42.543454 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03e915-b171-4077-8d02-3f995f3a9a8b None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:42.544003 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03e915-b171-4077-8d02-3f995f3a9a8b None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:42.544003 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03e915-b171-4077-8d02-3f995f3a9a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:42.564884 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-3a03e915-b171-4077-8d02-3f995f3a9a8b None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:42.566706 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-3a03e915-b171-4077-8d02-3f995f3a9a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:42.680430 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1025/2082] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:42.691052 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7494ede-1dfb-4109-8871-e76d61770503 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:42.693622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-d7494ede-1dfb-4109-8871-e76d61770503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:42.731301 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:42.768874 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7494ede-1dfb-4109-8871-e76d61770503 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:42.773379 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bce868-ad33-4098-a84f-01feaaa01bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:42.774190 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bce868-ad33-4098-a84f-01feaaa01bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:42.774539 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bce868-ad33-4098-a84f-01feaaa01bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:42.774885 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bce868-ad33-4098-a84f-01feaaa01bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:42.793839 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bce868-ad33-4098-a84f-01feaaa01bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:42.795915 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bce868-ad33-4098-a84f-01feaaa01bc2 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:42.810891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1058/2083] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:43.163284 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03e915-b171-4077-8d02-3f995f3a9a8b None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:43.164969 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-3a03e915-b171-4077-8d02-3f995f3a9a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:43.179256 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03e915-b171-4077-8d02-3f995f3a9a8b None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:43.184395 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f775c9-84f9-438f-a9f1-cd32e6ab7e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:43.185398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f775c9-84f9-438f-a9f1-cd32e6ab7e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:43.185711 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f775c9-84f9-438f-a9f1-cd32e6ab7e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:43.186040 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f775c9-84f9-438f-a9f1-cd32e6ab7e1f admin admin] PATH_INFO: `/v3/projects/5db98f3481734e5b83529dd684dbedff` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:43.187349 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f775c9-84f9-438f-a9f1-cd32e6ab7e1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db98f3481734e5b83529dd684dbedff)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:43.189357 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f775c9-84f9-438f-a9f1-cd32e6ab7e1f admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:43.252939 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-44f775c9-84f9-438f-a9f1-cd32e6ab7e1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db98f3481734e5b83529dd684dbedff', 'request_id': 'req-44f775c9-84f9-438f-a9f1-cd32e6ab7e1f'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:43.262346 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-44f775c9-84f9-438f-a9f1-cd32e6ab7e1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db98f3481734e5b83529dd684dbedff', 'request_id': 'req-44f775c9-84f9-438f-a9f1-cd32e6ab7e1f'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:43.269248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-44f775c9-84f9-438f-a9f1-cd32e6ab7e1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db98f3481734e5b83529dd684dbedff', 'request_id': 'req-44f775c9-84f9-438f-a9f1-cd32e6ab7e1f'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:43.273665 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:43.282919 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-44f775c9-84f9-438f-a9f1-cd32e6ab7e1f admin admin] The token cache is being invalidate because project 5db98f3481734e5b83529dd684dbedff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:43.283215 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-44f775c9-84f9-438f-a9f1-cd32e6ab7e1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:43.284447 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-44f775c9-84f9-438f-a9f1-cd32e6ab7e1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:43.286325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1026/2084] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:43 2022] DELETE /identity/v3/projects/5db98f3481734e5b83529dd684dbedff => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:43.290043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bce868-ad33-4098-a84f-01feaaa01bc2 service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:43.302469 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bce868-ad33-4098-a84f-01feaaa01bc2 service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:43.368440 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbff52-7ae2-4bb2-8a9f-30fe2fc02bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:43.369332 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbff52-7ae2-4bb2-8a9f-30fe2fc02bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:43.369630 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbff52-7ae2-4bb2-8a9f-30fe2fc02bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:43.369940 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbff52-7ae2-4bb2-8a9f-30fe2fc02bd1 admin admin] PATH_INFO: `/v3/users/1ede2b6e8cd24c03a0b9be52030f44af` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:43.371170 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbff52-7ae2-4bb2-8a9f-30fe2fc02bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ede2b6e8cd24c03a0b9be52030f44af)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:43.373145 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbff52-7ae2-4bb2-8a9f-30fe2fc02bd1 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:43.424320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-22fbff52-7ae2-4bb2-8a9f-30fe2fc02bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ede2b6e8cd24c03a0b9be52030f44af'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:43.432215 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-22fbff52-7ae2-4bb2-8a9f-30fe2fc02bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ede2b6e8cd24c03a0b9be52030f44af'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:43.432979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-22fbff52-7ae2-4bb2-8a9f-30fe2fc02bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ede2b6e8cd24c03a0b9be52030f44af'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:43.433593 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-22fbff52-7ae2-4bb2-8a9f-30fe2fc02bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ede2b6e8cd24c03a0b9be52030f44af'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:43.445785 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-22fbff52-7ae2-4bb2-8a9f-30fe2fc02bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ede2b6e8cd24c03a0b9be52030f44af'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:43.458793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1059/2085] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:52:43 2022] DELETE /identity/v3/users/1ede2b6e8cd24c03a0b9be52030f44af => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:43.745107 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f775c9-84f9-438f-a9f1-cd32e6ab7e1f admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:43.746778 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-44f775c9-84f9-438f-a9f1-cd32e6ab7e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:43.761292 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f775c9-84f9-438f-a9f1-cd32e6ab7e1f admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:43.818898 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2374576-84b6-4f87-be46-50db72f5d317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:43.819676 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2374576-84b6-4f87-be46-50db72f5d317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:43.819958 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2374576-84b6-4f87-be46-50db72f5d317 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:43.820233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2374576-84b6-4f87-be46-50db72f5d317 admin admin] PATH_INFO: `/v3/projects/674c486f9f7b4fd0adaaaffb90116455` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:43.821428 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2374576-84b6-4f87-be46-50db72f5d317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=674c486f9f7b4fd0adaaaffb90116455)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:43.823367 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2374576-84b6-4f87-be46-50db72f5d317 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:43.872464 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c2374576-84b6-4f87-be46-50db72f5d317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '674c486f9f7b4fd0adaaaffb90116455', 'request_id': 'req-c2374576-84b6-4f87-be46-50db72f5d317'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:43.881721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c2374576-84b6-4f87-be46-50db72f5d317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '674c486f9f7b4fd0adaaaffb90116455', 'request_id': 'req-c2374576-84b6-4f87-be46-50db72f5d317'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:43.888406 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c2374576-84b6-4f87-be46-50db72f5d317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '674c486f9f7b4fd0adaaaffb90116455', 'request_id': 'req-c2374576-84b6-4f87-be46-50db72f5d317'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:43.900514 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c2374576-84b6-4f87-be46-50db72f5d317 admin admin] The token cache is being invalidate because project 674c486f9f7b4fd0adaaaffb90116455 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:43.900808 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c2374576-84b6-4f87-be46-50db72f5d317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:43.901567 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c2374576-84b6-4f87-be46-50db72f5d317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:43.903848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1027/2086] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:43 2022] DELETE /identity/v3/projects/674c486f9f7b4fd0adaaaffb90116455 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:43.908818 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb361e-929f-46cb-acb0-8711040ef988 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:43.909329 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb361e-929f-46cb-acb0-8711040ef988 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:43.909421 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb361e-929f-46cb-acb0-8711040ef988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:43.928201 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-c2eb361e-929f-46cb-acb0-8711040ef988 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:43.930222 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-c2eb361e-929f-46cb-acb0-8711040ef988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:43.975735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:43.995512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1060/2087] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:44.003392 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407c46f-0139-47f3-9b02-bc349c1bbbf0 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:44.003683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407c46f-0139-47f3-9b02-bc349c1bbbf0 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:44.004011 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407c46f-0139-47f3-9b02-bc349c1bbbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:44.023915 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-9407c46f-0139-47f3-9b02-bc349c1bbbf0 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:44.025116 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-9407c46f-0139-47f3-9b02-bc349c1bbbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:44.033442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1028/2088] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:44.038323 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb361e-929f-46cb-acb0-8711040ef988 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:44.048430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb361e-929f-46cb-acb0-8711040ef988 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:44.053432 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15911fe3-8851-4520-aabc-0a74cd106a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:44.054153 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15911fe3-8851-4520-aabc-0a74cd106a8e admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:44.054440 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15911fe3-8851-4520-aabc-0a74cd106a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:44.054721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15911fe3-8851-4520-aabc-0a74cd106a8e admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:44.055471 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15911fe3-8851-4520-aabc-0a74cd106a8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:52:44.055781 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15911fe3-8851-4520-aabc-0a74cd106a8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:44.057421 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15911fe3-8851-4520-aabc-0a74cd106a8e admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:44.069712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1061/2089] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:52:44.074085 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407c46f-0139-47f3-9b02-bc349c1bbbf0 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:44.083779 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407c46f-0139-47f3-9b02-bc349c1bbbf0 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:44.088389 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59442eae-c084-407d-9cea-74f2d60da215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:44.089033 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59442eae-c084-407d-9cea-74f2d60da215 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:44.089316 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59442eae-c084-407d-9cea-74f2d60da215 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:44.089595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59442eae-c084-407d-9cea-74f2d60da215 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:44.090315 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59442eae-c084-407d-9cea-74f2d60da215 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:44.092231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59442eae-c084-407d-9cea-74f2d60da215 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:44.121282 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1029/2090] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:52:44 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:44.122916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15911fe3-8851-4520-aabc-0a74cd106a8e admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:44.134056 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15911fe3-8851-4520-aabc-0a74cd106a8e admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:44.190830 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7ef68-9813-4110-9a8c-3929116d651d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:44.192053 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7ef68-9813-4110-9a8c-3929116d651d admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:44.192359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7ef68-9813-4110-9a8c-3929116d651d admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:44.192664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb7ef68-9813-4110-9a8c-3929116d651d admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:44.193361 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7ef68-9813-4110-9a8c-3929116d651d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:44.195309 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb7ef68-9813-4110-9a8c-3929116d651d admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:44.215780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1062/2091] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:52:44 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:44.219907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59442eae-c084-407d-9cea-74f2d60da215 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:44.230981 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59442eae-c084-407d-9cea-74f2d60da215 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:44.236391 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14b55d-8339-4954-a780-b7aa85ee2f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:44.237052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14b55d-8339-4954-a780-b7aa85ee2f97 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:44.237391 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14b55d-8339-4954-a780-b7aa85ee2f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:44.237670 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14b55d-8339-4954-a780-b7aa85ee2f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:44.238524 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14b55d-8339-4954-a780-b7aa85ee2f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:44.240523 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14b55d-8339-4954-a780-b7aa85ee2f97 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:44.253091 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1030/2092] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:44.257508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7ef68-9813-4110-9a8c-3929116d651d admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:44.268287 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb7ef68-9813-4110-9a8c-3929116d651d admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:44.273955 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23ce89-d749-4f20-9f65-d2055d083b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:44.274729 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23ce89-d749-4f20-9f65-d2055d083b26 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:44.275158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23ce89-d749-4f20-9f65-d2055d083b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:44.275504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23ce89-d749-4f20-9f65-d2055d083b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:44.276356 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f23ce89-d749-4f20-9f65-d2055d083b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:44.277994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f23ce89-d749-4f20-9f65-d2055d083b26 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:44.292169 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1063/2093] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:44.296191 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14b55d-8339-4954-a780-b7aa85ee2f97 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:44.309415 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14b55d-8339-4954-a780-b7aa85ee2f97 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:44.315111 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7ba0f-1e45-4b38-a10c-9f73f6dbecb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:44.316081 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7ba0f-1e45-4b38-a10c-9f73f6dbecb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:44.317046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7ba0f-1e45-4b38-a10c-9f73f6dbecb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:44.317413 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7ba0f-1e45-4b38-a10c-9f73f6dbecb1 admin admin] PATH_INFO: `/v3/projects/35d7c25c2e2644ce9d1a591e97a95a02/users/902d11ac80464b02b557d3c23cce403e/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:44.337968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7ba0f-1e45-4b38-a10c-9f73f6dbecb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35d7c25c2e2644ce9d1a591e97a95a02, user_id=902d11ac80464b02b557d3c23cce403e, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:44.341128 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c7ba0f-1e45-4b38-a10c-9f73f6dbecb1 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:44.356334 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1031/2094] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:44 2022] PUT /identity/v3/projects/35d7c25c2e2644ce9d1a591e97a95a02/users/902d11ac80464b02b557d3c23cce403e/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:52:44.368899 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071a65b-4482-41bb-b607-3b7e78662f8c None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:44.369431 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071a65b-4482-41bb-b607-3b7e78662f8c None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:44.370182 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071a65b-4482-41bb-b607-3b7e78662f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:44.412005 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-8071a65b-4482-41bb-b607-3b7e78662f8c None None] MFA Rules not processed for user `902d11ac80464b02b557d3c23cce403e`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:44.413580 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-8071a65b-4482-41bb-b607-3b7e78662f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:44.512329 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1064/2095] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:44.516371 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7ba0f-1e45-4b38-a10c-9f73f6dbecb1 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:44.543158 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:44.591905 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7ba0f-1e45-4b38-a10c-9f73f6dbecb1 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:44.596641 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95386b9d-c8e4-4393-90bc-b1c50f941793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:44.597307 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95386b9d-c8e4-4393-90bc-b1c50f941793 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:44.597627 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95386b9d-c8e4-4393-90bc-b1c50f941793 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:44.597937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95386b9d-c8e4-4393-90bc-b1c50f941793 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:44.598637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95386b9d-c8e4-4393-90bc-b1c50f941793 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:44.600553 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95386b9d-c8e4-4393-90bc-b1c50f941793 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:44.626805 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1032/2096] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:52:44 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:44.631382 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071a65b-4482-41bb-b607-3b7e78662f8c None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:44.642158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071a65b-4482-41bb-b607-3b7e78662f8c None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:44.688904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:44.706856 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e644c95-cd5a-4bc8-b74a-eb45adb2fcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:44.707554 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e644c95-cd5a-4bc8-b74a-eb45adb2fcc7 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:44.707833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e644c95-cd5a-4bc8-b74a-eb45adb2fcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:44.708111 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e644c95-cd5a-4bc8-b74a-eb45adb2fcc7 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:44.708822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e644c95-cd5a-4bc8-b74a-eb45adb2fcc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:44.710773 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e644c95-cd5a-4bc8-b74a-eb45adb2fcc7 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:44.730360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1065/2097] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:52:44 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:44.734488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95386b9d-c8e4-4393-90bc-b1c50f941793 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:44.745706 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95386b9d-c8e4-4393-90bc-b1c50f941793 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:44.751117 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a830cb-7722-4fda-bb55-4109b49b3611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:44.751825 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a830cb-7722-4fda-bb55-4109b49b3611 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:44.752111 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a830cb-7722-4fda-bb55-4109b49b3611 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:44.752408 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a830cb-7722-4fda-bb55-4109b49b3611 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:44.753207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a830cb-7722-4fda-bb55-4109b49b3611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:44.755416 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a830cb-7722-4fda-bb55-4109b49b3611 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:44.768393 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1033/2098] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:44.772438 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e644c95-cd5a-4bc8-b74a-eb45adb2fcc7 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:44.782612 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e644c95-cd5a-4bc8-b74a-eb45adb2fcc7 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:44.787384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63373f-6ad0-43e7-aaaa-6850a4253c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:44.788266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63373f-6ad0-43e7-aaaa-6850a4253c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:44.788549 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63373f-6ad0-43e7-aaaa-6850a4253c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:44.788825 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63373f-6ad0-43e7-aaaa-6850a4253c0f admin admin] PATH_INFO: `/v3/projects/52887096f2b74f7a94bbf14f83847d12/users/0a695776c1a64a0aa0e8b4347cc96b9b/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:44.804422 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63373f-6ad0-43e7-aaaa-6850a4253c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=52887096f2b74f7a94bbf14f83847d12, user_id=0a695776c1a64a0aa0e8b4347cc96b9b, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:44.807113 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63373f-6ad0-43e7-aaaa-6850a4253c0f admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:44.821181 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1066/2099] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:44 2022] PUT /identity/v3/projects/52887096f2b74f7a94bbf14f83847d12/users/0a695776c1a64a0aa0e8b4347cc96b9b/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:44.825253 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a830cb-7722-4fda-bb55-4109b49b3611 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:44.836918 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a830cb-7722-4fda-bb55-4109b49b3611 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:44.895977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2371a-a394-4f83-b808-17b66827f9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:44.896641 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2371a-a394-4f83-b808-17b66827f9aa admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:44.897146 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2371a-a394-4f83-b808-17b66827f9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:44.897434 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2371a-a394-4f83-b808-17b66827f9aa admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:44.898204 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2371a-a394-4f83-b808-17b66827f9aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:44.899788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2371a-a394-4f83-b808-17b66827f9aa admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:44.911043 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1034/2100] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:44.915026 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63373f-6ad0-43e7-aaaa-6850a4253c0f admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:44.927243 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63373f-6ad0-43e7-aaaa-6850a4253c0f admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:44.932914 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c70a24-7586-46a2-bfcb-09da4f3c145a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:44.933943 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c70a24-7586-46a2-bfcb-09da4f3c145a admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:44.934225 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c70a24-7586-46a2-bfcb-09da4f3c145a admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:44.934497 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c70a24-7586-46a2-bfcb-09da4f3c145a admin admin] PATH_INFO: `/v3/projects/52887096f2b74f7a94bbf14f83847d12/users/0a695776c1a64a0aa0e8b4347cc96b9b/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:44.936475 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c70a24-7586-46a2-bfcb-09da4f3c145a admin admin] RBAC: Authorizing `identity:create_grant(project_id=52887096f2b74f7a94bbf14f83847d12, user_id=0a695776c1a64a0aa0e8b4347cc96b9b, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:44.939133 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c70a24-7586-46a2-bfcb-09da4f3c145a admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:44.949614 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1067/2101] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:44 2022] PUT /identity/v3/projects/52887096f2b74f7a94bbf14f83847d12/users/0a695776c1a64a0aa0e8b4347cc96b9b/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:44.959950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa58ea-0dcc-4242-a6b6-696972d22e03 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:44.960249 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa58ea-0dcc-4242-a6b6-696972d22e03 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:44.960550 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa58ea-0dcc-4242-a6b6-696972d22e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:44.987294 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-4daa58ea-0dcc-4242-a6b6-696972d22e03 None None] MFA Rules not processed for user `0a695776c1a64a0aa0e8b4347cc96b9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:44.989150 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-4daa58ea-0dcc-4242-a6b6-696972d22e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:45.061252 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1035/2102] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:45.072819 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c70a24-7586-46a2-bfcb-09da4f3c145a admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:45.074636 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-11c70a24-7586-46a2-bfcb-09da4f3c145a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:45.144280 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c70a24-7586-46a2-bfcb-09da4f3c145a admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:45.148051 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14cbfdb-28df-45f7-a0af-1c66f3638c41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:45.148734 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cbfdb-28df-45f7-a0af-1c66f3638c41 service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:45.149020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cbfdb-28df-45f7-a0af-1c66f3638c41 service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:45.149304 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cbfdb-28df-45f7-a0af-1c66f3638c41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:45.159702 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14cbfdb-28df-45f7-a0af-1c66f3638c41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:45.161694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14cbfdb-28df-45f7-a0af-1c66f3638c41 service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:45.173043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1068/2103] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:45.257002 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa58ea-0dcc-4242-a6b6-696972d22e03 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:45.283402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:45.333442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa58ea-0dcc-4242-a6b6-696972d22e03 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:45.337931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608e340-3ee0-450c-b97b-9c28bf8bb597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:45.338801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608e340-3ee0-450c-b97b-9c28bf8bb597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:45.339079 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608e340-3ee0-450c-b97b-9c28bf8bb597 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:45.339476 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608e340-3ee0-450c-b97b-9c28bf8bb597 admin admin] PATH_INFO: `/v3/users/902d11ac80464b02b557d3c23cce403e` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:45.340797 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608e340-3ee0-450c-b97b-9c28bf8bb597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=902d11ac80464b02b557d3c23cce403e)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:45.342767 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608e340-3ee0-450c-b97b-9c28bf8bb597 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:45.392830 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-1608e340-3ee0-450c-b97b-9c28bf8bb597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '902d11ac80464b02b557d3c23cce403e'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:45.404872 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-1608e340-3ee0-450c-b97b-9c28bf8bb597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '902d11ac80464b02b557d3c23cce403e'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:45.405814 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-1608e340-3ee0-450c-b97b-9c28bf8bb597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '902d11ac80464b02b557d3c23cce403e'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:45.407111 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-1608e340-3ee0-450c-b97b-9c28bf8bb597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '902d11ac80464b02b557d3c23cce403e'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:45.427460 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-1608e340-3ee0-450c-b97b-9c28bf8bb597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '902d11ac80464b02b557d3c23cce403e'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:45.447130 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1036/2104] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:52:45 2022] DELETE /identity/v3/users/902d11ac80464b02b557d3c23cce403e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:45.452854 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2086f2-c5ad-4a4d-8d55-0b9ad58dd1d9 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:45.453388 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2086f2-c5ad-4a4d-8d55-0b9ad58dd1d9 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:45.453916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2086f2-c5ad-4a4d-8d55-0b9ad58dd1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:45.491382 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-bf2086f2-c5ad-4a4d-8d55-0b9ad58dd1d9 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:45.493485 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-bf2086f2-c5ad-4a4d-8d55-0b9ad58dd1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:45.583973 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1069/2105] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:45.602003 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608e340-3ee0-450c-b97b-9c28bf8bb597 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:45.604512 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-1608e340-3ee0-450c-b97b-9c28bf8bb597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:45.684466 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608e340-3ee0-450c-b97b-9c28bf8bb597 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:45.688272 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780a31e-966b-470f-b5fe-6a21a3692029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:45.689021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780a31e-966b-470f-b5fe-6a21a3692029 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:45.689374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780a31e-966b-470f-b5fe-6a21a3692029 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:45.689720 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780a31e-966b-470f-b5fe-6a21a3692029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:45.703439 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780a31e-966b-470f-b5fe-6a21a3692029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:45.705537 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780a31e-966b-470f-b5fe-6a21a3692029 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:45.718785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1037/2106] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:46.280313 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2086f2-c5ad-4a4d-8d55-0b9ad58dd1d9 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:46.280313 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-bf2086f2-c5ad-4a4d-8d55-0b9ad58dd1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:46.296364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2086f2-c5ad-4a4d-8d55-0b9ad58dd1d9 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:46.312807 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073bc60-229e-4159-a137-78f03fdcc550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:46.316121 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073bc60-229e-4159-a137-78f03fdcc550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:46.316121 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073bc60-229e-4159-a137-78f03fdcc550 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:46.316121 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073bc60-229e-4159-a137-78f03fdcc550 admin admin] PATH_INFO: `/v3/projects/35d7c25c2e2644ce9d1a591e97a95a02` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:46.324501 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073bc60-229e-4159-a137-78f03fdcc550 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35d7c25c2e2644ce9d1a591e97a95a02)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:46.326681 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073bc60-229e-4159-a137-78f03fdcc550 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:46.377035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:46.396599 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b073bc60-229e-4159-a137-78f03fdcc550 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35d7c25c2e2644ce9d1a591e97a95a02', 'request_id': 'req-b073bc60-229e-4159-a137-78f03fdcc550'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:46.404207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b073bc60-229e-4159-a137-78f03fdcc550 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35d7c25c2e2644ce9d1a591e97a95a02', 'request_id': 'req-b073bc60-229e-4159-a137-78f03fdcc550'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:46.414601 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b073bc60-229e-4159-a137-78f03fdcc550 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35d7c25c2e2644ce9d1a591e97a95a02', 'request_id': 'req-b073bc60-229e-4159-a137-78f03fdcc550'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:46.428557 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b073bc60-229e-4159-a137-78f03fdcc550 admin admin] The token cache is being invalidate because project 35d7c25c2e2644ce9d1a591e97a95a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:46.428852 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b073bc60-229e-4159-a137-78f03fdcc550 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:46.429572 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b073bc60-229e-4159-a137-78f03fdcc550 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:46.431192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1070/2107] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:46 2022] DELETE /identity/v3/projects/35d7c25c2e2644ce9d1a591e97a95a02 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:46.436256 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780a31e-966b-470f-b5fe-6a21a3692029 service neutron] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:46.446688 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780a31e-966b-470f-b5fe-6a21a3692029 service neutron] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:46.486160 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:46.514512 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb0d99-fdbe-4bde-9758-484d578974f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:46.515397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb0d99-fdbe-4bde-9758-484d578974f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:46.515683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb0d99-fdbe-4bde-9758-484d578974f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:46.515954 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb0d99-fdbe-4bde-9758-484d578974f2 admin admin] PATH_INFO: `/v3/users/0a695776c1a64a0aa0e8b4347cc96b9b` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:46.517190 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb0d99-fdbe-4bde-9758-484d578974f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a695776c1a64a0aa0e8b4347cc96b9b)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:46.519157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb0d99-fdbe-4bde-9758-484d578974f2 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:46.573104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a1eb0d99-fdbe-4bde-9758-484d578974f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a695776c1a64a0aa0e8b4347cc96b9b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:46.580269 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a1eb0d99-fdbe-4bde-9758-484d578974f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a695776c1a64a0aa0e8b4347cc96b9b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:46.581015 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a1eb0d99-fdbe-4bde-9758-484d578974f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a695776c1a64a0aa0e8b4347cc96b9b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:46.581662 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a1eb0d99-fdbe-4bde-9758-484d578974f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a695776c1a64a0aa0e8b4347cc96b9b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:46.594513 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a1eb0d99-fdbe-4bde-9758-484d578974f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a695776c1a64a0aa0e8b4347cc96b9b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:46.609754 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1038/2108] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:52:46 2022] DELETE /identity/v3/users/0a695776c1a64a0aa0e8b4347cc96b9b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:52:46.986689 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073bc60-229e-4159-a137-78f03fdcc550 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:46.988437 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-b073bc60-229e-4159-a137-78f03fdcc550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:47.002708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073bc60-229e-4159-a137-78f03fdcc550 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:47.087664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa429aa-fae7-412b-9c7f-87b34977307e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:47.088549 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa429aa-fae7-412b-9c7f-87b34977307e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:47.088839 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa429aa-fae7-412b-9c7f-87b34977307e admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:47.089106 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa429aa-fae7-412b-9c7f-87b34977307e admin admin] PATH_INFO: `/v3/projects/52887096f2b74f7a94bbf14f83847d12` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:47.091037 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa429aa-fae7-412b-9c7f-87b34977307e admin admin] RBAC: Authorizing `identity:delete_project(project_id=52887096f2b74f7a94bbf14f83847d12)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:47.093229 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa429aa-fae7-412b-9c7f-87b34977307e admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:47.150810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-7fa429aa-fae7-412b-9c7f-87b34977307e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52887096f2b74f7a94bbf14f83847d12', 'request_id': 'req-7fa429aa-fae7-412b-9c7f-87b34977307e'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:47.157423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-7fa429aa-fae7-412b-9c7f-87b34977307e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52887096f2b74f7a94bbf14f83847d12', 'request_id': 'req-7fa429aa-fae7-412b-9c7f-87b34977307e'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:47.165196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-7fa429aa-fae7-412b-9c7f-87b34977307e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52887096f2b74f7a94bbf14f83847d12', 'request_id': 'req-7fa429aa-fae7-412b-9c7f-87b34977307e'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:47.176086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-7fa429aa-fae7-412b-9c7f-87b34977307e admin admin] The token cache is being invalidate because project 52887096f2b74f7a94bbf14f83847d12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:47.176502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-7fa429aa-fae7-412b-9c7f-87b34977307e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:47.177384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-7fa429aa-fae7-412b-9c7f-87b34977307e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:47.179153 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1071/2109] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:46 2022] DELETE /identity/v3/projects/52887096f2b74f7a94bbf14f83847d12 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:47.184129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a755b8a-354b-41f4-8fc9-d35194b57cac None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:47.184423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a755b8a-354b-41f4-8fc9-d35194b57cac None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:47.184712 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a755b8a-354b-41f4-8fc9-d35194b57cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:47.203621 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-4a755b8a-354b-41f4-8fc9-d35194b57cac None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:47.204841 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-4a755b8a-354b-41f4-8fc9-d35194b57cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:47.264978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1039/2110] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:47.273779 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcc3ef-1f62-4c63-85d1-8ecfa84d44a7 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:47.274035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcc3ef-1f62-4c63-85d1-8ecfa84d44a7 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:47.274316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcc3ef-1f62-4c63-85d1-8ecfa84d44a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:47.293480 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-58fcc3ef-1f62-4c63-85d1-8ecfa84d44a7 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:47.294740 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-58fcc3ef-1f62-4c63-85d1-8ecfa84d44a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:47.308877 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1072/2111] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:47.318373 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a755b8a-354b-41f4-8fc9-d35194b57cac None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:47.328385 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a755b8a-354b-41f4-8fc9-d35194b57cac None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:47.339488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6f4f8-7f7e-41bc-be3e-d94d51c2b7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:47.340184 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6f4f8-7f7e-41bc-be3e-d94d51c2b7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:47.340475 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6f4f8-7f7e-41bc-be3e-d94d51c2b7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:47.340760 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6f4f8-7f7e-41bc-be3e-d94d51c2b7d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:47.341510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6f4f8-7f7e-41bc-be3e-d94d51c2b7d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:52:47.341825 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6f4f8-7f7e-41bc-be3e-d94d51c2b7d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:47.343518 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6f4f8-7f7e-41bc-be3e-d94d51c2b7d0 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:47.361967 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1040/2112] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:52:47.366872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcc3ef-1f62-4c63-85d1-8ecfa84d44a7 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:47.377016 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcc3ef-1f62-4c63-85d1-8ecfa84d44a7 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:47.383882 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa333f-1423-42c5-be14-eba34accb917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:47.384552 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa333f-1423-42c5-be14-eba34accb917 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:47.384833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa333f-1423-42c5-be14-eba34accb917 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:47.385110 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa333f-1423-42c5-be14-eba34accb917 admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:47.385819 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa333f-1423-42c5-be14-eba34accb917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:47.387781 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa333f-1423-42c5-be14-eba34accb917 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:47.416571 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1073/2113] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:52:47 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:52:47.420878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6f4f8-7f7e-41bc-be3e-d94d51c2b7d0 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:47.431720 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6f4f8-7f7e-41bc-be3e-d94d51c2b7d0 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:47.490819 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:47.508391 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ba137-5ae4-41c2-b192-d99e1ffac5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:47.509069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ba137-5ae4-41c2-b192-d99e1ffac5ac admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:47.509358 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ba137-5ae4-41c2-b192-d99e1ffac5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:47.509631 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ba137-5ae4-41c2-b192-d99e1ffac5ac admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:47.510363 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ba137-5ae4-41c2-b192-d99e1ffac5ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:47.512261 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ba137-5ae4-41c2-b192-d99e1ffac5ac admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:47.535073 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1041/2114] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:52:47 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:47.539305 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa333f-1423-42c5-be14-eba34accb917 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:47.550267 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa333f-1423-42c5-be14-eba34accb917 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:47.555659 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7c7b0-3c9c-4fa4-a4e8-338b533231f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:47.556322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7c7b0-3c9c-4fa4-a4e8-338b533231f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:47.556610 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7c7b0-3c9c-4fa4-a4e8-338b533231f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:47.556891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7c7b0-3c9c-4fa4-a4e8-338b533231f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:47.557626 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7c7b0-3c9c-4fa4-a4e8-338b533231f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:47.559288 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7c7b0-3c9c-4fa4-a4e8-338b533231f0 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:47.571732 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1074/2115] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:47.576257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ba137-5ae4-41c2-b192-d99e1ffac5ac admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:47.586907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ba137-5ae4-41c2-b192-d99e1ffac5ac admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:47.592040 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94399b96-26da-4d62-90f9-f074133c5344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:47.592768 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94399b96-26da-4d62-90f9-f074133c5344 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:47.593145 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94399b96-26da-4d62-90f9-f074133c5344 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:47.593510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94399b96-26da-4d62-90f9-f074133c5344 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:47.594446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94399b96-26da-4d62-90f9-f074133c5344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:47.596170 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94399b96-26da-4d62-90f9-f074133c5344 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:47.609001 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1042/2116] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:47.614010 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7c7b0-3c9c-4fa4-a4e8-338b533231f0 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:47.624326 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7c7b0-3c9c-4fa4-a4e8-338b533231f0 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:47.630298 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46edf1a-3376-49c2-ab19-546ff4e6d3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:47.631434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46edf1a-3376-49c2-ab19-546ff4e6d3b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:47.631652 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46edf1a-3376-49c2-ab19-546ff4e6d3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:47.632243 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46edf1a-3376-49c2-ab19-546ff4e6d3b7 admin admin] PATH_INFO: `/v3/projects/e1f30c606ae34874a48158557bcaaf82/users/7e1d77e8083640e98bd2a64c118eafaf/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:47.640948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:47.649424 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46edf1a-3376-49c2-ab19-546ff4e6d3b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1f30c606ae34874a48158557bcaaf82, user_id=7e1d77e8083640e98bd2a64c118eafaf, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:47.652755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46edf1a-3376-49c2-ab19-546ff4e6d3b7 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:47.667559 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1075/2117] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:47 2022] PUT /identity/v3/projects/e1f30c606ae34874a48158557bcaaf82/users/7e1d77e8083640e98bd2a64c118eafaf/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:47.679580 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0b90a-0d26-4cf1-ba93-28a4d8a65afb None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:47.679899 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0b90a-0d26-4cf1-ba93-28a4d8a65afb None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:47.680131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0b90a-0d26-4cf1-ba93-28a4d8a65afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:47.718653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-61a0b90a-0d26-4cf1-ba93-28a4d8a65afb None None] MFA Rules not processed for user `7e1d77e8083640e98bd2a64c118eafaf`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:47.719750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-61a0b90a-0d26-4cf1-ba93-28a4d8a65afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:47.804871 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1043/2118] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:52:47.809546 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46edf1a-3376-49c2-ab19-546ff4e6d3b7 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:47.889136 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46edf1a-3376-49c2-ab19-546ff4e6d3b7 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:47.894478 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f60184-bb37-4f14-9764-bb7db84b241e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:47.895378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f60184-bb37-4f14-9764-bb7db84b241e admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:47.895891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f60184-bb37-4f14-9764-bb7db84b241e admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:47.896236 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f60184-bb37-4f14-9764-bb7db84b241e admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:47.897000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f60184-bb37-4f14-9764-bb7db84b241e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:47.899016 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f60184-bb37-4f14-9764-bb7db84b241e admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:47.927118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1076/2119] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:52:47 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:47.931508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0b90a-0d26-4cf1-ba93-28a4d8a65afb None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:47.943353 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0b90a-0d26-4cf1-ba93-28a4d8a65afb None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:48.002952 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93eabd-5f59-4fec-9b0f-cbd40ce1e968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:48.003633 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93eabd-5f59-4fec-9b0f-cbd40ce1e968 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:48.004091 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93eabd-5f59-4fec-9b0f-cbd40ce1e968 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:48.004387 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93eabd-5f59-4fec-9b0f-cbd40ce1e968 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:48.005089 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93eabd-5f59-4fec-9b0f-cbd40ce1e968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:48.007062 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93eabd-5f59-4fec-9b0f-cbd40ce1e968 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:48.030539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1044/2120] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:52:47 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:48.037062 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f60184-bb37-4f14-9764-bb7db84b241e admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:48.048424 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f60184-bb37-4f14-9764-bb7db84b241e admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:48.054067 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdb4af-24dd-43e1-bf0b-14f52b221490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:48.054747 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdb4af-24dd-43e1-bf0b-14f52b221490 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:48.055036 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdb4af-24dd-43e1-bf0b-14f52b221490 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:48.056743 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdb4af-24dd-43e1-bf0b-14f52b221490 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:48.056743 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdb4af-24dd-43e1-bf0b-14f52b221490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:48.057727 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdb4af-24dd-43e1-bf0b-14f52b221490 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:48.071851 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1077/2121] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:48.075501 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93eabd-5f59-4fec-9b0f-cbd40ce1e968 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:48.086027 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93eabd-5f59-4fec-9b0f-cbd40ce1e968 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:48.091092 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea580f-63f4-40bc-bac7-9903d775de3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:48.092129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea580f-63f4-40bc-bac7-9903d775de3b admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:48.092518 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea580f-63f4-40bc-bac7-9903d775de3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:48.092901 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea580f-63f4-40bc-bac7-9903d775de3b admin admin] PATH_INFO: `/v3/projects/641945edd430417f8055afdd9cdcb798/users/02b704037f434a8f97ddae7ef49eedae/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:48.116681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea580f-63f4-40bc-bac7-9903d775de3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=641945edd430417f8055afdd9cdcb798, user_id=02b704037f434a8f97ddae7ef49eedae, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:48.119590 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea580f-63f4-40bc-bac7-9903d775de3b admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:48.137266 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1045/2122] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:48 2022] PUT /identity/v3/projects/641945edd430417f8055afdd9cdcb798/users/02b704037f434a8f97ddae7ef49eedae/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:52:48.141495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdb4af-24dd-43e1-bf0b-14f52b221490 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:48.153106 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdb4af-24dd-43e1-bf0b-14f52b221490 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:48.229466 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b80d8-fbd8-4d70-bb42-7fc7676a64d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:48.230285 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b80d8-fbd8-4d70-bb42-7fc7676a64d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:48.230465 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b80d8-fbd8-4d70-bb42-7fc7676a64d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:48.230745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b80d8-fbd8-4d70-bb42-7fc7676a64d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:48.231482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b80d8-fbd8-4d70-bb42-7fc7676a64d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:48.233120 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b80d8-fbd8-4d70-bb42-7fc7676a64d9 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:48.245830 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1078/2123] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:48.250281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea580f-63f4-40bc-bac7-9903d775de3b admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:48.261346 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea580f-63f4-40bc-bac7-9903d775de3b admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:48.266610 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8a88a-2fa2-4751-9234-d377972dfd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:48.267532 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8a88a-2fa2-4751-9234-d377972dfd9b admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:48.267817 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8a88a-2fa2-4751-9234-d377972dfd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:48.268097 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8a88a-2fa2-4751-9234-d377972dfd9b admin admin] PATH_INFO: `/v3/projects/641945edd430417f8055afdd9cdcb798/users/02b704037f434a8f97ddae7ef49eedae/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:48.270722 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8a88a-2fa2-4751-9234-d377972dfd9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=641945edd430417f8055afdd9cdcb798, user_id=02b704037f434a8f97ddae7ef49eedae, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:48.273416 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8a88a-2fa2-4751-9234-d377972dfd9b admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:48.285835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1046/2124] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:48 2022] PUT /identity/v3/projects/641945edd430417f8055afdd9cdcb798/users/02b704037f434a8f97ddae7ef49eedae/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:48.296064 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf492fb-c04c-4228-8d95-c1a6e611fcd9 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:48.296564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf492fb-c04c-4228-8d95-c1a6e611fcd9 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:48.296564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf492fb-c04c-4228-8d95-c1a6e611fcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:48.327640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-6bf492fb-c04c-4228-8d95-c1a6e611fcd9 None None] MFA Rules not processed for user `02b704037f434a8f97ddae7ef49eedae`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:48.328853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-6bf492fb-c04c-4228-8d95-c1a6e611fcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:48.384967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:48.411759 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1079/2125] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:48.423755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8a88a-2fa2-4751-9234-d377972dfd9b admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:48.425495 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-83b8a88a-2fa2-4751-9234-d377972dfd9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:48.432571 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:48.486607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8a88a-2fa2-4751-9234-d377972dfd9b admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:48.490295 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37b7ca-2dd2-4171-a223-7af8b18ecada service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:48.491038 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37b7ca-2dd2-4171-a223-7af8b18ecada service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:48.491568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37b7ca-2dd2-4171-a223-7af8b18ecada service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:48.491568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37b7ca-2dd2-4171-a223-7af8b18ecada service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:48.501254 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37b7ca-2dd2-4171-a223-7af8b18ecada service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:48.502727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37b7ca-2dd2-4171-a223-7af8b18ecada service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:48.513418 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1047/2126] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:48.526155 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d26a4-2f18-45d5-9929-a63ee62d5fb8 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:48.526522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d26a4-2f18-45d5-9929-a63ee62d5fb8 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:48.527038 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d26a4-2f18-45d5-9929-a63ee62d5fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:48.560727 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-6c4d26a4-2f18-45d5-9929-a63ee62d5fb8 None None] MFA Rules not processed for user `4d4eabecb1e9447ebe2c705623ade25e`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:48.565453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-6c4d26a4-2f18-45d5-9929-a63ee62d5fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:48.630639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1080/2127] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:48.882180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37b7ca-2dd2-4171-a223-7af8b18ecada service cinder] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:48.892152 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37b7ca-2dd2-4171-a223-7af8b18ecada service cinder] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:48.898266 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3a1c2-aa47-4d50-aa1f-1e2d496c2b22 tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02b704037f434a8f97ddae7ef49eedae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '641945edd430417f8055afdd9cdcb798', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:48.899221 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3a1c2-aa47-4d50-aa1f-1e2d496c2b22 tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:48.899650 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3a1c2-aa47-4d50-aa1f-1e2d496c2b22 tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:48.900009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3a1c2-aa47-4d50-aa1f-1e2d496c2b22 tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:48.900779 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3a1c2-aa47-4d50-aa1f-1e2d496c2b22 tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:52:48.901095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3a1c2-aa47-4d50-aa1f-1e2d496c2b22 tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:48.903309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3a1c2-aa47-4d50-aa1f-1e2d496c2b22 tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:48.919521 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1048/2128] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:52:48.921623 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d26a4-2f18-45d5-9929-a63ee62d5fb8 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:48.934273 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d26a4-2f18-45d5-9929-a63ee62d5fb8 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:48.939385 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184ed3e-a950-4717-a7a1-44e236924a7a tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02b704037f434a8f97ddae7ef49eedae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '641945edd430417f8055afdd9cdcb798', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:48.940174 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184ed3e-a950-4717-a7a1-44e236924a7a tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:48.940428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184ed3e-a950-4717-a7a1-44e236924a7a tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:48.940716 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184ed3e-a950-4717-a7a1-44e236924a7a tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:48.941997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184ed3e-a950-4717-a7a1-44e236924a7a tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:48.943961 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184ed3e-a950-4717-a7a1-44e236924a7a tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:48.982426 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1081/2129] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:52:48 2022] POST /identity/v3/projects => generated 354 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:48.983946 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3a1c2-aa47-4d50-aa1f-1e2d496c2b22 tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:48.995998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3a1c2-aa47-4d50-aa1f-1e2d496c2b22 tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:49.074524 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee96587-7e71-45dd-bb76-b9c3aef5d0d3 tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02b704037f434a8f97ddae7ef49eedae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '641945edd430417f8055afdd9cdcb798', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:49.075140 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee96587-7e71-45dd-bb76-b9c3aef5d0d3 tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:49.075433 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee96587-7e71-45dd-bb76-b9c3aef5d0d3 tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:49.075719 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee96587-7e71-45dd-bb76-b9c3aef5d0d3 tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:49.076469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee96587-7e71-45dd-bb76-b9c3aef5d0d3 tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:52:49.076785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee96587-7e71-45dd-bb76-b9c3aef5d0d3 tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:49.078453 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee96587-7e71-45dd-bb76-b9c3aef5d0d3 tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:49.090729 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1049/2130] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:52:49.130333 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184ed3e-a950-4717-a7a1-44e236924a7a tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:49.141677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184ed3e-a950-4717-a7a1-44e236924a7a tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:49.146970 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462312b-fc48-4f8c-922f-e8cb75ed63fc tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02b704037f434a8f97ddae7ef49eedae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '641945edd430417f8055afdd9cdcb798', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:49.147857 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462312b-fc48-4f8c-922f-e8cb75ed63fc tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:49.148151 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462312b-fc48-4f8c-922f-e8cb75ed63fc tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:49.148464 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462312b-fc48-4f8c-922f-e8cb75ed63fc tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] PATH_INFO: `/v3/projects/d0d46bf28c2940e393f020231ce415cb` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:49.149690 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462312b-fc48-4f8c-922f-e8cb75ed63fc tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d0d46bf28c2940e393f020231ce415cb)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:49.151780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462312b-fc48-4f8c-922f-e8cb75ed63fc tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:49.212925 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1462312b-fc48-4f8c-922f-e8cb75ed63fc tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0d46bf28c2940e393f020231ce415cb', 'request_id': 'req-1462312b-fc48-4f8c-922f-e8cb75ed63fc'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:49.220534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1462312b-fc48-4f8c-922f-e8cb75ed63fc tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0d46bf28c2940e393f020231ce415cb', 'request_id': 'req-1462312b-fc48-4f8c-922f-e8cb75ed63fc'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:49.231361 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1462312b-fc48-4f8c-922f-e8cb75ed63fc tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0d46bf28c2940e393f020231ce415cb', 'request_id': 'req-1462312b-fc48-4f8c-922f-e8cb75ed63fc'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:49.248973 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1462312b-fc48-4f8c-922f-e8cb75ed63fc tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] The token cache is being invalidate because project d0d46bf28c2940e393f020231ce415cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:49.249400 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1462312b-fc48-4f8c-922f-e8cb75ed63fc tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:49.250352 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1462312b-fc48-4f8c-922f-e8cb75ed63fc tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:49.267985 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1082/2131] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:49 2022] DELETE /identity/v3/projects/d0d46bf28c2940e393f020231ce415cb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:49.525678 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee96587-7e71-45dd-bb76-b9c3aef5d0d3 tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:49.530990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-aee96587-7e71-45dd-bb76-b9c3aef5d0d3 tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:49.640104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee96587-7e71-45dd-bb76-b9c3aef5d0d3 tempest-VolumeQuotaClassesTest-1816015443 tempest-VolumeQuotaClassesTest-1816015443-project-admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:49.675343 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:49.702238 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c789b-87bf-4a6f-b310-0f1dd5bc8948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:49.703126 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c789b-87bf-4a6f-b310-0f1dd5bc8948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:49.703414 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c789b-87bf-4a6f-b310-0f1dd5bc8948 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:49.703694 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c789b-87bf-4a6f-b310-0f1dd5bc8948 admin admin] PATH_INFO: `/v3/users/7e1d77e8083640e98bd2a64c118eafaf` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:49.704918 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c789b-87bf-4a6f-b310-0f1dd5bc8948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e1d77e8083640e98bd2a64c118eafaf)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:49.706986 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c789b-87bf-4a6f-b310-0f1dd5bc8948 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:49.773400 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a32c789b-87bf-4a6f-b310-0f1dd5bc8948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e1d77e8083640e98bd2a64c118eafaf'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:49.780890 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a32c789b-87bf-4a6f-b310-0f1dd5bc8948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e1d77e8083640e98bd2a64c118eafaf'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:49.781984 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a32c789b-87bf-4a6f-b310-0f1dd5bc8948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e1d77e8083640e98bd2a64c118eafaf'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:49.782590 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a32c789b-87bf-4a6f-b310-0f1dd5bc8948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e1d77e8083640e98bd2a64c118eafaf'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:49.796094 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a32c789b-87bf-4a6f-b310-0f1dd5bc8948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e1d77e8083640e98bd2a64c118eafaf'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:49.808746 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1050/2132] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:52:49 2022] DELETE /identity/v3/users/7e1d77e8083640e98bd2a64c118eafaf => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:52:49.813324 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088f81a-d11b-4de3-afb5-e846a73b0ef6 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:49.813799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088f81a-d11b-4de3-afb5-e846a73b0ef6 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:49.814166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8088f81a-d11b-4de3-afb5-e846a73b0ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:49.831684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-8088f81a-d11b-4de3-afb5-e846a73b0ef6 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:49.833481 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-8088f81a-d11b-4de3-afb5-e846a73b0ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:49.884548 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:49.901579 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1083/2133] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:49.913023 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c789b-87bf-4a6f-b310-0f1dd5bc8948 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:49.914590 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-a32c789b-87bf-4a6f-b310-0f1dd5bc8948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:49.987232 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c789b-87bf-4a6f-b310-0f1dd5bc8948 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:49.991239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e4896-5a6c-4d7e-abea-c4f13cc363d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:49.991912 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e4896-5a6c-4d7e-abea-c4f13cc363d7 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:49.992201 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e4896-5a6c-4d7e-abea-c4f13cc363d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:49.992479 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e4896-5a6c-4d7e-abea-c4f13cc363d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:50.002995 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e4896-5a6c-4d7e-abea-c4f13cc363d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:50.004507 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e4896-5a6c-4d7e-abea-c4f13cc363d7 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:50.015366 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1051/2134] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:50.306670 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088f81a-d11b-4de3-afb5-e846a73b0ef6 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:50.308452 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-8088f81a-d11b-4de3-afb5-e846a73b0ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:50.328373 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8088f81a-d11b-4de3-afb5-e846a73b0ef6 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:50.340981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98cac2-4c86-4465-8077-27e836ee31a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:50.342079 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98cac2-4c86-4465-8077-27e836ee31a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:50.342715 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98cac2-4c86-4465-8077-27e836ee31a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:50.343225 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98cac2-4c86-4465-8077-27e836ee31a4 admin admin] PATH_INFO: `/v3/projects/e1f30c606ae34874a48158557bcaaf82` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:50.344687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98cac2-4c86-4465-8077-27e836ee31a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1f30c606ae34874a48158557bcaaf82)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:50.346805 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98cac2-4c86-4465-8077-27e836ee31a4 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:50.403431 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-7c98cac2-4c86-4465-8077-27e836ee31a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1f30c606ae34874a48158557bcaaf82', 'request_id': 'req-7c98cac2-4c86-4465-8077-27e836ee31a4'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:50.414785 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-7c98cac2-4c86-4465-8077-27e836ee31a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1f30c606ae34874a48158557bcaaf82', 'request_id': 'req-7c98cac2-4c86-4465-8077-27e836ee31a4'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:50.423355 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-7c98cac2-4c86-4465-8077-27e836ee31a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1f30c606ae34874a48158557bcaaf82', 'request_id': 'req-7c98cac2-4c86-4465-8077-27e836ee31a4'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:50.436602 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-7c98cac2-4c86-4465-8077-27e836ee31a4 admin admin] The token cache is being invalidate because project e1f30c606ae34874a48158557bcaaf82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:50.436892 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-7c98cac2-4c86-4465-8077-27e836ee31a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:50.437824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-7c98cac2-4c86-4465-8077-27e836ee31a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:50.439413 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1084/2135] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:50 2022] DELETE /identity/v3/projects/e1f30c606ae34874a48158557bcaaf82 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:50.444482 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e4896-5a6c-4d7e-abea-c4f13cc363d7 service neutron] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:50.454972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e4896-5a6c-4d7e-abea-c4f13cc363d7 service neutron] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:50.519631 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:50.526657 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab113521-e988-4d9b-90c3-af65ff7c4024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:50.527542 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab113521-e988-4d9b-90c3-af65ff7c4024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:50.528285 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab113521-e988-4d9b-90c3-af65ff7c4024 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:50.528565 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab113521-e988-4d9b-90c3-af65ff7c4024 admin admin] PATH_INFO: `/v3/users/02b704037f434a8f97ddae7ef49eedae` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:50.529943 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab113521-e988-4d9b-90c3-af65ff7c4024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02b704037f434a8f97ddae7ef49eedae)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:50.532598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab113521-e988-4d9b-90c3-af65ff7c4024 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:50.592697 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ab113521-e988-4d9b-90c3-af65ff7c4024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02b704037f434a8f97ddae7ef49eedae'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:50.600477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ab113521-e988-4d9b-90c3-af65ff7c4024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02b704037f434a8f97ddae7ef49eedae'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:50.601272 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ab113521-e988-4d9b-90c3-af65ff7c4024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02b704037f434a8f97ddae7ef49eedae'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:50.601915 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ab113521-e988-4d9b-90c3-af65ff7c4024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02b704037f434a8f97ddae7ef49eedae'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:50.615402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ab113521-e988-4d9b-90c3-af65ff7c4024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02b704037f434a8f97ddae7ef49eedae'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:50.629757 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1052/2136] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:52:50 2022] DELETE /identity/v3/users/02b704037f434a8f97ddae7ef49eedae => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:51.113443 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98cac2-4c86-4465-8077-27e836ee31a4 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:51.116026 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-7c98cac2-4c86-4465-8077-27e836ee31a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:51.134823 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98cac2-4c86-4465-8077-27e836ee31a4 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:51.230490 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74ccba-e0cb-43d2-a608-16a3b4401668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:51.232467 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74ccba-e0cb-43d2-a608-16a3b4401668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:51.233536 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74ccba-e0cb-43d2-a608-16a3b4401668 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:51.234390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74ccba-e0cb-43d2-a608-16a3b4401668 admin admin] PATH_INFO: `/v3/projects/641945edd430417f8055afdd9cdcb798` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:51.236979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74ccba-e0cb-43d2-a608-16a3b4401668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=641945edd430417f8055afdd9cdcb798)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:51.241306 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab74ccba-e0cb-43d2-a608-16a3b4401668 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:51.358745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-ab74ccba-e0cb-43d2-a608-16a3b4401668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '641945edd430417f8055afdd9cdcb798', 'request_id': 'req-ab74ccba-e0cb-43d2-a608-16a3b4401668'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:51.370017 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-ab74ccba-e0cb-43d2-a608-16a3b4401668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '641945edd430417f8055afdd9cdcb798', 'request_id': 'req-ab74ccba-e0cb-43d2-a608-16a3b4401668'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:51.386854 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-ab74ccba-e0cb-43d2-a608-16a3b4401668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '641945edd430417f8055afdd9cdcb798', 'request_id': 'req-ab74ccba-e0cb-43d2-a608-16a3b4401668'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:51.407738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-ab74ccba-e0cb-43d2-a608-16a3b4401668 admin admin] The token cache is being invalidate because project 641945edd430417f8055afdd9cdcb798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:51.408274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-ab74ccba-e0cb-43d2-a608-16a3b4401668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:51.410743 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-ab74ccba-e0cb-43d2-a608-16a3b4401668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:51.414173 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1085/2137] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:51 2022] DELETE /identity/v3/projects/641945edd430417f8055afdd9cdcb798 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:51.421098 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59024e1a-9b0b-408a-9c04-0c58dc8f787f None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:51.421098 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59024e1a-9b0b-408a-9c04-0c58dc8f787f None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:51.421340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59024e1a-9b0b-408a-9c04-0c58dc8f787f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:51.452038 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-59024e1a-9b0b-408a-9c04-0c58dc8f787f None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:51.454124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-59024e1a-9b0b-408a-9c04-0c58dc8f787f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:51.640641 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1053/2138] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:51.648944 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e0e81-af17-44cd-a126-a035ea3ca547 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:51.649244 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e0e81-af17-44cd-a126-a035ea3ca547 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:51.649528 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e0e81-af17-44cd-a126-a035ea3ca547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:51.656611 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:51.672444 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-f33e0e81-af17-44cd-a126-a035ea3ca547 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:51.674583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-f33e0e81-af17-44cd-a126-a035ea3ca547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:51.685561 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1086/2139] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:52:51.690439 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59024e1a-9b0b-408a-9c04-0c58dc8f787f None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:51.700579 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59024e1a-9b0b-408a-9c04-0c58dc8f787f None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:51.705196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7d5b8-f2c2-41d8-aaaa-a57d51056a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:51.705918 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7d5b8-f2c2-41d8-aaaa-a57d51056a2a admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:51.706204 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7d5b8-f2c2-41d8-aaaa-a57d51056a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:51.706484 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7d5b8-f2c2-41d8-aaaa-a57d51056a2a admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:51.707258 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7d5b8-f2c2-41d8-aaaa-a57d51056a2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:52:51.707578 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7d5b8-f2c2-41d8-aaaa-a57d51056a2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:51.709186 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7d5b8-f2c2-41d8-aaaa-a57d51056a2a admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:51.722203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1054/2140] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:52:51.727239 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e0e81-af17-44cd-a126-a035ea3ca547 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:51.741395 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e0e81-af17-44cd-a126-a035ea3ca547 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:51.757496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e820a-a138-48e5-8323-0326e945eead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:51.758203 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e820a-a138-48e5-8323-0326e945eead admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:51.758485 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e820a-a138-48e5-8323-0326e945eead admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:51.758760 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e820a-a138-48e5-8323-0326e945eead admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:51.759463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e820a-a138-48e5-8323-0326e945eead admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:51.762130 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e820a-a138-48e5-8323-0326e945eead admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:51.795797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1087/2141] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:52:51 2022] POST /identity/v3/projects => generated 367 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:51.799965 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7d5b8-f2c2-41d8-aaaa-a57d51056a2a admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:51.813094 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7d5b8-f2c2-41d8-aaaa-a57d51056a2a admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:51.877182 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a966de-c2de-4c4b-a8f5-f0d1313c398d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:51.877923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a966de-c2de-4c4b-a8f5-f0d1313c398d admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:51.878213 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a966de-c2de-4c4b-a8f5-f0d1313c398d admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:51.878677 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a966de-c2de-4c4b-a8f5-f0d1313c398d admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:51.879393 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a966de-c2de-4c4b-a8f5-f0d1313c398d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:51.881321 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a966de-c2de-4c4b-a8f5-f0d1313c398d admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:51.891270 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:51.909297 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1055/2142] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:52:51 2022] POST /identity/v3/users => generated 284 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:51.913912 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e820a-a138-48e5-8323-0326e945eead admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:51.929918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e820a-a138-48e5-8323-0326e945eead admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:51.937358 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36086fc0-5c02-4567-9157-5b825c17bac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:51.938580 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36086fc0-5c02-4567-9157-5b825c17bac7 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:51.938943 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36086fc0-5c02-4567-9157-5b825c17bac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:51.939329 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36086fc0-5c02-4567-9157-5b825c17bac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:51.940349 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36086fc0-5c02-4567-9157-5b825c17bac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:51.942531 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36086fc0-5c02-4567-9157-5b825c17bac7 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:51.958314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1088/2143] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 15:52:51.962409 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a966de-c2de-4c4b-a8f5-f0d1313c398d admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:51.977053 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a966de-c2de-4c4b-a8f5-f0d1313c398d admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:51.983129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c5a29-074e-481d-bb19-a9a79413619f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:51.983812 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c5a29-074e-481d-bb19-a9a79413619f admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:51.984127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c5a29-074e-481d-bb19-a9a79413619f admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:51.984385 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c5a29-074e-481d-bb19-a9a79413619f admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:51.985191 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c5a29-074e-481d-bb19-a9a79413619f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:51.986822 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c5a29-074e-481d-bb19-a9a79413619f admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:52.002797 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1056/2144] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:52.004134 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36086fc0-5c02-4567-9157-5b825c17bac7 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:52.016585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36086fc0-5c02-4567-9157-5b825c17bac7 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:52.022602 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417cbf7-f972-4d19-b0f1-e69d8fce27ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:52.024064 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417cbf7-f972-4d19-b0f1-e69d8fce27ff admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:52.024429 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417cbf7-f972-4d19-b0f1-e69d8fce27ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:52.024798 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417cbf7-f972-4d19-b0f1-e69d8fce27ff admin admin] PATH_INFO: `/v3/projects/ed3a175cf7bf46838e226c9d2ef2de54/users/aa7bad2ad2e0406f98104fbbde521c2a/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:52.059075 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417cbf7-f972-4d19-b0f1-e69d8fce27ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3a175cf7bf46838e226c9d2ef2de54, user_id=aa7bad2ad2e0406f98104fbbde521c2a, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:52.062533 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417cbf7-f972-4d19-b0f1-e69d8fce27ff admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:52.082965 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1089/2145] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:52 2022] PUT /identity/v3/projects/ed3a175cf7bf46838e226c9d2ef2de54/users/aa7bad2ad2e0406f98104fbbde521c2a/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:52:52.094670 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaaa13-6bd8-4f06-8727-2e648526b655 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:52.094965 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaaa13-6bd8-4f06-8727-2e648526b655 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:52.095459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaaa13-6bd8-4f06-8727-2e648526b655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:52.130612 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-1ccaaa13-6bd8-4f06-8727-2e648526b655 None None] MFA Rules not processed for user `aa7bad2ad2e0406f98104fbbde521c2a`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:52.133110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-1ccaaa13-6bd8-4f06-8727-2e648526b655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:52.214458 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1057/2146] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:52.219325 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417cbf7-f972-4d19-b0f1-e69d8fce27ff admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:52.288668 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417cbf7-f972-4d19-b0f1-e69d8fce27ff admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:52.293803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863dea4b-a8bf-4475-82ec-260f73a5bb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:52.294773 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dea4b-a8bf-4475-82ec-260f73a5bb17 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:52.295058 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dea4b-a8bf-4475-82ec-260f73a5bb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:52.295340 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863dea4b-a8bf-4475-82ec-260f73a5bb17 admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:52.296061 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863dea4b-a8bf-4475-82ec-260f73a5bb17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:52.298037 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863dea4b-a8bf-4475-82ec-260f73a5bb17 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:52.329114 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1090/2147] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:52:52 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:52.330360 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccaaa13-6bd8-4f06-8727-2e648526b655 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:52.342892 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccaaa13-6bd8-4f06-8727-2e648526b655 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:52.410793 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ee23a-96d2-4e95-b4bb-46cfebe5c46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:52.411626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ee23a-96d2-4e95-b4bb-46cfebe5c46e admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:52.411911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ee23a-96d2-4e95-b4bb-46cfebe5c46e admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:52.412183 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ee23a-96d2-4e95-b4bb-46cfebe5c46e admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:52.412897 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ee23a-96d2-4e95-b4bb-46cfebe5c46e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:52.414872 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ee23a-96d2-4e95-b4bb-46cfebe5c46e admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:52.438514 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1058/2148] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:52:52 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:52:52.443297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863dea4b-a8bf-4475-82ec-260f73a5bb17 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:52.454649 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863dea4b-a8bf-4475-82ec-260f73a5bb17 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:52.460172 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339e833-79b2-47ec-ac6d-f2ee2d17147c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:52.460857 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339e833-79b2-47ec-ac6d-f2ee2d17147c admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:52.461149 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339e833-79b2-47ec-ac6d-f2ee2d17147c admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:52.461426 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339e833-79b2-47ec-ac6d-f2ee2d17147c admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:52.462270 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339e833-79b2-47ec-ac6d-f2ee2d17147c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:52.464219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339e833-79b2-47ec-ac6d-f2ee2d17147c admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:52.478925 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1091/2149] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:52.483614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ee23a-96d2-4e95-b4bb-46cfebe5c46e admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:52.494469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ee23a-96d2-4e95-b4bb-46cfebe5c46e admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:52.499674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b38ff7-9a5f-4499-adba-e6ed7ecba4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:52.500487 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b38ff7-9a5f-4499-adba-e6ed7ecba4db admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:52.500779 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b38ff7-9a5f-4499-adba-e6ed7ecba4db admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:52.501052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b38ff7-9a5f-4499-adba-e6ed7ecba4db admin admin] PATH_INFO: `/v3/projects/c5aa802758b348ce836ec26c1aa83b5f/users/b3b2e9aa55384dd58ed93f8fb0752868/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:52.518254 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b38ff7-9a5f-4499-adba-e6ed7ecba4db admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5aa802758b348ce836ec26c1aa83b5f, user_id=b3b2e9aa55384dd58ed93f8fb0752868, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:52.521561 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b38ff7-9a5f-4499-adba-e6ed7ecba4db admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:52.536222 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1059/2150] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:52 2022] PUT /identity/v3/projects/c5aa802758b348ce836ec26c1aa83b5f/users/b3b2e9aa55384dd58ed93f8fb0752868/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:52.545439 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339e833-79b2-47ec-ac6d-f2ee2d17147c admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:52.551389 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339e833-79b2-47ec-ac6d-f2ee2d17147c admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:52.626607 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82cd1d-8ff9-4c67-8bd2-bccfffef95d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:52.627442 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82cd1d-8ff9-4c67-8bd2-bccfffef95d8 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:52.627914 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82cd1d-8ff9-4c67-8bd2-bccfffef95d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:52.630504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82cd1d-8ff9-4c67-8bd2-bccfffef95d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:52.631238 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82cd1d-8ff9-4c67-8bd2-bccfffef95d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:52.634622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82cd1d-8ff9-4c67-8bd2-bccfffef95d8 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:52.655765 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1092/2151] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:52.657536 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b38ff7-9a5f-4499-adba-e6ed7ecba4db admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:52.669995 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b38ff7-9a5f-4499-adba-e6ed7ecba4db admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:52.675550 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dffd83-9714-45fb-92f1-082bbdd2e43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:52.676608 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dffd83-9714-45fb-92f1-082bbdd2e43e admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:52.676896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dffd83-9714-45fb-92f1-082bbdd2e43e admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:52.677333 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dffd83-9714-45fb-92f1-082bbdd2e43e admin admin] PATH_INFO: `/v3/projects/c5aa802758b348ce836ec26c1aa83b5f/users/b3b2e9aa55384dd58ed93f8fb0752868/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:52.679665 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dffd83-9714-45fb-92f1-082bbdd2e43e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5aa802758b348ce836ec26c1aa83b5f, user_id=b3b2e9aa55384dd58ed93f8fb0752868, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:52.682508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dffd83-9714-45fb-92f1-082bbdd2e43e admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:52.696625 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1060/2152] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:52 2022] PUT /identity/v3/projects/c5aa802758b348ce836ec26c1aa83b5f/users/b3b2e9aa55384dd58ed93f8fb0752868/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:52.707557 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac77ec-81ad-4d64-b311-b8688078cf0a None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:52.707853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac77ec-81ad-4d64-b311-b8688078cf0a None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:52.708172 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac77ec-81ad-4d64-b311-b8688078cf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:52.729900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:52.748013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-f8ac77ec-81ad-4d64-b311-b8688078cf0a None None] MFA Rules not processed for user `b3b2e9aa55384dd58ed93f8fb0752868`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:52.748013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-f8ac77ec-81ad-4d64-b311-b8688078cf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:52.833573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1093/2153] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:52 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:52.846525 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dffd83-9714-45fb-92f1-082bbdd2e43e admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:52.849349 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-a3dffd83-9714-45fb-92f1-082bbdd2e43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:52.888152 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:52.931786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dffd83-9714-45fb-92f1-082bbdd2e43e admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:52.936230 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de8fc4-6303-425f-abb1-bdf2ca4d3a66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:52.937030 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de8fc4-6303-425f-abb1-bdf2ca4d3a66 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:52.937434 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de8fc4-6303-425f-abb1-bdf2ca4d3a66 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:52.937818 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de8fc4-6303-425f-abb1-bdf2ca4d3a66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:52.949049 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de8fc4-6303-425f-abb1-bdf2ca4d3a66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:52.950725 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63de8fc4-6303-425f-abb1-bdf2ca4d3a66 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:52.962418 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1061/2154] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:52 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:53.052103 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac77ec-81ad-4d64-b311-b8688078cf0a None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:53.062520 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac77ec-81ad-4d64-b311-b8688078cf0a None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:53.067043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee7020-c76c-4d27-aa41-9c9a4deedb15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:53.067703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee7020-c76c-4d27-aa41-9c9a4deedb15 service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:53.067989 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee7020-c76c-4d27-aa41-9c9a4deedb15 service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:53.068273 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee7020-c76c-4d27-aa41-9c9a4deedb15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:53.141048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee7020-c76c-4d27-aa41-9c9a4deedb15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:53.142577 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee7020-c76c-4d27-aa41-9c9a4deedb15 service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:53.155583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1094/2155] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:53 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:53.373958 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f58bf9-da1e-4b11-ba3f-0162666a6c7e None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:53.374731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f58bf9-da1e-4b11-ba3f-0162666a6c7e None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:53.375169 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f58bf9-da1e-4b11-ba3f-0162666a6c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:53.400639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-a5f58bf9-da1e-4b11-ba3f-0162666a6c7e None None] MFA Rules not processed for user `dbf2c12174e94e2db9be178973183ced`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:53.402168 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-a5f58bf9-da1e-4b11-ba3f-0162666a6c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:53.533819 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1062/2156] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 23 15:52:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:52:53.595064 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee7020-c76c-4d27-aa41-9c9a4deedb15 service cinder] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:53.596707 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-82ee7020-c76c-4d27-aa41-9c9a4deedb15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:53.675796 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee7020-c76c-4d27-aa41-9c9a4deedb15 service cinder] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:53.681122 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd05d5-130e-4396-aa7a-9a3e3d361f9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5824ee17e276483faf20db88a93545f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:53.681911 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd05d5-130e-4396-aa7a-9a3e3d361f9b service swift] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:53.682201 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd05d5-130e-4396-aa7a-9a3e3d361f9b service swift] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:53.682478 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd05d5-130e-4396-aa7a-9a3e3d361f9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:53.691612 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd05d5-130e-4396-aa7a-9a3e3d361f9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:53.693228 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd05d5-130e-4396-aa7a-9a3e3d361f9b service swift] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:53.701799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1095/2157] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 23 15:52:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 15:52:54.292699 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09e874-a135-492d-b9e1-ddaad02d6472 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:54.293192 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09e874-a135-492d-b9e1-ddaad02d6472 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:54.293294 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09e874-a135-492d-b9e1-ddaad02d6472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:54.312832 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-3f09e874-a135-492d-b9e1-ddaad02d6472 None None] MFA Rules not processed for user `dbf2c12174e94e2db9be178973183ced`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:54.314102 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-3f09e874-a135-492d-b9e1-ddaad02d6472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:54.321996 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1063/2158] 10.222.0.15 () {58 vars in 967 bytes} [Thu Jun 23 15:52:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:54.335770 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd05d5-130e-4396-aa7a-9a3e3d361f9b service swift] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:54.347369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd05d5-130e-4396-aa7a-9a3e3d361f9b service swift] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:54.353252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02ca72-e145-4b5e-bbdf-eb38b52b7621 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5824ee17e276483faf20db88a93545f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:54.353972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02ca72-e145-4b5e-bbdf-eb38b52b7621 service swift] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:54.354269 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02ca72-e145-4b5e-bbdf-eb38b52b7621 service swift] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:54.354557 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02ca72-e145-4b5e-bbdf-eb38b52b7621 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:54.364636 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02ca72-e145-4b5e-bbdf-eb38b52b7621 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:54.366325 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02ca72-e145-4b5e-bbdf-eb38b52b7621 service swift] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:54.375565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1096/2159] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 23 15:52:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 15:52:54.640828 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fa894-c6b6-4a73-b201-fd281c065c2c None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:54.641119 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fa894-c6b6-4a73-b201-fd281c065c2c None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:54.641406 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fa894-c6b6-4a73-b201-fd281c065c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:54.663234 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-4b6fa894-c6b6-4a73-b201-fd281c065c2c None None] MFA Rules not processed for user `dbf2c12174e94e2db9be178973183ced`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:54.664534 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-4b6fa894-c6b6-4a73-b201-fd281c065c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:54.672142 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1064/2160] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 23 15:52:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:54.685608 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02ca72-e145-4b5e-bbdf-eb38b52b7621 service swift] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:54.697473 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02ca72-e145-4b5e-bbdf-eb38b52b7621 service swift] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:54.702769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34d55b-1ed8-4448-a47b-2f243da7ebfe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5824ee17e276483faf20db88a93545f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:54.703453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34d55b-1ed8-4448-a47b-2f243da7ebfe service swift] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:54.703744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34d55b-1ed8-4448-a47b-2f243da7ebfe service swift] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:54.704028 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34d55b-1ed8-4448-a47b-2f243da7ebfe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:54.710548 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:54.713632 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34d55b-1ed8-4448-a47b-2f243da7ebfe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:54.715397 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34d55b-1ed8-4448-a47b-2f243da7ebfe service swift] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:54.726055 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1097/2161] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 23 15:52:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 15:52:55.138723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fa894-c6b6-4a73-b201-fd281c065c2c None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:55.140199 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-4b6fa894-c6b6-4a73-b201-fd281c065c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:55.157666 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98980d-3ac0-4097-ae18-6a283de2e28e None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:55.157997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98980d-3ac0-4097-ae18-6a283de2e28e None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:55.158283 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98980d-3ac0-4097-ae18-6a283de2e28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:55.188934 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-7b98980d-3ac0-4097-ae18-6a283de2e28e None None] MFA Rules not processed for user `dbf2c12174e94e2db9be178973183ced`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:55.190312 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-7b98980d-3ac0-4097-ae18-6a283de2e28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:55.198983 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1098/2162] 10.222.0.15 () {58 vars in 967 bytes} [Thu Jun 23 15:52:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:52:55.214604 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98980d-3ac0-4097-ae18-6a283de2e28e None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:55.221607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fa894-c6b6-4a73-b201-fd281c065c2c None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:55.226981 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8b3da-5568-4380-911d-6cf66175fa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:55.228059 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98980d-3ac0-4097-ae18-6a283de2e28e None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:55.228266 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8b3da-5568-4380-911d-6cf66175fa0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:55.228560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8b3da-5568-4380-911d-6cf66175fa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:55.228841 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8b3da-5568-4380-911d-6cf66175fa0c admin admin] PATH_INFO: `/v3/users/f2c974301b4f415285b6761316a6d8f8` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:55.230170 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8b3da-5568-4380-911d-6cf66175fa0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2c974301b4f415285b6761316a6d8f8)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:55.232106 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8b3da-5568-4380-911d-6cf66175fa0c admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:55.233368 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4989158-d39b-4dd9-a3a9-51aa16251e9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5824ee17e276483faf20db88a93545f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:55.234262 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4989158-d39b-4dd9-a3a9-51aa16251e9e service swift] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:55.234554 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4989158-d39b-4dd9-a3a9-51aa16251e9e service swift] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:55.234831 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4989158-d39b-4dd9-a3a9-51aa16251e9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:55.246242 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4989158-d39b-4dd9-a3a9-51aa16251e9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:55.247930 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4989158-d39b-4dd9-a3a9-51aa16251e9e service swift] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:55.258071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1099/2163] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 23 15:52:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 15:52:55.294334 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-12e8b3da-5568-4380-911d-6cf66175fa0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2c974301b4f415285b6761316a6d8f8'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:55.304082 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-12e8b3da-5568-4380-911d-6cf66175fa0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2c974301b4f415285b6761316a6d8f8'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:55.304965 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-12e8b3da-5568-4380-911d-6cf66175fa0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2c974301b4f415285b6761316a6d8f8'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:55.305987 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-12e8b3da-5568-4380-911d-6cf66175fa0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2c974301b4f415285b6761316a6d8f8'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:55.313308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:55.330190 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-12e8b3da-5568-4380-911d-6cf66175fa0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2c974301b4f415285b6761316a6d8f8'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:55.352130 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1065/2164] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:52:55 2022] DELETE /identity/v3/users/f2c974301b4f415285b6761316a6d8f8 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:52:55.358439 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88281b-13bc-4814-99ea-39a3ac2737b5 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:55.359076 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88281b-13bc-4814-99ea-39a3ac2737b5 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:55.359455 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88281b-13bc-4814-99ea-39a3ac2737b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:55.388616 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-fd88281b-13bc-4814-99ea-39a3ac2737b5 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:55.390108 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-fd88281b-13bc-4814-99ea-39a3ac2737b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:55.463885 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1100/2165] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:55.475311 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8b3da-5568-4380-911d-6cf66175fa0c admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:55.476810 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-12e8b3da-5568-4380-911d-6cf66175fa0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:55.551218 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8b3da-5568-4380-911d-6cf66175fa0c admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:55.554952 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc1e31-7d0e-4c55-b816-6e958dd7ace8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:55.555608 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc1e31-7d0e-4c55-b816-6e958dd7ace8 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:55.555896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc1e31-7d0e-4c55-b816-6e958dd7ace8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:55.556177 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc1e31-7d0e-4c55-b816-6e958dd7ace8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:55.571336 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc1e31-7d0e-4c55-b816-6e958dd7ace8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:55.573131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc1e31-7d0e-4c55-b816-6e958dd7ace8 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:55.584639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1066/2166] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:55.951061 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88281b-13bc-4814-99ea-39a3ac2737b5 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:55.953514 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-fd88281b-13bc-4814-99ea-39a3ac2737b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:55.991995 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88281b-13bc-4814-99ea-39a3ac2737b5 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:56.000055 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8f2aa-ee3b-4fda-9f50-80d85ce07bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:56.001689 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8f2aa-ee3b-4fda-9f50-80d85ce07bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:56.002030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8f2aa-ee3b-4fda-9f50-80d85ce07bce admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:56.002334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8f2aa-ee3b-4fda-9f50-80d85ce07bce admin admin] PATH_INFO: `/v3/projects/8f5f1587a4054a93b86bb2cac3f55cb6` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:56.004864 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8f2aa-ee3b-4fda-9f50-80d85ce07bce admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f5f1587a4054a93b86bb2cac3f55cb6)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:56.007939 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8f2aa-ee3b-4fda-9f50-80d85ce07bce admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:56.080097 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-e6f8f2aa-ee3b-4fda-9f50-80d85ce07bce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f5f1587a4054a93b86bb2cac3f55cb6', 'request_id': 'req-e6f8f2aa-ee3b-4fda-9f50-80d85ce07bce'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:56.092616 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-e6f8f2aa-ee3b-4fda-9f50-80d85ce07bce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f5f1587a4054a93b86bb2cac3f55cb6', 'request_id': 'req-e6f8f2aa-ee3b-4fda-9f50-80d85ce07bce'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:56.100252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-e6f8f2aa-ee3b-4fda-9f50-80d85ce07bce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f5f1587a4054a93b86bb2cac3f55cb6', 'request_id': 'req-e6f8f2aa-ee3b-4fda-9f50-80d85ce07bce'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:56.115678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-e6f8f2aa-ee3b-4fda-9f50-80d85ce07bce admin admin] The token cache is being invalidate because project 8f5f1587a4054a93b86bb2cac3f55cb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:56.115978 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-e6f8f2aa-ee3b-4fda-9f50-80d85ce07bce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:56.116670 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-e6f8f2aa-ee3b-4fda-9f50-80d85ce07bce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:56.118438 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1101/2167] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:55 2022] DELETE /identity/v3/projects/8f5f1587a4054a93b86bb2cac3f55cb6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:52:56.123353 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c0243-acd2-4ca7-bf02-d68ed7b0cc43 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:56.123650 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c0243-acd2-4ca7-bf02-d68ed7b0cc43 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:56.123944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c0243-acd2-4ca7-bf02-d68ed7b0cc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:56.150887 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-b74c0243-acd2-4ca7-bf02-d68ed7b0cc43 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:56.152818 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-b74c0243-acd2-4ca7-bf02-d68ed7b0cc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:56.226956 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1067/2168] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:56.239413 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e64bf-e081-4b65-af9b-9a4c164c5ccd None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:56.239766 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e64bf-e081-4b65-af9b-9a4c164c5ccd None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:56.239932 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e64bf-e081-4b65-af9b-9a4c164c5ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:56.264040 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-e75e64bf-e081-4b65-af9b-9a4c164c5ccd None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:56.265260 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e75e64bf-e081-4b65-af9b-9a4c164c5ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:56.274387 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1102/2169] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:56.279418 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c0243-acd2-4ca7-bf02-d68ed7b0cc43 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:56.291421 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c0243-acd2-4ca7-bf02-d68ed7b0cc43 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:56.301791 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc67c0-2757-477a-aa4e-5c0e1dd6f210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:56.303154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc67c0-2757-477a-aa4e-5c0e1dd6f210 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:56.303489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc67c0-2757-477a-aa4e-5c0e1dd6f210 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:56.303732 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc67c0-2757-477a-aa4e-5c0e1dd6f210 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:56.304704 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc67c0-2757-477a-aa4e-5c0e1dd6f210 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:52:56.305022 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc67c0-2757-477a-aa4e-5c0e1dd6f210 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:56.307347 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc67c0-2757-477a-aa4e-5c0e1dd6f210 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:56.321190 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1068/2170] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:52:56.327842 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e64bf-e081-4b65-af9b-9a4c164c5ccd None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:56.346295 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e64bf-e081-4b65-af9b-9a4c164c5ccd None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:56.355791 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c544a-b656-4adf-ab1c-2a20d17a2c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:56.357235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c544a-b656-4adf-ab1c-2a20d17a2c36 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:56.357779 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c544a-b656-4adf-ab1c-2a20d17a2c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:56.358517 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c544a-b656-4adf-ab1c-2a20d17a2c36 admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:56.359804 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c544a-b656-4adf-ab1c-2a20d17a2c36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:56.363925 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c544a-b656-4adf-ab1c-2a20d17a2c36 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:56.405701 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1103/2171] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:52:56 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:56.411339 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc67c0-2757-477a-aa4e-5c0e1dd6f210 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:56.428422 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc67c0-2757-477a-aa4e-5c0e1dd6f210 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:56.524625 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86952e01-a0c8-4dbb-8c88-e7616a9ddd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:56.526016 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86952e01-a0c8-4dbb-8c88-e7616a9ddd3b admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:56.526397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86952e01-a0c8-4dbb-8c88-e7616a9ddd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:56.526895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86952e01-a0c8-4dbb-8c88-e7616a9ddd3b admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:56.527841 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86952e01-a0c8-4dbb-8c88-e7616a9ddd3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:56.530926 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86952e01-a0c8-4dbb-8c88-e7616a9ddd3b admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:56.567821 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1069/2172] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:52:56 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:52:56.571792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:56.576804 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c544a-b656-4adf-ab1c-2a20d17a2c36 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:56.603771 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c544a-b656-4adf-ab1c-2a20d17a2c36 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:56.617380 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca6d9b-56c7-4b0f-8b73-fb71f1524a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:56.619814 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca6d9b-56c7-4b0f-8b73-fb71f1524a27 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:56.620385 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca6d9b-56c7-4b0f-8b73-fb71f1524a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:56.620862 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca6d9b-56c7-4b0f-8b73-fb71f1524a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:56.622413 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca6d9b-56c7-4b0f-8b73-fb71f1524a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:56.625604 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca6d9b-56c7-4b0f-8b73-fb71f1524a27 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:56.662168 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1104/2173] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:56.667169 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86952e01-a0c8-4dbb-8c88-e7616a9ddd3b admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:56.696675 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86952e01-a0c8-4dbb-8c88-e7616a9ddd3b admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:56.709489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973ad93-dbe5-48b3-9549-458a91431b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:56.712428 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973ad93-dbe5-48b3-9549-458a91431b02 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:56.713360 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973ad93-dbe5-48b3-9549-458a91431b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:56.714151 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973ad93-dbe5-48b3-9549-458a91431b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:56.716436 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973ad93-dbe5-48b3-9549-458a91431b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:56.719985 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973ad93-dbe5-48b3-9549-458a91431b02 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:56.751525 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1070/2174] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:52:56.752110 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca6d9b-56c7-4b0f-8b73-fb71f1524a27 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:56.776941 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca6d9b-56c7-4b0f-8b73-fb71f1524a27 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:56.789312 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e22afb-9eaa-4a7a-99d8-31567d36a0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:56.791865 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e22afb-9eaa-4a7a-99d8-31567d36a0ad admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:56.793007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e22afb-9eaa-4a7a-99d8-31567d36a0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:56.793260 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e22afb-9eaa-4a7a-99d8-31567d36a0ad admin admin] PATH_INFO: `/v3/projects/15a9e6b477014e78b5f1dbb660e022e2/users/a0cd86ff701e42ca9b975e341626df4b/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:56.837412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e22afb-9eaa-4a7a-99d8-31567d36a0ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a9e6b477014e78b5f1dbb660e022e2, user_id=a0cd86ff701e42ca9b975e341626df4b, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:56.851225 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e22afb-9eaa-4a7a-99d8-31567d36a0ad admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:56.853186 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:56.878319 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1105/2175] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:56 2022] PUT /identity/v3/projects/15a9e6b477014e78b5f1dbb660e022e2/users/a0cd86ff701e42ca9b975e341626df4b/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:56.892018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61194b97-0aa6-4713-81c1-651a0a34dae1 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:56.892620 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61194b97-0aa6-4713-81c1-651a0a34dae1 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:56.893100 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61194b97-0aa6-4713-81c1-651a0a34dae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:56.947295 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-61194b97-0aa6-4713-81c1-651a0a34dae1 None None] MFA Rules not processed for user `a0cd86ff701e42ca9b975e341626df4b`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:56.963230 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-61194b97-0aa6-4713-81c1-651a0a34dae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:57.117177 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1071/2176] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:57.132972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e22afb-9eaa-4a7a-99d8-31567d36a0ad admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:57.134875 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-13e22afb-9eaa-4a7a-99d8-31567d36a0ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:57.209409 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e22afb-9eaa-4a7a-99d8-31567d36a0ad admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:57.213154 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4dafd-0f8b-4a71-8d27-1fb0de743fe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:57.213820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4dafd-0f8b-4a71-8d27-1fb0de743fe7 service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:57.214166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4dafd-0f8b-4a71-8d27-1fb0de743fe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:57.214517 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4dafd-0f8b-4a71-8d27-1fb0de743fe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:57.224041 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4dafd-0f8b-4a71-8d27-1fb0de743fe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:57.225633 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4dafd-0f8b-4a71-8d27-1fb0de743fe7 service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:57.237020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1106/2177] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:57.268932 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61194b97-0aa6-4713-81c1-651a0a34dae1 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:57.344293 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61194b97-0aa6-4713-81c1-651a0a34dae1 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:57.349232 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72690ab-5221-4752-8153-2ee97369b916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:57.350218 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72690ab-5221-4752-8153-2ee97369b916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:57.350566 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72690ab-5221-4752-8153-2ee97369b916 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:57.350915 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72690ab-5221-4752-8153-2ee97369b916 admin admin] PATH_INFO: `/v3/users/a0cd86ff701e42ca9b975e341626df4b` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:57.352131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72690ab-5221-4752-8153-2ee97369b916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0cd86ff701e42ca9b975e341626df4b)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:57.354283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72690ab-5221-4752-8153-2ee97369b916 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:57.405012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e72690ab-5221-4752-8153-2ee97369b916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0cd86ff701e42ca9b975e341626df4b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:57.412333 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e72690ab-5221-4752-8153-2ee97369b916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0cd86ff701e42ca9b975e341626df4b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:57.412992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e72690ab-5221-4752-8153-2ee97369b916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0cd86ff701e42ca9b975e341626df4b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:57.413603 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e72690ab-5221-4752-8153-2ee97369b916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0cd86ff701e42ca9b975e341626df4b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:57.425195 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e72690ab-5221-4752-8153-2ee97369b916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0cd86ff701e42ca9b975e341626df4b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:57.429269 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:57.440392 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1072/2178] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:52:57 2022] DELETE /identity/v3/users/a0cd86ff701e42ca9b975e341626df4b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:57.445643 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72142e-2ea3-4722-b7d4-027cc63650b2 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:57.446158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72142e-2ea3-4722-b7d4-027cc63650b2 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:57.446404 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72142e-2ea3-4722-b7d4-027cc63650b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:57.464971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-9d72142e-2ea3-4722-b7d4-027cc63650b2 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:57.466234 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-9d72142e-2ea3-4722-b7d4-027cc63650b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:57.533398 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1107/2179] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:57.542908 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72690ab-5221-4752-8153-2ee97369b916 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:57.544316 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-e72690ab-5221-4752-8153-2ee97369b916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:57.590090 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72142e-2ea3-4722-b7d4-027cc63650b2 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:57.592010 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-9d72142e-2ea3-4722-b7d4-027cc63650b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:57.609008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72142e-2ea3-4722-b7d4-027cc63650b2 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:57.614988 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b3384-0d7d-49cb-b757-88e032e52abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:57.615880 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b3384-0d7d-49cb-b757-88e032e52abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:57.616176 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b3384-0d7d-49cb-b757-88e032e52abd admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:57.616460 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b3384-0d7d-49cb-b757-88e032e52abd admin admin] PATH_INFO: `/v3/users/dbdf8cfd2ef442d98dfd225a3c750dd3` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:57.618493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b3384-0d7d-49cb-b757-88e032e52abd admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbdf8cfd2ef442d98dfd225a3c750dd3)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:57.621315 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b3384-0d7d-49cb-b757-88e032e52abd admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:57.623684 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72690ab-5221-4752-8153-2ee97369b916 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:57.627811 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d510319-74d3-45ec-a93f-727e1af813b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:57.628563 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d510319-74d3-45ec-a93f-727e1af813b9 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:57.629327 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d510319-74d3-45ec-a93f-727e1af813b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:57.629611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d510319-74d3-45ec-a93f-727e1af813b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:57.641088 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d510319-74d3-45ec-a93f-727e1af813b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:57.642565 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d510319-74d3-45ec-a93f-727e1af813b9 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:57.654546 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1073/2180] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:57.689547 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1f2b3384-0d7d-49cb-b757-88e032e52abd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbdf8cfd2ef442d98dfd225a3c750dd3'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:57.699087 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1f2b3384-0d7d-49cb-b757-88e032e52abd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbdf8cfd2ef442d98dfd225a3c750dd3'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:57.699882 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1f2b3384-0d7d-49cb-b757-88e032e52abd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbdf8cfd2ef442d98dfd225a3c750dd3'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:57.700524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1f2b3384-0d7d-49cb-b757-88e032e52abd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbdf8cfd2ef442d98dfd225a3c750dd3'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:57.715215 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1f2b3384-0d7d-49cb-b757-88e032e52abd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbdf8cfd2ef442d98dfd225a3c750dd3'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:57.731418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1108/2181] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:52:57 2022] DELETE /identity/v3/users/dbdf8cfd2ef442d98dfd225a3c750dd3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:57.736347 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bc76b-972c-456a-9c95-d74ca04ae72f None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:57.736646 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bc76b-972c-456a-9c95-d74ca04ae72f None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:57.736965 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bc76b-972c-456a-9c95-d74ca04ae72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:57.755368 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-597bc76b-972c-456a-9c95-d74ca04ae72f None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:57.756586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-597bc76b-972c-456a-9c95-d74ca04ae72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:57.826383 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1074/2182] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:57.836786 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b3384-0d7d-49cb-b757-88e032e52abd admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:57.838271 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-1f2b3384-0d7d-49cb-b757-88e032e52abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:57.857609 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:57.915195 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b3384-0d7d-49cb-b757-88e032e52abd admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:57.918930 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f449420-b338-415e-a888-26817469bd57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:57.919616 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f449420-b338-415e-a888-26817469bd57 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:57.919882 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f449420-b338-415e-a888-26817469bd57 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:57.920154 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f449420-b338-415e-a888-26817469bd57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:57.930729 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f449420-b338-415e-a888-26817469bd57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:57.932261 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f449420-b338-415e-a888-26817469bd57 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:57.942593 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1109/2183] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:58.043195 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bc76b-972c-456a-9c95-d74ca04ae72f None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:58.044672 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-597bc76b-972c-456a-9c95-d74ca04ae72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:58.067175 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bc76b-972c-456a-9c95-d74ca04ae72f None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:58.072849 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccadf1-9cb0-49ce-a490-7b9ed549b5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:58.073888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccadf1-9cb0-49ce-a490-7b9ed549b5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:58.074127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccadf1-9cb0-49ce-a490-7b9ed549b5be admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:58.074769 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccadf1-9cb0-49ce-a490-7b9ed549b5be admin admin] PATH_INFO: `/v3/projects/15a9e6b477014e78b5f1dbb660e022e2` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:58.075596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ccadf1-9cb0-49ce-a490-7b9ed549b5be admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a9e6b477014e78b5f1dbb660e022e2)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:58.077742 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ccadf1-9cb0-49ce-a490-7b9ed549b5be admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:58.127000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f449420-b338-415e-a888-26817469bd57 service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:58.128539 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-3f449420-b338-415e-a888-26817469bd57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:58.136025 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c1ccadf1-9cb0-49ce-a490-7b9ed549b5be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a9e6b477014e78b5f1dbb660e022e2', 'request_id': 'req-c1ccadf1-9cb0-49ce-a490-7b9ed549b5be'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:58.142346 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f449420-b338-415e-a888-26817469bd57 service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:58.157143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c1ccadf1-9cb0-49ce-a490-7b9ed549b5be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a9e6b477014e78b5f1dbb660e022e2', 'request_id': 'req-c1ccadf1-9cb0-49ce-a490-7b9ed549b5be'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:58.166800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c1ccadf1-9cb0-49ce-a490-7b9ed549b5be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a9e6b477014e78b5f1dbb660e022e2', 'request_id': 'req-c1ccadf1-9cb0-49ce-a490-7b9ed549b5be'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:58.178816 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c1ccadf1-9cb0-49ce-a490-7b9ed549b5be admin admin] The token cache is being invalidate because project 15a9e6b477014e78b5f1dbb660e022e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:58.179100 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c1ccadf1-9cb0-49ce-a490-7b9ed549b5be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:58.179770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c1ccadf1-9cb0-49ce-a490-7b9ed549b5be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:58.181508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1075/2184] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:58 2022] DELETE /identity/v3/projects/15a9e6b477014e78b5f1dbb660e022e2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:58.186735 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6328e-58d1-41ab-88fa-2af4b9bd5daf None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:58.187528 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6328e-58d1-41ab-88fa-2af4b9bd5daf None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:58.187528 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6328e-58d1-41ab-88fa-2af4b9bd5daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:58.209533 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-1df6328e-58d1-41ab-88fa-2af4b9bd5daf None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:58.210777 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-1df6328e-58d1-41ab-88fa-2af4b9bd5daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:58.214611 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1e7a9-a000-4616-9022-d17f071982e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:58.215863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1e7a9-a000-4616-9022-d17f071982e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:58.216160 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1e7a9-a000-4616-9022-d17f071982e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:58.216441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1e7a9-a000-4616-9022-d17f071982e2 admin admin] PATH_INFO: `/v3/projects/e31ac098b7f74c1ea896007fdd9f2a6a` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:58.217711 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1e7a9-a000-4616-9022-d17f071982e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e31ac098b7f74c1ea896007fdd9f2a6a)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:58.219675 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1e7a9-a000-4616-9022-d17f071982e2 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:58.221404 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1076/2185] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:58.229884 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d8e37-0c4d-49e2-9269-3dc5ff5ae89a None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:58.230375 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d8e37-0c4d-49e2-9269-3dc5ff5ae89a None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:58.230602 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d8e37-0c4d-49e2-9269-3dc5ff5ae89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:58.252118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-c09d8e37-0c4d-49e2-9269-3dc5ff5ae89a None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:58.254828 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-c09d8e37-0c4d-49e2-9269-3dc5ff5ae89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:58.263969 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1077/2186] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:52:58.268256 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d8e37-0c4d-49e2-9269-3dc5ff5ae89a None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:58.280214 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d8e37-0c4d-49e2-9269-3dc5ff5ae89a None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:58.284093 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-bdd1e7a9-a000-4616-9022-d17f071982e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e31ac098b7f74c1ea896007fdd9f2a6a', 'request_id': 'req-bdd1e7a9-a000-4616-9022-d17f071982e2'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:58.287099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:58.292267 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-bdd1e7a9-a000-4616-9022-d17f071982e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e31ac098b7f74c1ea896007fdd9f2a6a', 'request_id': 'req-bdd1e7a9-a000-4616-9022-d17f071982e2'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:58.301408 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-bdd1e7a9-a000-4616-9022-d17f071982e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e31ac098b7f74c1ea896007fdd9f2a6a', 'request_id': 'req-bdd1e7a9-a000-4616-9022-d17f071982e2'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:58.314216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-bdd1e7a9-a000-4616-9022-d17f071982e2 admin admin] The token cache is being invalidate because project e31ac098b7f74c1ea896007fdd9f2a6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:58.314537 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-bdd1e7a9-a000-4616-9022-d17f071982e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:58.315223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-bdd1e7a9-a000-4616-9022-d17f071982e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:58.317250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1110/2187] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:58 2022] DELETE /identity/v3/projects/e31ac098b7f74c1ea896007fdd9f2a6a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:52:58.355552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de3b2c-0934-40cb-887b-65043e58f8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:58.356241 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de3b2c-0934-40cb-887b-65043e58f8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:58.356541 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de3b2c-0934-40cb-887b-65043e58f8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:58.356815 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de3b2c-0934-40cb-887b-65043e58f8c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:58.357573 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de3b2c-0934-40cb-887b-65043e58f8c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:52:58.357929 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de3b2c-0934-40cb-887b-65043e58f8c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:58.360083 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de3b2c-0934-40cb-887b-65043e58f8c7 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:58.380760 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1078/2188] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:52:58.381633 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1e7a9-a000-4616-9022-d17f071982e2 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:58.383349 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-bdd1e7a9-a000-4616-9022-d17f071982e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:58.399731 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1e7a9-a000-4616-9022-d17f071982e2 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:58.416685 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd2ae2-898f-4d86-8cc7-0d916930862b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:58.418503 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd2ae2-898f-4d86-8cc7-0d916930862b admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:58.419060 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd2ae2-898f-4d86-8cc7-0d916930862b admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:58.419463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfd2ae2-898f-4d86-8cc7-0d916930862b admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:58.420545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd2ae2-898f-4d86-8cc7-0d916930862b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:58.423446 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfd2ae2-898f-4d86-8cc7-0d916930862b admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:58.463170 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1111/2189] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:52:58 2022] POST /identity/v3/projects => generated 371 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:52:58.467345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de3b2c-0934-40cb-887b-65043e58f8c7 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:58.479003 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de3b2c-0934-40cb-887b-65043e58f8c7 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:58.560905 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2b323-94a4-428f-9c11-68a8bc3e9276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:58.567288 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2b323-94a4-428f-9c11-68a8bc3e9276 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:58.567585 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2b323-94a4-428f-9c11-68a8bc3e9276 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:58.567899 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2b323-94a4-428f-9c11-68a8bc3e9276 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:58.568664 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2b323-94a4-428f-9c11-68a8bc3e9276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:58.570917 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2b323-94a4-428f-9c11-68a8bc3e9276 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:58.588840 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd2ae2-898f-4d86-8cc7-0d916930862b admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:58.591197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-bbfd2ae2-898f-4d86-8cc7-0d916930862b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:58.596280 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1079/2190] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:52:58 2022] POST /identity/v3/users => generated 286 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:52:58.601337 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2b323-94a4-428f-9c11-68a8bc3e9276 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:58.605235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfd2ae2-898f-4d86-8cc7-0d916930862b admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:58.609930 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab756cb-c62a-494d-a17c-86335acde7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:58.610807 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab756cb-c62a-494d-a17c-86335acde7ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:58.611094 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab756cb-c62a-494d-a17c-86335acde7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:58.611370 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab756cb-c62a-494d-a17c-86335acde7ad admin admin] PATH_INFO: `/v3/users/aa7bad2ad2e0406f98104fbbde521c2a` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:58.612596 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab756cb-c62a-494d-a17c-86335acde7ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa7bad2ad2e0406f98104fbbde521c2a)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:58.614086 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2b323-94a4-428f-9c11-68a8bc3e9276 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:58.615115 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab756cb-c62a-494d-a17c-86335acde7ad admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:58.619925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737e903-eaf9-4a5a-9153-2f57c172ae0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:58.620587 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737e903-eaf9-4a5a-9153-2f57c172ae0f admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:58.620924 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737e903-eaf9-4a5a-9153-2f57c172ae0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:58.621147 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737e903-eaf9-4a5a-9153-2f57c172ae0f admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:58.621896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737e903-eaf9-4a5a-9153-2f57c172ae0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:58.623623 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737e903-eaf9-4a5a-9153-2f57c172ae0f admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:58.632332 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:58.634617 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1080/2191] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 15:52:58.638679 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737e903-eaf9-4a5a-9153-2f57c172ae0f admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:58.649821 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737e903-eaf9-4a5a-9153-2f57c172ae0f admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:58.655127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd3fa2-32e9-47ff-a8b1-d97f4c0cee17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:58.655835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd3fa2-32e9-47ff-a8b1-d97f4c0cee17 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:58.656191 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd3fa2-32e9-47ff-a8b1-d97f4c0cee17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:58.656514 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd3fa2-32e9-47ff-a8b1-d97f4c0cee17 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:58.659086 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd3fa2-32e9-47ff-a8b1-d97f4c0cee17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:58.661611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd3fa2-32e9-47ff-a8b1-d97f4c0cee17 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:58.671375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-2ab756cb-c62a-494d-a17c-86335acde7ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa7bad2ad2e0406f98104fbbde521c2a'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:58.673181 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1081/2192] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 15:52:58.677932 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd3fa2-32e9-47ff-a8b1-d97f4c0cee17 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:58.682493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-2ab756cb-c62a-494d-a17c-86335acde7ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa7bad2ad2e0406f98104fbbde521c2a'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:58.683229 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-2ab756cb-c62a-494d-a17c-86335acde7ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa7bad2ad2e0406f98104fbbde521c2a'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:58.683898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-2ab756cb-c62a-494d-a17c-86335acde7ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa7bad2ad2e0406f98104fbbde521c2a'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:58.688190 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd3fa2-32e9-47ff-a8b1-d97f4c0cee17 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:58.694147 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545afd6-2b8e-4dab-a862-6017f35b8db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:58.695169 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545afd6-2b8e-4dab-a862-6017f35b8db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:58.695529 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545afd6-2b8e-4dab-a862-6017f35b8db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:58.695828 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545afd6-2b8e-4dab-a862-6017f35b8db2 admin admin] PATH_INFO: `/v3/projects/ba201456c04a46018339b0c806d809d1/users/53a77c323a8843709660a12833e99b18/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:58.696786 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-2ab756cb-c62a-494d-a17c-86335acde7ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa7bad2ad2e0406f98104fbbde521c2a'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:58.711473 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1112/2193] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:52:58 2022] DELETE /identity/v3/users/aa7bad2ad2e0406f98104fbbde521c2a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:58.716062 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725389f-9f7d-43f0-b294-3279016471ee None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:58.716452 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725389f-9f7d-43f0-b294-3279016471ee None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:58.716627 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545afd6-2b8e-4dab-a862-6017f35b8db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba201456c04a46018339b0c806d809d1, user_id=53a77c323a8843709660a12833e99b18, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:58.717024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725389f-9f7d-43f0-b294-3279016471ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:58.719281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545afd6-2b8e-4dab-a862-6017f35b8db2 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:58.739117 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1082/2194] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:52:58 2022] PUT /identity/v3/projects/ba201456c04a46018339b0c806d809d1/users/53a77c323a8843709660a12833e99b18/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:58.740685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d7d75-a61b-42d2-87ad-b0af93a1cbc7 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:58.740986 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d7d75-a61b-42d2-87ad-b0af93a1cbc7 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:58.741275 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d7d75-a61b-42d2-87ad-b0af93a1cbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:58.743795 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-c725389f-9f7d-43f0-b294-3279016471ee None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:58.745146 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-c725389f-9f7d-43f0-b294-3279016471ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:58.762855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-2c0d7d75-a61b-42d2-87ad-b0af93a1cbc7 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:52:58.764119 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-2c0d7d75-a61b-42d2-87ad-b0af93a1cbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:58.827471 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1113/2195] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:52:58.829053 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:58.840073 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725389f-9f7d-43f0-b294-3279016471ee None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:58.841770 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-c725389f-9f7d-43f0-b294-3279016471ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:58.869895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1083/2196] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:52:58.880351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d7d75-a61b-42d2-87ad-b0af93a1cbc7 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:58.887457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-2c0d7d75-a61b-42d2-87ad-b0af93a1cbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:58.922544 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725389f-9f7d-43f0-b294-3279016471ee None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:58.927453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b40f3-fd87-4314-a3e3-1493a8d4688a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:58.928132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b40f3-fd87-4314-a3e3-1493a8d4688a service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:58.928587 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b40f3-fd87-4314-a3e3-1493a8d4688a service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:58.928834 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b40f3-fd87-4314-a3e3-1493a8d4688a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:58.946657 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b40f3-fd87-4314-a3e3-1493a8d4688a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:58.948671 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b40f3-fd87-4314-a3e3-1493a8d4688a service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:58.960681 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1114/2197] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:52:59.032534 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d7d75-a61b-42d2-87ad-b0af93a1cbc7 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:59.037578 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82355093-ca1f-4c61-9455-1412452231d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:59.038280 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82355093-ca1f-4c61-9455-1412452231d8 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:59.038569 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82355093-ca1f-4c61-9455-1412452231d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:59.039180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82355093-ca1f-4c61-9455-1412452231d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:59.049479 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82355093-ca1f-4c61-9455-1412452231d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:59.050999 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82355093-ca1f-4c61-9455-1412452231d8 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:59.063650 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1084/2198] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:52:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:52:59.453015 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b40f3-fd87-4314-a3e3-1493a8d4688a service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:59.454945 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-1f2b40f3-fd87-4314-a3e3-1493a8d4688a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:52:59.468610 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b40f3-fd87-4314-a3e3-1493a8d4688a service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:59.475898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d57bfc-5dc9-4e7c-9cde-b9f712fb3794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:59.475898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d57bfc-5dc9-4e7c-9cde-b9f712fb3794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:59.475898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d57bfc-5dc9-4e7c-9cde-b9f712fb3794 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:59.475898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d57bfc-5dc9-4e7c-9cde-b9f712fb3794 admin admin] PATH_INFO: `/v3/projects/ed3a175cf7bf46838e226c9d2ef2de54` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:59.477680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d57bfc-5dc9-4e7c-9cde-b9f712fb3794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed3a175cf7bf46838e226c9d2ef2de54)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:59.479778 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d57bfc-5dc9-4e7c-9cde-b9f712fb3794 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:59.524010 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:52:59.542460 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-64d57bfc-5dc9-4e7c-9cde-b9f712fb3794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed3a175cf7bf46838e226c9d2ef2de54', 'request_id': 'req-64d57bfc-5dc9-4e7c-9cde-b9f712fb3794'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:59.553002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-64d57bfc-5dc9-4e7c-9cde-b9f712fb3794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed3a175cf7bf46838e226c9d2ef2de54', 'request_id': 'req-64d57bfc-5dc9-4e7c-9cde-b9f712fb3794'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:59.564108 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-64d57bfc-5dc9-4e7c-9cde-b9f712fb3794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed3a175cf7bf46838e226c9d2ef2de54', 'request_id': 'req-64d57bfc-5dc9-4e7c-9cde-b9f712fb3794'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:59.584120 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-64d57bfc-5dc9-4e7c-9cde-b9f712fb3794 admin admin] The token cache is being invalidate because project ed3a175cf7bf46838e226c9d2ef2de54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:52:59.584363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-64d57bfc-5dc9-4e7c-9cde-b9f712fb3794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:59.585040 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-64d57bfc-5dc9-4e7c-9cde-b9f712fb3794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:59.586829 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1115/2199] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:52:59 2022] DELETE /identity/v3/projects/ed3a175cf7bf46838e226c9d2ef2de54 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:52:59.590771 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82355093-ca1f-4c61-9455-1412452231d8 service neutron] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:52:59.602648 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82355093-ca1f-4c61-9455-1412452231d8 service neutron] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:52:59.666450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8590c-ffd4-4440-bbe2-d6c9bf307dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:52:59.667992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8590c-ffd4-4440-bbe2-d6c9bf307dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:52:59.668527 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8590c-ffd4-4440-bbe2-d6c9bf307dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:52:59.669299 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8590c-ffd4-4440-bbe2-d6c9bf307dc7 admin admin] PATH_INFO: `/v3/users/b3b2e9aa55384dd58ed93f8fb0752868` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:52:59.671128 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8590c-ffd4-4440-bbe2-d6c9bf307dc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3b2e9aa55384dd58ed93f8fb0752868)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:52:59.674555 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8590c-ffd4-4440-bbe2-d6c9bf307dc7 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:52:59.734177 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-14e8590c-ffd4-4440-bbe2-d6c9bf307dc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3b2e9aa55384dd58ed93f8fb0752868'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:59.741760 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-14e8590c-ffd4-4440-bbe2-d6c9bf307dc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3b2e9aa55384dd58ed93f8fb0752868'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:59.742545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-14e8590c-ffd4-4440-bbe2-d6c9bf307dc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3b2e9aa55384dd58ed93f8fb0752868'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:59.743165 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-14e8590c-ffd4-4440-bbe2-d6c9bf307dc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3b2e9aa55384dd58ed93f8fb0752868'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:59.756178 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-14e8590c-ffd4-4440-bbe2-d6c9bf307dc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3b2e9aa55384dd58ed93f8fb0752868'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:52:59.771972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1085/2200] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:52:59 2022] DELETE /identity/v3/users/b3b2e9aa55384dd58ed93f8fb0752868 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:53:00.086265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d57bfc-5dc9-4e7c-9cde-b9f712fb3794 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:00.087765 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-64d57bfc-5dc9-4e7c-9cde-b9f712fb3794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:00.101709 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d57bfc-5dc9-4e7c-9cde-b9f712fb3794 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:00.206481 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573d920-eb4b-4ac5-b948-056afd1615a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:00.207541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573d920-eb4b-4ac5-b948-056afd1615a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:00.207903 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573d920-eb4b-4ac5-b948-056afd1615a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:00.208369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573d920-eb4b-4ac5-b948-056afd1615a6 admin admin] PATH_INFO: `/v3/projects/c5aa802758b348ce836ec26c1aa83b5f` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:00.209886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573d920-eb4b-4ac5-b948-056afd1615a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5aa802758b348ce836ec26c1aa83b5f)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:00.212548 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573d920-eb4b-4ac5-b948-056afd1615a6 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:00.277996 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1573d920-eb4b-4ac5-b948-056afd1615a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5aa802758b348ce836ec26c1aa83b5f', 'request_id': 'req-1573d920-eb4b-4ac5-b948-056afd1615a6'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:00.287259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1573d920-eb4b-4ac5-b948-056afd1615a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5aa802758b348ce836ec26c1aa83b5f', 'request_id': 'req-1573d920-eb4b-4ac5-b948-056afd1615a6'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:00.302451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1573d920-eb4b-4ac5-b948-056afd1615a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5aa802758b348ce836ec26c1aa83b5f', 'request_id': 'req-1573d920-eb4b-4ac5-b948-056afd1615a6'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:00.319673 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1573d920-eb4b-4ac5-b948-056afd1615a6 admin admin] The token cache is being invalidate because project c5aa802758b348ce836ec26c1aa83b5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:53:00.320678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1573d920-eb4b-4ac5-b948-056afd1615a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:00.321028 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1573d920-eb4b-4ac5-b948-056afd1615a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:00.326492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1116/2201] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:53:00 2022] DELETE /identity/v3/projects/c5aa802758b348ce836ec26c1aa83b5f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:53:00.328591 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b9aa9-a148-4a01-a75c-bd3e99e9526f None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:00.328893 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b9aa9-a148-4a01-a75c-bd3e99e9526f None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:00.329177 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b9aa9-a148-4a01-a75c-bd3e99e9526f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:00.371189 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-8d7b9aa9-a148-4a01-a75c-bd3e99e9526f None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:00.372599 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-8d7b9aa9-a148-4a01-a75c-bd3e99e9526f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:00.391446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:00.490282 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1086/2202] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:53:00.492311 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b9cab-21dc-47cb-af06-3ee77bebce70 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:00.492773 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b9cab-21dc-47cb-af06-3ee77bebce70 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:00.492948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b9cab-21dc-47cb-af06-3ee77bebce70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:00.512265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-a26b9cab-21dc-47cb-af06-3ee77bebce70 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:00.513901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-a26b9cab-21dc-47cb-af06-3ee77bebce70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:00.549400 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1117/2203] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:53:00.553688 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b9aa9-a148-4a01-a75c-bd3e99e9526f None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:00.569474 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b9aa9-a148-4a01-a75c-bd3e99e9526f None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:00.577155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8d6ea-a7a1-440d-acd2-37e83a61f8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:00.577974 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8d6ea-a7a1-440d-acd2-37e83a61f8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:00.578268 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8d6ea-a7a1-440d-acd2-37e83a61f8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:00.578723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8d6ea-a7a1-440d-acd2-37e83a61f8e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:00.579489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8d6ea-a7a1-440d-acd2-37e83a61f8e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:53:00.579806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8d6ea-a7a1-440d-acd2-37e83a61f8e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:00.582530 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8d6ea-a7a1-440d-acd2-37e83a61f8e7 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:00.598360 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1087/2204] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:53:00.602817 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b9cab-21dc-47cb-af06-3ee77bebce70 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:00.618749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b9cab-21dc-47cb-af06-3ee77bebce70 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:00.625458 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39fc78-e2ad-412c-86ae-b7e850bb2728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:00.625818 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39fc78-e2ad-412c-86ae-b7e850bb2728 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:00.626153 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39fc78-e2ad-412c-86ae-b7e850bb2728 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:00.626440 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39fc78-e2ad-412c-86ae-b7e850bb2728 admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:00.627189 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39fc78-e2ad-412c-86ae-b7e850bb2728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:00.629903 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be39fc78-e2ad-412c-86ae-b7e850bb2728 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:00.689950 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1118/2205] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:53:00 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:53:00.694795 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8d6ea-a7a1-440d-acd2-37e83a61f8e7 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:00.716600 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8d6ea-a7a1-440d-acd2-37e83a61f8e7 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:00.844268 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e32b9-cebb-49b9-a5d4-852fbd79897f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:00.845346 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e32b9-cebb-49b9-a5d4-852fbd79897f admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:00.845806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e32b9-cebb-49b9-a5d4-852fbd79897f admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:00.846284 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e32b9-cebb-49b9-a5d4-852fbd79897f admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:00.847222 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e32b9-cebb-49b9-a5d4-852fbd79897f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:00.849595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e32b9-cebb-49b9-a5d4-852fbd79897f admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:00.892915 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1088/2206] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:53:00 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:53:00.899894 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39fc78-e2ad-412c-86ae-b7e850bb2728 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:00.912884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39fc78-e2ad-412c-86ae-b7e850bb2728 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:00.918602 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f740264-517c-4a4a-81c1-b9b75c51bab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:00.919287 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f740264-517c-4a4a-81c1-b9b75c51bab3 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:00.919721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f740264-517c-4a4a-81c1-b9b75c51bab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:00.920131 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f740264-517c-4a4a-81c1-b9b75c51bab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:00.920839 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f740264-517c-4a4a-81c1-b9b75c51bab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:00.922995 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f740264-517c-4a4a-81c1-b9b75c51bab3 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:00.936003 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1119/2207] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:53:00.940134 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e32b9-cebb-49b9-a5d4-852fbd79897f admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:00.953466 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e32b9-cebb-49b9-a5d4-852fbd79897f admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:00.960637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd03879-037c-4496-a166-0251037ed819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:00.961615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd03879-037c-4496-a166-0251037ed819 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:00.962130 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd03879-037c-4496-a166-0251037ed819 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:00.962552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd03879-037c-4496-a166-0251037ed819 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:00.963489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd03879-037c-4496-a166-0251037ed819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:00.965265 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd03879-037c-4496-a166-0251037ed819 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:00.981615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1089/2208] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:53:00.984949 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f740264-517c-4a4a-81c1-b9b75c51bab3 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:01.004804 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f740264-517c-4a4a-81c1-b9b75c51bab3 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:01.027142 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e50b4d-c661-4b07-beea-4eaac3c9ecdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:01.028063 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e50b4d-c661-4b07-beea-4eaac3c9ecdf admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:01.028352 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e50b4d-c661-4b07-beea-4eaac3c9ecdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:01.028730 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e50b4d-c661-4b07-beea-4eaac3c9ecdf admin admin] PATH_INFO: `/v3/projects/e8857038e58644aca81481f84c341eb6/users/5d4184b9dda24d8a8e1da73d79556b29/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:01.042519 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:01.052743 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e50b4d-c661-4b07-beea-4eaac3c9ecdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8857038e58644aca81481f84c341eb6, user_id=5d4184b9dda24d8a8e1da73d79556b29, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:01.062776 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e50b4d-c661-4b07-beea-4eaac3c9ecdf admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:01.086998 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1120/2209] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:53:00 2022] PUT /identity/v3/projects/e8857038e58644aca81481f84c341eb6/users/5d4184b9dda24d8a8e1da73d79556b29/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:53:01.098069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e112c42-94b1-4fde-94e0-3b1de59fe95a None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:01.098374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e112c42-94b1-4fde-94e0-3b1de59fe95a None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:01.098668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e112c42-94b1-4fde-94e0-3b1de59fe95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:01.139691 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-3e112c42-94b1-4fde-94e0-3b1de59fe95a None None] MFA Rules not processed for user `5d4184b9dda24d8a8e1da73d79556b29`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:01.141483 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-3e112c42-94b1-4fde-94e0-3b1de59fe95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:01.262462 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1090/2210] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:53:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:53:01.267038 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e50b4d-c661-4b07-beea-4eaac3c9ecdf admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:01.357391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e50b4d-c661-4b07-beea-4eaac3c9ecdf admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:01.367619 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d147bb-4199-4557-8065-31049e6a5e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:01.368311 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d147bb-4199-4557-8065-31049e6a5e14 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:01.368603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d147bb-4199-4557-8065-31049e6a5e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:01.368888 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d147bb-4199-4557-8065-31049e6a5e14 admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:01.369601 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d147bb-4199-4557-8065-31049e6a5e14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:01.372184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d147bb-4199-4557-8065-31049e6a5e14 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:01.410509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1121/2211] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:53:01 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:53:01.412471 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e112c42-94b1-4fde-94e0-3b1de59fe95a None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:01.419417 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:01.424807 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e112c42-94b1-4fde-94e0-3b1de59fe95a None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:01.485730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a795e98-9763-4da1-90a6-c29dd3e7d12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:01.486564 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a795e98-9763-4da1-90a6-c29dd3e7d12f admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:01.486858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a795e98-9763-4da1-90a6-c29dd3e7d12f admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:01.487137 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a795e98-9763-4da1-90a6-c29dd3e7d12f admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:01.488434 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a795e98-9763-4da1-90a6-c29dd3e7d12f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:01.490536 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a795e98-9763-4da1-90a6-c29dd3e7d12f admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:01.513824 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1091/2212] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:53:01 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:53:01.518328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d147bb-4199-4557-8065-31049e6a5e14 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:01.535572 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d147bb-4199-4557-8065-31049e6a5e14 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:01.549720 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a54b4-2917-45d6-a493-6f7ca158e275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:01.551547 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a54b4-2917-45d6-a493-6f7ca158e275 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:01.551960 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a54b4-2917-45d6-a493-6f7ca158e275 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:01.552513 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a54b4-2917-45d6-a493-6f7ca158e275 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:01.553807 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a54b4-2917-45d6-a493-6f7ca158e275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:01.556078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a54b4-2917-45d6-a493-6f7ca158e275 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:01.577274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1122/2213] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 15:53:01.581507 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a795e98-9763-4da1-90a6-c29dd3e7d12f admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:01.593879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a795e98-9763-4da1-90a6-c29dd3e7d12f admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:01.599799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05521dce-79ec-49aa-8d9e-4422fbceadbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:01.603506 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05521dce-79ec-49aa-8d9e-4422fbceadbb admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:01.603506 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05521dce-79ec-49aa-8d9e-4422fbceadbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:01.603506 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05521dce-79ec-49aa-8d9e-4422fbceadbb admin admin] PATH_INFO: `/v3/projects/06bbb5b118554ec9808d0720e24e01ba/users/e1782bcf781b46e28130cedfe725bc14/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:01.623920 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05521dce-79ec-49aa-8d9e-4422fbceadbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=06bbb5b118554ec9808d0720e24e01ba, user_id=e1782bcf781b46e28130cedfe725bc14, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:01.627025 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05521dce-79ec-49aa-8d9e-4422fbceadbb admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:01.643768 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1092/2214] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:53:01 2022] PUT /identity/v3/projects/06bbb5b118554ec9808d0720e24e01ba/users/e1782bcf781b46e28130cedfe725bc14/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:53:01.649553 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a54b4-2917-45d6-a493-6f7ca158e275 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:01.662223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a54b4-2917-45d6-a493-6f7ca158e275 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:01.766826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d09b42-8b06-4d8a-955f-e748d69d1058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:01.769725 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d09b42-8b06-4d8a-955f-e748d69d1058 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:01.770171 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d09b42-8b06-4d8a-955f-e748d69d1058 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:01.771984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d09b42-8b06-4d8a-955f-e748d69d1058 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:01.772896 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d09b42-8b06-4d8a-955f-e748d69d1058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:01.774960 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d09b42-8b06-4d8a-955f-e748d69d1058 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:01.792766 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1123/2215] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:53:01.796877 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05521dce-79ec-49aa-8d9e-4422fbceadbb admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:01.809309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05521dce-79ec-49aa-8d9e-4422fbceadbb admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:01.815444 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c4276-5481-4b59-9f6b-d08f82038f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:01.816534 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c4276-5481-4b59-9f6b-d08f82038f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:01.817405 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c4276-5481-4b59-9f6b-d08f82038f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:01.817405 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c4276-5481-4b59-9f6b-d08f82038f96 admin admin] PATH_INFO: `/v3/projects/06bbb5b118554ec9808d0720e24e01ba/users/e1782bcf781b46e28130cedfe725bc14/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:01.820324 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c4276-5481-4b59-9f6b-d08f82038f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06bbb5b118554ec9808d0720e24e01ba, user_id=e1782bcf781b46e28130cedfe725bc14, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:01.824530 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c4276-5481-4b59-9f6b-d08f82038f96 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:01.840816 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1093/2216] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:53:01 2022] PUT /identity/v3/projects/06bbb5b118554ec9808d0720e24e01ba/users/e1782bcf781b46e28130cedfe725bc14/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:53:01.853716 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da71a4-032a-42b3-a0be-8b9ff10483d3 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:01.854786 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da71a4-032a-42b3-a0be-8b9ff10483d3 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:01.855542 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da71a4-032a-42b3-a0be-8b9ff10483d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:01.919166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-44da71a4-032a-42b3-a0be-8b9ff10483d3 None None] MFA Rules not processed for user `e1782bcf781b46e28130cedfe725bc14`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:01.921551 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-44da71a4-032a-42b3-a0be-8b9ff10483d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:02.035763 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:02.068368 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1124/2217] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:53:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:53:02.084274 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c4276-5481-4b59-9f6b-d08f82038f96 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:02.087808 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-089c4276-5481-4b59-9f6b-d08f82038f96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:02.226452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c4276-5481-4b59-9f6b-d08f82038f96 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:02.231372 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd310cc2-ef40-447b-ab73-d3f2e1d9c759 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:02.232950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd310cc2-ef40-447b-ab73-d3f2e1d9c759 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:02.233399 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd310cc2-ef40-447b-ab73-d3f2e1d9c759 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:02.233835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd310cc2-ef40-447b-ab73-d3f2e1d9c759 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:02.320121 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd310cc2-ef40-447b-ab73-d3f2e1d9c759 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:02.326535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd310cc2-ef40-447b-ab73-d3f2e1d9c759 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:02.343878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1094/2218] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:53:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:53:04.448318 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e741e44-a2f6-47e4-a853-6edf055c18a9 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:04.448866 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e741e44-a2f6-47e4-a853-6edf055c18a9 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:04.448866 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e741e44-a2f6-47e4-a853-6edf055c18a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:04.492673 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-8e741e44-a2f6-47e4-a853-6edf055c18a9 None None] MFA Rules not processed for user `53a77c323a8843709660a12833e99b18`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:04.493941 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-8e741e44-a2f6-47e4-a853-6edf055c18a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:04.582610 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1125/2219] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:53:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:53:04.587356 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd310cc2-ef40-447b-ab73-d3f2e1d9c759 service cinder] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:04.589199 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-dd310cc2-ef40-447b-ab73-d3f2e1d9c759 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:04.604098 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:04.666024 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd310cc2-ef40-447b-ab73-d3f2e1d9c759 service cinder] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:04.670985 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076d7c0-9083-4890-9540-4dca06d48206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:04.672125 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076d7c0-9083-4890-9540-4dca06d48206 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:04.672490 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076d7c0-9083-4890-9540-4dca06d48206 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:04.672833 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076d7c0-9083-4890-9540-4dca06d48206 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:04.683027 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076d7c0-9083-4890-9540-4dca06d48206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:04.685000 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076d7c0-9083-4890-9540-4dca06d48206 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:04.740412 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1095/2220] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:53:04 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:53:04.741711 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e741e44-a2f6-47e4-a853-6edf055c18a9 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:04.755193 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e741e44-a2f6-47e4-a853-6edf055c18a9 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:04.848935 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f133d01-f4c7-4f91-b495-e09874096480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:04.849762 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f133d01-f4c7-4f91-b495-e09874096480 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:04.850174 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f133d01-f4c7-4f91-b495-e09874096480 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:04.850549 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f133d01-f4c7-4f91-b495-e09874096480 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:04.851964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f133d01-f4c7-4f91-b495-e09874096480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:04.853805 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f133d01-f4c7-4f91-b495-e09874096480 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:04.880887 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1126/2221] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:53:04 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:53:04.884780 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076d7c0-9083-4890-9540-4dca06d48206 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:04.898083 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076d7c0-9083-4890-9540-4dca06d48206 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:04.928329 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e6f7b-6849-4c0c-bf99-133ed0c4bd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:04.930401 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e6f7b-6849-4c0c-bf99-133ed0c4bd57 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:04.930704 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e6f7b-6849-4c0c-bf99-133ed0c4bd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:04.931000 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e6f7b-6849-4c0c-bf99-133ed0c4bd57 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:04.932316 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e6f7b-6849-4c0c-bf99-133ed0c4bd57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:04.935335 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e6f7b-6849-4c0c-bf99-133ed0c4bd57 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:04.958002 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1096/2222] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 15:53:04.961595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f133d01-f4c7-4f91-b495-e09874096480 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:04.973234 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f133d01-f4c7-4f91-b495-e09874096480 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:04.984051 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455e7c8-4869-4354-b8be-105ac0bb0b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:04.985765 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455e7c8-4869-4354-b8be-105ac0bb0b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:04.986314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455e7c8-4869-4354-b8be-105ac0bb0b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:04.989966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455e7c8-4869-4354-b8be-105ac0bb0b17 admin admin] PATH_INFO: `/v3/projects/d1c88405e5424ab4833f88c93c201c12/users/23d80799778a47efab41f86a879c4fba/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:05.024992 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455e7c8-4869-4354-b8be-105ac0bb0b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1c88405e5424ab4833f88c93c201c12, user_id=23d80799778a47efab41f86a879c4fba, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:05.033675 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455e7c8-4869-4354-b8be-105ac0bb0b17 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:05.065845 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1127/2223] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:53:04 2022] PUT /identity/v3/projects/d1c88405e5424ab4833f88c93c201c12/users/23d80799778a47efab41f86a879c4fba/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:53:05.069948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e6f7b-6849-4c0c-bf99-133ed0c4bd57 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:05.087025 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e6f7b-6849-4c0c-bf99-133ed0c4bd57 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:05.205376 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5fbfaa-c4dd-4ea8-a267-0453c715d63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:05.206145 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fbfaa-c4dd-4ea8-a267-0453c715d63b admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:05.207288 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fbfaa-c4dd-4ea8-a267-0453c715d63b admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:05.207764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5fbfaa-c4dd-4ea8-a267-0453c715d63b admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:05.208533 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5fbfaa-c4dd-4ea8-a267-0453c715d63b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:05.210360 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5fbfaa-c4dd-4ea8-a267-0453c715d63b admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:05.230050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1097/2224] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:53:05.232040 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455e7c8-4869-4354-b8be-105ac0bb0b17 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:05.249080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5fbfaa-c4dd-4ea8-a267-0453c715d63b admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:05.273079 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5fbfaa-c4dd-4ea8-a267-0453c715d63b admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:05.279280 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f741863-bd09-4c0d-82c4-4f162ddbed89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:05.281018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f741863-bd09-4c0d-82c4-4f162ddbed89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:05.281625 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f741863-bd09-4c0d-82c4-4f162ddbed89 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:05.282534 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f741863-bd09-4c0d-82c4-4f162ddbed89 admin admin] PATH_INFO: `/v3/users/5d4184b9dda24d8a8e1da73d79556b29` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:05.283900 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f741863-bd09-4c0d-82c4-4f162ddbed89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d4184b9dda24d8a8e1da73d79556b29)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:05.287177 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f741863-bd09-4c0d-82c4-4f162ddbed89 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:05.287326 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455e7c8-4869-4354-b8be-105ac0bb0b17 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:05.293179 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c367a-44c9-4d4b-ba83-3c6b77923d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:05.294129 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c367a-44c9-4d4b-ba83-3c6b77923d90 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:05.294410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c367a-44c9-4d4b-ba83-3c6b77923d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:05.294688 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c367a-44c9-4d4b-ba83-3c6b77923d90 admin admin] PATH_INFO: `/v3/projects/d1c88405e5424ab4833f88c93c201c12/users/23d80799778a47efab41f86a879c4fba/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:05.296772 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c367a-44c9-4d4b-ba83-3c6b77923d90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1c88405e5424ab4833f88c93c201c12, user_id=23d80799778a47efab41f86a879c4fba, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:05.303134 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c367a-44c9-4d4b-ba83-3c6b77923d90 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:05.331921 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1128/2225] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:53:05 2022] PUT /identity/v3/projects/d1c88405e5424ab4833f88c93c201c12/users/23d80799778a47efab41f86a879c4fba/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:53:05.391028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-6f741863-bd09-4c0d-82c4-4f162ddbed89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d4184b9dda24d8a8e1da73d79556b29'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:05.402874 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-6f741863-bd09-4c0d-82c4-4f162ddbed89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d4184b9dda24d8a8e1da73d79556b29'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:05.404026 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-6f741863-bd09-4c0d-82c4-4f162ddbed89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d4184b9dda24d8a8e1da73d79556b29'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:05.404674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-6f741863-bd09-4c0d-82c4-4f162ddbed89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d4184b9dda24d8a8e1da73d79556b29'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:05.422682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-6f741863-bd09-4c0d-82c4-4f162ddbed89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d4184b9dda24d8a8e1da73d79556b29'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:05.427798 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:05.452775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1098/2226] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:53:05 2022] DELETE /identity/v3/users/5d4184b9dda24d8a8e1da73d79556b29 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:53:05.454427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a2e8c-062e-4a36-aa8e-7008fe36814a None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:05.454901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a2e8c-062e-4a36-aa8e-7008fe36814a None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:05.454993 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a2e8c-062e-4a36-aa8e-7008fe36814a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:05.477039 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-271a2e8c-062e-4a36-aa8e-7008fe36814a None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:05.482954 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-271a2e8c-062e-4a36-aa8e-7008fe36814a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:05.511101 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:05.596133 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1129/2227] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:53:05.612351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f741863-bd09-4c0d-82c4-4f162ddbed89 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:05.615759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-6f741863-bd09-4c0d-82c4-4f162ddbed89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:05.744846 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f741863-bd09-4c0d-82c4-4f162ddbed89 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:05.750308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced40d0-03a0-4c31-920c-5a40d6fe8411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:05.751339 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced40d0-03a0-4c31-920c-5a40d6fe8411 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:05.751812 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced40d0-03a0-4c31-920c-5a40d6fe8411 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:05.752466 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced40d0-03a0-4c31-920c-5a40d6fe8411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:05.763703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced40d0-03a0-4c31-920c-5a40d6fe8411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:05.765495 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced40d0-03a0-4c31-920c-5a40d6fe8411 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:05.779227 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1099/2228] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:53:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:53:06.335876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a2e8c-062e-4a36-aa8e-7008fe36814a None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:06.337390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-271a2e8c-062e-4a36-aa8e-7008fe36814a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:06.359973 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a2e8c-062e-4a36-aa8e-7008fe36814a None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:06.367378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d0d64-40a1-467d-832a-773f2e4b7aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:06.368712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d0d64-40a1-467d-832a-773f2e4b7aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:06.369091 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d0d64-40a1-467d-832a-773f2e4b7aea admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:06.369526 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d0d64-40a1-467d-832a-773f2e4b7aea admin admin] PATH_INFO: `/v3/projects/e8857038e58644aca81481f84c341eb6` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:06.371032 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d0d64-40a1-467d-832a-773f2e4b7aea admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8857038e58644aca81481f84c341eb6)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:06.374897 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d0d64-40a1-467d-832a-773f2e4b7aea admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:06.435823 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-433d0d64-40a1-467d-832a-773f2e4b7aea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8857038e58644aca81481f84c341eb6', 'request_id': 'req-433d0d64-40a1-467d-832a-773f2e4b7aea'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:06.446336 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-433d0d64-40a1-467d-832a-773f2e4b7aea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8857038e58644aca81481f84c341eb6', 'request_id': 'req-433d0d64-40a1-467d-832a-773f2e4b7aea'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:06.458747 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-433d0d64-40a1-467d-832a-773f2e4b7aea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8857038e58644aca81481f84c341eb6', 'request_id': 'req-433d0d64-40a1-467d-832a-773f2e4b7aea'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:06.474248 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-433d0d64-40a1-467d-832a-773f2e4b7aea admin admin] The token cache is being invalidate because project e8857038e58644aca81481f84c341eb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:53:06.474613 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-433d0d64-40a1-467d-832a-773f2e4b7aea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:06.475339 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-433d0d64-40a1-467d-832a-773f2e4b7aea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:06.480227 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1130/2229] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:53:06 2022] DELETE /identity/v3/projects/e8857038e58644aca81481f84c341eb6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:53:06.481329 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced40d0-03a0-4c31-920c-5a40d6fe8411 service neutron] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:06.493760 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced40d0-03a0-4c31-920c-5a40d6fe8411 service neutron] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:06.623283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaebe3c-c386-431b-8209-5f0ce614ce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:06.631665 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaebe3c-c386-431b-8209-5f0ce614ce87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:06.631665 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaebe3c-c386-431b-8209-5f0ce614ce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:06.631665 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaebe3c-c386-431b-8209-5f0ce614ce87 admin admin] PATH_INFO: `/v3/users/e1782bcf781b46e28130cedfe725bc14` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:06.636133 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaebe3c-c386-431b-8209-5f0ce614ce87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1782bcf781b46e28130cedfe725bc14)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:06.640360 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaebe3c-c386-431b-8209-5f0ce614ce87 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:06.731218 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-cdaebe3c-c386-431b-8209-5f0ce614ce87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1782bcf781b46e28130cedfe725bc14'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:06.744312 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-cdaebe3c-c386-431b-8209-5f0ce614ce87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1782bcf781b46e28130cedfe725bc14'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:06.745062 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-cdaebe3c-c386-431b-8209-5f0ce614ce87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1782bcf781b46e28130cedfe725bc14'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:06.746114 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-cdaebe3c-c386-431b-8209-5f0ce614ce87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1782bcf781b46e28130cedfe725bc14'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:06.764855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-cdaebe3c-c386-431b-8209-5f0ce614ce87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1782bcf781b46e28130cedfe725bc14'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:06.790356 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1100/2230] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:53:06 2022] DELETE /identity/v3/users/e1782bcf781b46e28130cedfe725bc14 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:53:07.270045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d0d64-40a1-467d-832a-773f2e4b7aea admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:07.271857 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-433d0d64-40a1-467d-832a-773f2e4b7aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:07.420448 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d0d64-40a1-467d-832a-773f2e4b7aea admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:07.512907 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:07.550112 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab848d7-7bb5-47df-befa-1897fda136eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:07.551010 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab848d7-7bb5-47df-befa-1897fda136eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:07.551294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab848d7-7bb5-47df-befa-1897fda136eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:07.551588 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab848d7-7bb5-47df-befa-1897fda136eb admin admin] PATH_INFO: `/v3/projects/06bbb5b118554ec9808d0720e24e01ba` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:07.553481 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab848d7-7bb5-47df-befa-1897fda136eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=06bbb5b118554ec9808d0720e24e01ba)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:07.555481 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab848d7-7bb5-47df-befa-1897fda136eb admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:07.676722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-9ab848d7-7bb5-47df-befa-1897fda136eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06bbb5b118554ec9808d0720e24e01ba', 'request_id': 'req-9ab848d7-7bb5-47df-befa-1897fda136eb'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:07.689179 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-9ab848d7-7bb5-47df-befa-1897fda136eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06bbb5b118554ec9808d0720e24e01ba', 'request_id': 'req-9ab848d7-7bb5-47df-befa-1897fda136eb'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:07.708874 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-9ab848d7-7bb5-47df-befa-1897fda136eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06bbb5b118554ec9808d0720e24e01ba', 'request_id': 'req-9ab848d7-7bb5-47df-befa-1897fda136eb'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:07.726970 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-9ab848d7-7bb5-47df-befa-1897fda136eb admin admin] The token cache is being invalidate because project 06bbb5b118554ec9808d0720e24e01ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:53:07.727255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-9ab848d7-7bb5-47df-befa-1897fda136eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:07.728217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-9ab848d7-7bb5-47df-befa-1897fda136eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:07.734760 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1131/2231] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:53:07 2022] DELETE /identity/v3/projects/06bbb5b118554ec9808d0720e24e01ba => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:53:07.740288 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6eaa3-5802-489b-897b-a523b5e51a08 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:07.741118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6eaa3-5802-489b-897b-a523b5e51a08 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:07.741554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6eaa3-5802-489b-897b-a523b5e51a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:07.789244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:07.827701 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-a5d6eaa3-5802-489b-897b-a523b5e51a08 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:07.829454 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-a5d6eaa3-5802-489b-897b-a523b5e51a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:07.936087 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1101/2232] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:53:07.947960 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb55a0-c7be-410c-ba99-7c494415cb80 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:07.948256 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb55a0-c7be-410c-ba99-7c494415cb80 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:07.948543 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb55a0-c7be-410c-ba99-7c494415cb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:07.971389 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-95fb55a0-c7be-410c-ba99-7c494415cb80 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:07.972851 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-95fb55a0-c7be-410c-ba99-7c494415cb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:07.986106 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1132/2233] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:53:07.990866 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6eaa3-5802-489b-897b-a523b5e51a08 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:08.008383 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6eaa3-5802-489b-897b-a523b5e51a08 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:08.015458 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40292f-a913-4413-8cf3-696cdb8acc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:08.016232 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40292f-a913-4413-8cf3-696cdb8acc2f admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:08.016586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40292f-a913-4413-8cf3-696cdb8acc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:08.016934 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40292f-a913-4413-8cf3-696cdb8acc2f admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:08.017794 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40292f-a913-4413-8cf3-696cdb8acc2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:53:08.018854 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40292f-a913-4413-8cf3-696cdb8acc2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:08.020658 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40292f-a913-4413-8cf3-696cdb8acc2f admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:08.036196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1102/2234] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:53:08.041317 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb55a0-c7be-410c-ba99-7c494415cb80 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:08.059673 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb55a0-c7be-410c-ba99-7c494415cb80 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:08.064828 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803db7fa-ce30-49aa-bd7b-5fd483fde156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:08.065659 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803db7fa-ce30-49aa-bd7b-5fd483fde156 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:08.066554 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803db7fa-ce30-49aa-bd7b-5fd483fde156 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:08.067198 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803db7fa-ce30-49aa-bd7b-5fd483fde156 admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:08.067705 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803db7fa-ce30-49aa-bd7b-5fd483fde156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:08.069985 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803db7fa-ce30-49aa-bd7b-5fd483fde156 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:08.114514 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1133/2235] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:53:08 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:53:08.119843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40292f-a913-4413-8cf3-696cdb8acc2f admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:08.137323 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40292f-a913-4413-8cf3-696cdb8acc2f admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:08.288568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a2381-dd55-4cd9-bece-f3846546306e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:08.289404 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a2381-dd55-4cd9-bece-f3846546306e admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:08.289817 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a2381-dd55-4cd9-bece-f3846546306e admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:08.290258 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a2381-dd55-4cd9-bece-f3846546306e admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:08.291397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a2381-dd55-4cd9-bece-f3846546306e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:08.294560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4a2381-dd55-4cd9-bece-f3846546306e admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:08.334943 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1103/2236] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:53:08 2022] POST /identity/v3/users => generated 288 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:53:08.338212 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803db7fa-ce30-49aa-bd7b-5fd483fde156 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:08.354201 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803db7fa-ce30-49aa-bd7b-5fd483fde156 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:08.368400 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b35aa5-d3c7-4dfd-8cbb-f66174a78b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:08.369100 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b35aa5-d3c7-4dfd-8cbb-f66174a78b2a admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:08.369493 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b35aa5-d3c7-4dfd-8cbb-f66174a78b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:08.369663 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b35aa5-d3c7-4dfd-8cbb-f66174a78b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:08.370489 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b35aa5-d3c7-4dfd-8cbb-f66174a78b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:08.372840 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b35aa5-d3c7-4dfd-8cbb-f66174a78b2a admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:08.387910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1134/2237] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:53:08.391583 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a2381-dd55-4cd9-bece-f3846546306e admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:08.414784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a2381-dd55-4cd9-bece-f3846546306e admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:08.422053 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8620e1-002e-4eab-ac05-7c0ef192dc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:08.423013 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8620e1-002e-4eab-ac05-7c0ef192dc76 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:08.423301 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8620e1-002e-4eab-ac05-7c0ef192dc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:08.423633 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8620e1-002e-4eab-ac05-7c0ef192dc76 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:08.424395 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8620e1-002e-4eab-ac05-7c0ef192dc76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:08.426933 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8620e1-002e-4eab-ac05-7c0ef192dc76 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:08.447625 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1104/2238] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:53:08.449278 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b35aa5-d3c7-4dfd-8cbb-f66174a78b2a admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:08.470913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b35aa5-d3c7-4dfd-8cbb-f66174a78b2a admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:08.481642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7643be-ec4f-4dfa-8f71-1bc6fbbb8778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:08.483708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7643be-ec4f-4dfa-8f71-1bc6fbbb8778 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:08.484301 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7643be-ec4f-4dfa-8f71-1bc6fbbb8778 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:08.484880 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7643be-ec4f-4dfa-8f71-1bc6fbbb8778 admin admin] PATH_INFO: `/v3/projects/9255fcb675934ee3bbe06f31d4327862/users/fb51a48ddad545ee8a4ac45a1d8aea3e/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:08.517666 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7643be-ec4f-4dfa-8f71-1bc6fbbb8778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9255fcb675934ee3bbe06f31d4327862, user_id=fb51a48ddad545ee8a4ac45a1d8aea3e, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:08.525357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7643be-ec4f-4dfa-8f71-1bc6fbbb8778 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:08.553994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1135/2239] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:53:08 2022] PUT /identity/v3/projects/9255fcb675934ee3bbe06f31d4327862/users/fb51a48ddad545ee8a4ac45a1d8aea3e/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:53:08.564159 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe82006-6990-40c2-b71a-e5bb46ead1b0 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:08.564459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe82006-6990-40c2-b71a-e5bb46ead1b0 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:08.564741 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe82006-6990-40c2-b71a-e5bb46ead1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:08.641707 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-2fe82006-6990-40c2-b71a-e5bb46ead1b0 None None] MFA Rules not processed for user `fb51a48ddad545ee8a4ac45a1d8aea3e`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:08.644514 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-2fe82006-6990-40c2-b71a-e5bb46ead1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:08.793982 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:08.876434 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1105/2240] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:53:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:53:08.891993 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7643be-ec4f-4dfa-8f71-1bc6fbbb8778 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:08.894630 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-7e7643be-ec4f-4dfa-8f71-1bc6fbbb8778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:09.141511 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7643be-ec4f-4dfa-8f71-1bc6fbbb8778 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:09.161241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854ecec-d240-4103-8d11-38293d96ffda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:09.161958 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854ecec-d240-4103-8d11-38293d96ffda service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:09.162250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854ecec-d240-4103-8d11-38293d96ffda service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:09.162532 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854ecec-d240-4103-8d11-38293d96ffda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:09.217408 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854ecec-d240-4103-8d11-38293d96ffda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:09.218981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854ecec-d240-4103-8d11-38293d96ffda service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:09.236858 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:09.248874 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1136/2241] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:53:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:53:11.727871 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bf9c0-2c49-4e95-b5e6-919d93d0ad5a None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:11.729162 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bf9c0-2c49-4e95-b5e6-919d93d0ad5a None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:11.730859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bf9c0-2c49-4e95-b5e6-919d93d0ad5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:11.758036 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-bd9bf9c0-2c49-4e95-b5e6-919d93d0ad5a None None] MFA Rules not processed for user `dbf2c12174e94e2db9be178973183ced`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:11.759635 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-bd9bf9c0-2c49-4e95-b5e6-919d93d0ad5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:11.926034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1106/2242] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 23 15:53:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:53:11.958097 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854ecec-d240-4103-8d11-38293d96ffda service cinder] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:11.960452 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-2854ecec-d240-4103-8d11-38293d96ffda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:12.110618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854ecec-d240-4103-8d11-38293d96ffda service cinder] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:12.123923 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d7e64-1e17-4db9-9306-597916dcfc8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5824ee17e276483faf20db88a93545f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:12.129197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d7e64-1e17-4db9-9306-597916dcfc8f service swift] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:12.130093 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d7e64-1e17-4db9-9306-597916dcfc8f service swift] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:12.132496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d7e64-1e17-4db9-9306-597916dcfc8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:12.158354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d7e64-1e17-4db9-9306-597916dcfc8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:12.161414 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d7e64-1e17-4db9-9306-597916dcfc8f service swift] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:12.178787 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1137/2243] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 23 15:53:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 15:53:12.745185 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c3820-677e-47ac-afc7-462fae9c8529 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:12.745741 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c3820-677e-47ac-afc7-462fae9c8529 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:12.745889 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c3820-677e-47ac-afc7-462fae9c8529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:12.807072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-f04c3820-677e-47ac-afc7-462fae9c8529 None None] MFA Rules not processed for user `23d80799778a47efab41f86a879c4fba`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:12.809205 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-f04c3820-677e-47ac-afc7-462fae9c8529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:12.963353 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1107/2244] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:53:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:53:13.006738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d7e64-1e17-4db9-9306-597916dcfc8f service swift] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:13.008852 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-df4d7e64-1e17-4db9-9306-597916dcfc8f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:13.149813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d7e64-1e17-4db9-9306-597916dcfc8f service swift] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:13.157820 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4024e-0e00-4b4d-8974-fdd14a344b20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:13.196475 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4024e-0e00-4b4d-8974-fdd14a344b20 service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:13.196475 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4024e-0e00-4b4d-8974-fdd14a344b20 service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:13.196475 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4024e-0e00-4b4d-8974-fdd14a344b20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:13.197015 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-20d4024e-0e00-4b4d-8974-fdd14a344b20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:13.392853 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4024e-0e00-4b4d-8974-fdd14a344b20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:13.397255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4024e-0e00-4b4d-8974-fdd14a344b20 service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:13.452568 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1138/2245] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:53:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:53:13.668518 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c3820-677e-47ac-afc7-462fae9c8529 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:13.839392 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c3820-677e-47ac-afc7-462fae9c8529 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:13.848650 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfb3ac-8295-42f3-ab9f-cc9617e00725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:13.850231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfb3ac-8295-42f3-ab9f-cc9617e00725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:13.850231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfb3ac-8295-42f3-ab9f-cc9617e00725 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:13.854634 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bfb3ac-8295-42f3-ab9f-cc9617e00725 admin admin] PATH_INFO: `/v3/users/fb51a48ddad545ee8a4ac45a1d8aea3e` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:13.859168 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfb3ac-8295-42f3-ab9f-cc9617e00725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb51a48ddad545ee8a4ac45a1d8aea3e)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:13.863554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bfb3ac-8295-42f3-ab9f-cc9617e00725 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:13.963967 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:14.064787 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e2bfb3ac-8295-42f3-ab9f-cc9617e00725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb51a48ddad545ee8a4ac45a1d8aea3e'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:14.083173 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e2bfb3ac-8295-42f3-ab9f-cc9617e00725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb51a48ddad545ee8a4ac45a1d8aea3e'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:14.085926 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e2bfb3ac-8295-42f3-ab9f-cc9617e00725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb51a48ddad545ee8a4ac45a1d8aea3e'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:14.087140 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e2bfb3ac-8295-42f3-ab9f-cc9617e00725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb51a48ddad545ee8a4ac45a1d8aea3e'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:14.113437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e2bfb3ac-8295-42f3-ab9f-cc9617e00725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb51a48ddad545ee8a4ac45a1d8aea3e'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:14.149036 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1108/2246] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:53:13 2022] DELETE /identity/v3/users/fb51a48ddad545ee8a4ac45a1d8aea3e => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:53:14.151818 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc5f6d-02a2-4ce4-8669-25d79c7de043 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:14.155487 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc5f6d-02a2-4ce4-8669-25d79c7de043 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:14.156451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc5f6d-02a2-4ce4-8669-25d79c7de043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:14.202459 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-96dc5f6d-02a2-4ce4-8669-25d79c7de043 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:14.203852 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-96dc5f6d-02a2-4ce4-8669-25d79c7de043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:14.280647 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:14.345923 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1139/2247] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:53:14.359601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfb3ac-8295-42f3-ab9f-cc9617e00725 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:14.362565 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-e2bfb3ac-8295-42f3-ab9f-cc9617e00725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:14.522226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bfb3ac-8295-42f3-ab9f-cc9617e00725 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:14.526702 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a40575-c6de-4a3e-bdbf-0e6ac79a4056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:14.527387 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a40575-c6de-4a3e-bdbf-0e6ac79a4056 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:14.527676 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a40575-c6de-4a3e-bdbf-0e6ac79a4056 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:14.527957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a40575-c6de-4a3e-bdbf-0e6ac79a4056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:14.544963 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a40575-c6de-4a3e-bdbf-0e6ac79a4056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:14.547737 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a40575-c6de-4a3e-bdbf-0e6ac79a4056 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:14.574990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1109/2248] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:53:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:53:15.081719 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc5f6d-02a2-4ce4-8669-25d79c7de043 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:15.084931 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-96dc5f6d-02a2-4ce4-8669-25d79c7de043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:15.143152 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc5f6d-02a2-4ce4-8669-25d79c7de043 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:15.173847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5bd047-a79d-4810-a595-f22580d14153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:15.176325 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bd047-a79d-4810-a595-f22580d14153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:15.176663 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bd047-a79d-4810-a595-f22580d14153 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:15.177208 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bd047-a79d-4810-a595-f22580d14153 admin admin] PATH_INFO: `/v3/projects/9255fcb675934ee3bbe06f31d4327862` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:15.180141 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5bd047-a79d-4810-a595-f22580d14153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9255fcb675934ee3bbe06f31d4327862)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:15.184042 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5bd047-a79d-4810-a595-f22580d14153 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:15.265843 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-fd5bd047-a79d-4810-a595-f22580d14153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9255fcb675934ee3bbe06f31d4327862', 'request_id': 'req-fd5bd047-a79d-4810-a595-f22580d14153'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:15.281266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-fd5bd047-a79d-4810-a595-f22580d14153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9255fcb675934ee3bbe06f31d4327862', 'request_id': 'req-fd5bd047-a79d-4810-a595-f22580d14153'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:15.314791 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-fd5bd047-a79d-4810-a595-f22580d14153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9255fcb675934ee3bbe06f31d4327862', 'request_id': 'req-fd5bd047-a79d-4810-a595-f22580d14153'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:15.342489 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-fd5bd047-a79d-4810-a595-f22580d14153 admin admin] The token cache is being invalidate because project 9255fcb675934ee3bbe06f31d4327862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:53:15.343287 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-fd5bd047-a79d-4810-a595-f22580d14153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:15.344284 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-fd5bd047-a79d-4810-a595-f22580d14153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:15.350607 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1140/2249] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:53:15 2022] DELETE /identity/v3/projects/9255fcb675934ee3bbe06f31d4327862 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:53:15.355994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8b9b5-b418-4b2f-bbbd-4cde762af09f None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:15.357021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8b9b5-b418-4b2f-bbbd-4cde762af09f None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:15.357516 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8b9b5-b418-4b2f-bbbd-4cde762af09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:15.397669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-75f8b9b5-b418-4b2f-bbbd-4cde762af09f None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:15.400542 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-75f8b9b5-b418-4b2f-bbbd-4cde762af09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:15.497948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1110/2250] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:53:15.502590 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6ea74-5287-47f4-886e-a79b100cadf1 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:15.502913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6ea74-5287-47f4-886e-a79b100cadf1 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:15.503286 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6ea74-5287-47f4-886e-a79b100cadf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:15.529834 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-2ca6ea74-5287-47f4-886e-a79b100cadf1 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:15.531038 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-2ca6ea74-5287-47f4-886e-a79b100cadf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:15.542581 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1141/2251] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:53:15.547678 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8b9b5-b418-4b2f-bbbd-4cde762af09f None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:15.568012 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924ff4b-520f-47a3-b92c-e3da0fef7b64 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:15.568303 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924ff4b-520f-47a3-b92c-e3da0fef7b64 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:15.568591 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924ff4b-520f-47a3-b92c-e3da0fef7b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:15.574090 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8b9b5-b418-4b2f-bbbd-4cde762af09f None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:15.582002 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc35d03-93ed-4de7-8aa8-4c70f86fb155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:15.583021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc35d03-93ed-4de7-8aa8-4c70f86fb155 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:15.583656 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc35d03-93ed-4de7-8aa8-4c70f86fb155 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:15.590644 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc35d03-93ed-4de7-8aa8-4c70f86fb155 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:15.595240 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc35d03-93ed-4de7-8aa8-4c70f86fb155 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:53:15.595519 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-d924ff4b-520f-47a3-b92c-e3da0fef7b64 None None] MFA Rules not processed for user `53a77c323a8843709660a12833e99b18`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:15.596899 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-d924ff4b-520f-47a3-b92c-e3da0fef7b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:15.599501 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc35d03-93ed-4de7-8aa8-4c70f86fb155 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:15.602888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc35d03-93ed-4de7-8aa8-4c70f86fb155 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:15.657619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1111/2252] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:53:15.660627 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc35d03-93ed-4de7-8aa8-4c70f86fb155 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:15.685369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1142/2253] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:53:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:53:15.703991 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc35d03-93ed-4de7-8aa8-4c70f86fb155 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:15.724323 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686246b-0d63-4462-ac59-7afaebf6e183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:15.725216 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686246b-0d63-4462-ac59-7afaebf6e183 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:15.725615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686246b-0d63-4462-ac59-7afaebf6e183 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:15.726168 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2686246b-0d63-4462-ac59-7afaebf6e183 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:15.728047 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686246b-0d63-4462-ac59-7afaebf6e183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:15.731721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2686246b-0d63-4462-ac59-7afaebf6e183 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:15.738699 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:15.797680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1112/2254] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:53:15 2022] POST /identity/v3/projects => generated 389 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:53:15.798705 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924ff4b-520f-47a3-b92c-e3da0fef7b64 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:15.813420 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924ff4b-520f-47a3-b92c-e3da0fef7b64 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:15.875164 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:15.893549 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b959c8a-012d-4a38-891c-17986ec4d346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:15.894337 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b959c8a-012d-4a38-891c-17986ec4d346 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:15.894639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b959c8a-012d-4a38-891c-17986ec4d346 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:15.895017 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b959c8a-012d-4a38-891c-17986ec4d346 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:15.895953 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b959c8a-012d-4a38-891c-17986ec4d346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:15.898082 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b959c8a-012d-4a38-891c-17986ec4d346 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:15.930446 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1143/2255] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:53:15 2022] POST /identity/v3/users => generated 295 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:53:15.931892 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686246b-0d63-4462-ac59-7afaebf6e183 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:15.951258 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2686246b-0d63-4462-ac59-7afaebf6e183 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:15.963872 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45202a-ebcd-49b4-ad9e-998825d7b935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:15.964571 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45202a-ebcd-49b4-ad9e-998825d7b935 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:15.964864 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45202a-ebcd-49b4-ad9e-998825d7b935 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:15.965196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45202a-ebcd-49b4-ad9e-998825d7b935 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:15.966102 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45202a-ebcd-49b4-ad9e-998825d7b935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:15.968276 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45202a-ebcd-49b4-ad9e-998825d7b935 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:15.997529 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b959c8a-012d-4a38-891c-17986ec4d346 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:15.999318 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1113/2256] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:53:16.011553 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b959c8a-012d-4a38-891c-17986ec4d346 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:16.020050 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0337b-da8f-4c73-9664-ae38f40f6a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:16.020922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0337b-da8f-4c73-9664-ae38f40f6a5f admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:16.021422 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0337b-da8f-4c73-9664-ae38f40f6a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:16.021934 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0337b-da8f-4c73-9664-ae38f40f6a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:16.023167 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0337b-da8f-4c73-9664-ae38f40f6a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:16.025802 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0337b-da8f-4c73-9664-ae38f40f6a5f admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:16.041033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1144/2257] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 15:53:16.046278 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45202a-ebcd-49b4-ad9e-998825d7b935 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:16.059156 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45202a-ebcd-49b4-ad9e-998825d7b935 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:16.074905 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7447d-0e61-4828-9102-b6609145bc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:16.076338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7447d-0e61-4828-9102-b6609145bc38 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:16.076788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7447d-0e61-4828-9102-b6609145bc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:16.077254 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7447d-0e61-4828-9102-b6609145bc38 admin admin] PATH_INFO: `/v3/projects/45b4520cc77a4ae4b43bd87396393128/users/b8beebc0743b4bc39e92439effa2a00e/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:16.122454 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7447d-0e61-4828-9102-b6609145bc38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45b4520cc77a4ae4b43bd87396393128, user_id=b8beebc0743b4bc39e92439effa2a00e, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:16.126241 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db7447d-0e61-4828-9102-b6609145bc38 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:16.167741 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1114/2258] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:53:16 2022] PUT /identity/v3/projects/45b4520cc77a4ae4b43bd87396393128/users/b8beebc0743b4bc39e92439effa2a00e/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:53:16.185455 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd2d98-c205-4d27-bc8f-1b367616eab6 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:16.186604 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd2d98-c205-4d27-bc8f-1b367616eab6 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:16.186604 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd2d98-c205-4d27-bc8f-1b367616eab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:16.266904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-dbdd2d98-c205-4d27-bc8f-1b367616eab6 None None] MFA Rules not processed for user `b8beebc0743b4bc39e92439effa2a00e`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:16.270735 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-dbdd2d98-c205-4d27-bc8f-1b367616eab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:16.568783 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1145/2259] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:53:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:53:16.591331 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7447d-0e61-4828-9102-b6609145bc38 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:16.593798 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-2db7447d-0e61-4828-9102-b6609145bc38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:16.707996 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db7447d-0e61-4828-9102-b6609145bc38 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:16.717798 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cf4cd-f38c-432b-aa81-df45fd94a6da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:16.718509 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cf4cd-f38c-432b-aa81-df45fd94a6da service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:16.718796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cf4cd-f38c-432b-aa81-df45fd94a6da service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:16.719104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cf4cd-f38c-432b-aa81-df45fd94a6da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:16.731568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202cf4cd-f38c-432b-aa81-df45fd94a6da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:16.733915 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202cf4cd-f38c-432b-aa81-df45fd94a6da service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:16.745310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1115/2260] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:53:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:53:26.548814 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=44,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:26.740987 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=46,keystone:INSERT=2 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:28.587740 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd2d98-c205-4d27-bc8f-1b367616eab6 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:28.701964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd2d98-c205-4d27-bc8f-1b367616eab6 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:28.708766 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca8f13-5a45-4f20-a4eb-a2ffa425d4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:28.709632 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca8f13-5a45-4f20-a4eb-a2ffa425d4b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:28.710631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca8f13-5a45-4f20-a4eb-a2ffa425d4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:28.710631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca8f13-5a45-4f20-a4eb-a2ffa425d4b1 admin admin] PATH_INFO: `/v3/users/b8beebc0743b4bc39e92439effa2a00e` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:28.713919 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca8f13-5a45-4f20-a4eb-a2ffa425d4b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8beebc0743b4bc39e92439effa2a00e)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:28.720612 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca8f13-5a45-4f20-a4eb-a2ffa425d4b1 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:28.812329 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-46ca8f13-5a45-4f20-a4eb-a2ffa425d4b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8beebc0743b4bc39e92439effa2a00e'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:28.834122 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-46ca8f13-5a45-4f20-a4eb-a2ffa425d4b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8beebc0743b4bc39e92439effa2a00e'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:28.835527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-46ca8f13-5a45-4f20-a4eb-a2ffa425d4b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8beebc0743b4bc39e92439effa2a00e'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:28.836581 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-46ca8f13-5a45-4f20-a4eb-a2ffa425d4b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8beebc0743b4bc39e92439effa2a00e'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:28.857586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-46ca8f13-5a45-4f20-a4eb-a2ffa425d4b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8beebc0743b4bc39e92439effa2a00e'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:28.878528 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1146/2261] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:53:28 2022] DELETE /identity/v3/users/b8beebc0743b4bc39e92439effa2a00e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:53:28.888042 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6ca8a-10b3-4db3-9ea5-f7e4dd02169d None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:28.888680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6ca8a-10b3-4db3-9ea5-f7e4dd02169d None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:28.888892 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6ca8a-10b3-4db3-9ea5-f7e4dd02169d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:28.918813 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-75e6ca8a-10b3-4db3-9ea5-f7e4dd02169d None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:28.920838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-75e6ca8a-10b3-4db3-9ea5-f7e4dd02169d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:29.038105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1116/2262] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:53:29.057889 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca8f13-5a45-4f20-a4eb-a2ffa425d4b1 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:29.057889 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-46ca8f13-5a45-4f20-a4eb-a2ffa425d4b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:29.134891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca8f13-5a45-4f20-a4eb-a2ffa425d4b1 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:29.139287 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf8d71-bccc-4bd6-b9ad-a1fa890ee4a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:29.140157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf8d71-bccc-4bd6-b9ad-a1fa890ee4a5 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:29.140555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf8d71-bccc-4bd6-b9ad-a1fa890ee4a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:29.140935 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf8d71-bccc-4bd6-b9ad-a1fa890ee4a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:29.153362 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf8d71-bccc-4bd6-b9ad-a1fa890ee4a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:29.156025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf8d71-bccc-4bd6-b9ad-a1fa890ee4a5 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:29.172399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1147/2263] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:53:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:53:29.774434 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6ca8a-10b3-4db3-9ea5-f7e4dd02169d None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:29.777430 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-75e6ca8a-10b3-4db3-9ea5-f7e4dd02169d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:29.810348 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6ca8a-10b3-4db3-9ea5-f7e4dd02169d None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:29.822943 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55b816-9cb8-4e97-b368-2644b6791036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:29.824907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55b816-9cb8-4e97-b368-2644b6791036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:29.825372 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55b816-9cb8-4e97-b368-2644b6791036 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:29.826015 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a55b816-9cb8-4e97-b368-2644b6791036 admin admin] PATH_INFO: `/v3/projects/45b4520cc77a4ae4b43bd87396393128` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:29.828556 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55b816-9cb8-4e97-b368-2644b6791036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45b4520cc77a4ae4b43bd87396393128)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:29.832095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a55b816-9cb8-4e97-b368-2644b6791036 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:29.941755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-3a55b816-9cb8-4e97-b368-2644b6791036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45b4520cc77a4ae4b43bd87396393128', 'request_id': 'req-3a55b816-9cb8-4e97-b368-2644b6791036'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:29.962343 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-3a55b816-9cb8-4e97-b368-2644b6791036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45b4520cc77a4ae4b43bd87396393128', 'request_id': 'req-3a55b816-9cb8-4e97-b368-2644b6791036'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:29.984344 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-3a55b816-9cb8-4e97-b368-2644b6791036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45b4520cc77a4ae4b43bd87396393128', 'request_id': 'req-3a55b816-9cb8-4e97-b368-2644b6791036'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:30.009990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-3a55b816-9cb8-4e97-b368-2644b6791036 admin admin] The token cache is being invalidate because project 45b4520cc77a4ae4b43bd87396393128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:53:30.010637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-3a55b816-9cb8-4e97-b368-2644b6791036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:30.011838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-3a55b816-9cb8-4e97-b368-2644b6791036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:30.014279 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1117/2264] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:53:29 2022] DELETE /identity/v3/projects/45b4520cc77a4ae4b43bd87396393128 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:53:37.729833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5136374-c052-4422-9d5f-2f124c5df62a None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:37.730534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5136374-c052-4422-9d5f-2f124c5df62a None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:37.730534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5136374-c052-4422-9d5f-2f124c5df62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:37.763211 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-c5136374-c052-4422-9d5f-2f124c5df62a None None] MFA Rules not processed for user `dbf2c12174e94e2db9be178973183ced`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:37.764478 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-c5136374-c052-4422-9d5f-2f124c5df62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:37.775014 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:37.861213 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1148/2265] 10.222.0.15 () {58 vars in 967 bytes} [Thu Jun 23 15:53:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:53:37.874775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55b816-9cb8-4e97-b368-2644b6791036 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:37.876365 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-3a55b816-9cb8-4e97-b368-2644b6791036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:37.947503 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a55b816-9cb8-4e97-b368-2644b6791036 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:37.952466 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af68534-13c0-4b39-b4c8-8715d5ed7a55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5824ee17e276483faf20db88a93545f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:37.953117 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af68534-13c0-4b39-b4c8-8715d5ed7a55 service swift] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:37.953409 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af68534-13c0-4b39-b4c8-8715d5ed7a55 service swift] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:37.953674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af68534-13c0-4b39-b4c8-8715d5ed7a55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:37.962696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af68534-13c0-4b39-b4c8-8715d5ed7a55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:37.964388 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af68534-13c0-4b39-b4c8-8715d5ed7a55 service swift] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:37.973343 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1118/2266] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 23 15:53:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 15:53:39.980100 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5136374-c052-4422-9d5f-2f124c5df62a None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:39.982012 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-c5136374-c052-4422-9d5f-2f124c5df62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:40.072038 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5136374-c052-4422-9d5f-2f124c5df62a None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:40.077115 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92620d64-122c-4a80-8c38-cddc8103ce2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:40.078149 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92620d64-122c-4a80-8c38-cddc8103ce2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:40.078509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92620d64-122c-4a80-8c38-cddc8103ce2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:40.078842 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92620d64-122c-4a80-8c38-cddc8103ce2b admin admin] PATH_INFO: `/v3/users/4d4eabecb1e9447ebe2c705623ade25e` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:40.080749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92620d64-122c-4a80-8c38-cddc8103ce2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d4eabecb1e9447ebe2c705623ade25e)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:40.083651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92620d64-122c-4a80-8c38-cddc8103ce2b admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:40.154652 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-92620d64-122c-4a80-8c38-cddc8103ce2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d4eabecb1e9447ebe2c705623ade25e'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:40.169132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-92620d64-122c-4a80-8c38-cddc8103ce2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d4eabecb1e9447ebe2c705623ade25e'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:40.173053 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-92620d64-122c-4a80-8c38-cddc8103ce2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d4eabecb1e9447ebe2c705623ade25e'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:40.174528 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-92620d64-122c-4a80-8c38-cddc8103ce2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d4eabecb1e9447ebe2c705623ade25e'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:40.196361 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-92620d64-122c-4a80-8c38-cddc8103ce2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d4eabecb1e9447ebe2c705623ade25e'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:40.220752 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1149/2267] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:53:39 2022] DELETE /identity/v3/users/4d4eabecb1e9447ebe2c705623ade25e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:53:40.437576 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af68534-13c0-4b39-b4c8-8715d5ed7a55 service swift] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:40.450067 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af68534-13c0-4b39-b4c8-8715d5ed7a55 service swift] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:40.463133 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:40.527149 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d12459-5e33-4b0f-aacc-452de2c9e428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:40.528067 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d12459-5e33-4b0f-aacc-452de2c9e428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:40.528354 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d12459-5e33-4b0f-aacc-452de2c9e428 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:40.528634 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d12459-5e33-4b0f-aacc-452de2c9e428 admin admin] PATH_INFO: `/v3/projects/16eebdfb6a744de7b0c14a476834ab4c` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:40.530022 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d12459-5e33-4b0f-aacc-452de2c9e428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16eebdfb6a744de7b0c14a476834ab4c)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:40.532275 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d12459-5e33-4b0f-aacc-452de2c9e428 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:40.590405 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a2d12459-5e33-4b0f-aacc-452de2c9e428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16eebdfb6a744de7b0c14a476834ab4c', 'request_id': 'req-a2d12459-5e33-4b0f-aacc-452de2c9e428'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:40.599112 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a2d12459-5e33-4b0f-aacc-452de2c9e428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16eebdfb6a744de7b0c14a476834ab4c', 'request_id': 'req-a2d12459-5e33-4b0f-aacc-452de2c9e428'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:40.607489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a2d12459-5e33-4b0f-aacc-452de2c9e428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16eebdfb6a744de7b0c14a476834ab4c', 'request_id': 'req-a2d12459-5e33-4b0f-aacc-452de2c9e428'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:40.620078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a2d12459-5e33-4b0f-aacc-452de2c9e428 admin admin] The token cache is being invalidate because project 16eebdfb6a744de7b0c14a476834ab4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:53:40.620364 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a2d12459-5e33-4b0f-aacc-452de2c9e428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:40.621065 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a2d12459-5e33-4b0f-aacc-452de2c9e428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:40.622723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1119/2268] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:53:40 2022] DELETE /identity/v3/projects/16eebdfb6a744de7b0c14a476834ab4c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:53:40.628251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7ab34-9a7e-44c7-89ed-8a1423b24e94 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:40.628541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7ab34-9a7e-44c7-89ed-8a1423b24e94 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:40.628824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7ab34-9a7e-44c7-89ed-8a1423b24e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:40.660997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-d8e7ab34-9a7e-44c7-89ed-8a1423b24e94 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:40.661900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-d8e7ab34-9a7e-44c7-89ed-8a1423b24e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:40.680061 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:40.731214 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1150/2269] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:53:40.740495 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48da080-37d8-46bb-8610-53c9ff805e62 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:40.740908 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48da080-37d8-46bb-8610-53c9ff805e62 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:40.741325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48da080-37d8-46bb-8610-53c9ff805e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:40.761108 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-f48da080-37d8-46bb-8610-53c9ff805e62 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:40.762385 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-f48da080-37d8-46bb-8610-53c9ff805e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:40.770703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1120/2270] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:53:40.775248 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7ab34-9a7e-44c7-89ed-8a1423b24e94 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:40.789634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7ab34-9a7e-44c7-89ed-8a1423b24e94 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:40.794751 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc78d68-285d-4d7b-b1bb-ff901e45363a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:40.795423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc78d68-285d-4d7b-b1bb-ff901e45363a admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:40.795707 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc78d68-285d-4d7b-b1bb-ff901e45363a admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:40.795986 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc78d68-285d-4d7b-b1bb-ff901e45363a admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:40.796732 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc78d68-285d-4d7b-b1bb-ff901e45363a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:53:40.797040 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc78d68-285d-4d7b-b1bb-ff901e45363a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:40.798722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc78d68-285d-4d7b-b1bb-ff901e45363a admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:40.819112 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1151/2271] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:53:40.823790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48da080-37d8-46bb-8610-53c9ff805e62 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:40.833429 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48da080-37d8-46bb-8610-53c9ff805e62 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:40.838339 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a6728-da5d-4c9a-bb1d-d5d803271db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:40.839026 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a6728-da5d-4c9a-bb1d-d5d803271db0 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:40.839291 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a6728-da5d-4c9a-bb1d-d5d803271db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:40.839570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a6728-da5d-4c9a-bb1d-d5d803271db0 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:40.840268 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a6728-da5d-4c9a-bb1d-d5d803271db0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:40.842310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a6728-da5d-4c9a-bb1d-d5d803271db0 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:40.869794 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1121/2272] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:53:40 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:53:40.874338 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc78d68-285d-4d7b-b1bb-ff901e45363a admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:40.885409 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc78d68-285d-4d7b-b1bb-ff901e45363a admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:40.946541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebf1e4-0b6e-4a4d-8c03-4adc01f9e21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:40.947222 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebf1e4-0b6e-4a4d-8c03-4adc01f9e21c admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:40.947506 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebf1e4-0b6e-4a4d-8c03-4adc01f9e21c admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:40.947782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebf1e4-0b6e-4a4d-8c03-4adc01f9e21c admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:40.948491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebf1e4-0b6e-4a4d-8c03-4adc01f9e21c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:40.950451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebf1e4-0b6e-4a4d-8c03-4adc01f9e21c admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:40.976186 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1152/2273] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:53:40 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:53:40.980328 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a6728-da5d-4c9a-bb1d-d5d803271db0 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:40.991796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a6728-da5d-4c9a-bb1d-d5d803271db0 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:40.996648 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8b88f-a126-457b-ab1c-bf019b0821ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:40.997323 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8b88f-a126-457b-ab1c-bf019b0821ff admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:40.997610 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8b88f-a126-457b-ab1c-bf019b0821ff admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:40.997916 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8b88f-a126-457b-ab1c-bf019b0821ff admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:40.998658 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8b88f-a126-457b-ab1c-bf019b0821ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:41.000276 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8b88f-a126-457b-ab1c-bf019b0821ff admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:41.012155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1122/2274] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 15:53:41.016531 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebf1e4-0b6e-4a4d-8c03-4adc01f9e21c admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:41.027649 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebf1e4-0b6e-4a4d-8c03-4adc01f9e21c admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:41.033307 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399d54c-aabb-488d-90a6-773585d9890f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:41.034436 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399d54c-aabb-488d-90a6-773585d9890f admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:41.034733 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399d54c-aabb-488d-90a6-773585d9890f admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:41.035158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399d54c-aabb-488d-90a6-773585d9890f admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:41.036006 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399d54c-aabb-488d-90a6-773585d9890f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:41.037665 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e399d54c-aabb-488d-90a6-773585d9890f admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:41.048787 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1153/2275] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:53:41.053715 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8b88f-a126-457b-ab1c-bf019b0821ff admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:41.066286 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8b88f-a126-457b-ab1c-bf019b0821ff admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:41.073102 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40acd5a-25cd-4e13-878b-f5a1a7e3048e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:41.074043 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40acd5a-25cd-4e13-878b-f5a1a7e3048e admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:41.074324 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40acd5a-25cd-4e13-878b-f5a1a7e3048e admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:41.074605 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40acd5a-25cd-4e13-878b-f5a1a7e3048e admin admin] PATH_INFO: `/v3/projects/5e19aed64c664863b776b0daafaf825c/users/7baab75541e941fbad80e430126adad9/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:41.090488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40acd5a-25cd-4e13-878b-f5a1a7e3048e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e19aed64c664863b776b0daafaf825c, user_id=7baab75541e941fbad80e430126adad9, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:41.093202 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40acd5a-25cd-4e13-878b-f5a1a7e3048e admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:41.108533 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1123/2276] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:53:41 2022] PUT /identity/v3/projects/5e19aed64c664863b776b0daafaf825c/users/7baab75541e941fbad80e430126adad9/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:53:41.119880 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f584b0-b02c-40b3-80e7-792c70a4d0c7 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:41.120339 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f584b0-b02c-40b3-80e7-792c70a4d0c7 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:41.120713 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f584b0-b02c-40b3-80e7-792c70a4d0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:41.167875 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-06f584b0-b02c-40b3-80e7-792c70a4d0c7 None None] MFA Rules not processed for user `7baab75541e941fbad80e430126adad9`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:41.170290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-06f584b0-b02c-40b3-80e7-792c70a4d0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:41.256889 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1154/2277] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:53:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:53:41.269341 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40acd5a-25cd-4e13-878b-f5a1a7e3048e admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:41.271192 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-d40acd5a-25cd-4e13-878b-f5a1a7e3048e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:41.342167 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:41.419163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40acd5a-25cd-4e13-878b-f5a1a7e3048e admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:41.426071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7f22f-0901-4df7-97ac-b40a884b8458 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:41.427189 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7f22f-0901-4df7-97ac-b40a884b8458 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:41.427681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7f22f-0901-4df7-97ac-b40a884b8458 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:41.428124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7f22f-0901-4df7-97ac-b40a884b8458 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:41.443637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7f22f-0901-4df7-97ac-b40a884b8458 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:41.446118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7f22f-0901-4df7-97ac-b40a884b8458 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:41.463675 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1124/2278] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:53:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:53:45.151712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f584b0-b02c-40b3-80e7-792c70a4d0c7 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:45.173803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:45.240814 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f584b0-b02c-40b3-80e7-792c70a4d0c7 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:45.246131 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f006e5-50c5-4f3b-a07a-552ea6b5df01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:45.247413 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f006e5-50c5-4f3b-a07a-552ea6b5df01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:45.247683 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f006e5-50c5-4f3b-a07a-552ea6b5df01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:45.248137 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f006e5-50c5-4f3b-a07a-552ea6b5df01 admin admin] PATH_INFO: `/v3/users/7baab75541e941fbad80e430126adad9` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:45.249606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f006e5-50c5-4f3b-a07a-552ea6b5df01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7baab75541e941fbad80e430126adad9)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:45.251527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f006e5-50c5-4f3b-a07a-552ea6b5df01 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:45.327257 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b1f006e5-50c5-4f3b-a07a-552ea6b5df01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7baab75541e941fbad80e430126adad9'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:45.337141 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b1f006e5-50c5-4f3b-a07a-552ea6b5df01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7baab75541e941fbad80e430126adad9'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:45.338195 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b1f006e5-50c5-4f3b-a07a-552ea6b5df01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7baab75541e941fbad80e430126adad9'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:45.338842 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b1f006e5-50c5-4f3b-a07a-552ea6b5df01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7baab75541e941fbad80e430126adad9'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:45.356589 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b1f006e5-50c5-4f3b-a07a-552ea6b5df01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7baab75541e941fbad80e430126adad9'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:45.375079 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1155/2279] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:53:45 2022] DELETE /identity/v3/users/7baab75541e941fbad80e430126adad9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:53:45.380161 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5d6c3-78de-48df-b1f0-e93369b649e9 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:45.380918 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5d6c3-78de-48df-b1f0-e93369b649e9 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:45.380918 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5d6c3-78de-48df-b1f0-e93369b649e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:45.405214 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-12a5d6c3-78de-48df-b1f0-e93369b649e9 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:45.406376 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-12a5d6c3-78de-48df-b1f0-e93369b649e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:45.487747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1125/2280] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:53:45.501504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f006e5-50c5-4f3b-a07a-552ea6b5df01 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:45.503726 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-b1f006e5-50c5-4f3b-a07a-552ea6b5df01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:45.578698 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f006e5-50c5-4f3b-a07a-552ea6b5df01 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:45.583930 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd1ffd-1274-4328-9609-6d429c95da04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:45.584891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd1ffd-1274-4328-9609-6d429c95da04 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:45.585336 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd1ffd-1274-4328-9609-6d429c95da04 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:45.585790 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd1ffd-1274-4328-9609-6d429c95da04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:45.604210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd1ffd-1274-4328-9609-6d429c95da04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:45.605680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd1ffd-1274-4328-9609-6d429c95da04 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:45.618103 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1156/2281] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:53:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:53:46.206927 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5d6c3-78de-48df-b1f0-e93369b649e9 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:46.208851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-12a5d6c3-78de-48df-b1f0-e93369b649e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:46.225144 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5d6c3-78de-48df-b1f0-e93369b649e9 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:46.231432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9287df-7793-4323-a103-a23be813333d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:46.232568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9287df-7793-4323-a103-a23be813333d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:46.232952 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9287df-7793-4323-a103-a23be813333d admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:46.233324 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9287df-7793-4323-a103-a23be813333d admin admin] PATH_INFO: `/v3/projects/5e19aed64c664863b776b0daafaf825c` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:46.234755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9287df-7793-4323-a103-a23be813333d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e19aed64c664863b776b0daafaf825c)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:46.237380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9287df-7793-4323-a103-a23be813333d admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:46.316957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-9e9287df-7793-4323-a103-a23be813333d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e19aed64c664863b776b0daafaf825c', 'request_id': 'req-9e9287df-7793-4323-a103-a23be813333d'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:46.331129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-9e9287df-7793-4323-a103-a23be813333d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e19aed64c664863b776b0daafaf825c', 'request_id': 'req-9e9287df-7793-4323-a103-a23be813333d'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:46.339785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-9e9287df-7793-4323-a103-a23be813333d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e19aed64c664863b776b0daafaf825c', 'request_id': 'req-9e9287df-7793-4323-a103-a23be813333d'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:46.356501 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-9e9287df-7793-4323-a103-a23be813333d admin admin] The token cache is being invalidate because project 5e19aed64c664863b776b0daafaf825c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:53:46.357208 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-9e9287df-7793-4323-a103-a23be813333d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:46.358282 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-9e9287df-7793-4323-a103-a23be813333d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:46.360760 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1126/2282] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:53:46 2022] DELETE /identity/v3/projects/5e19aed64c664863b776b0daafaf825c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:53:46.366955 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ec162-b6e9-4897-9d6b-0900e89b1627 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:46.367976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ec162-b6e9-4897-9d6b-0900e89b1627 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:46.367976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ec162-b6e9-4897-9d6b-0900e89b1627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:46.391150 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-511ec162-b6e9-4897-9d6b-0900e89b1627 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:46.392421 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-511ec162-b6e9-4897-9d6b-0900e89b1627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:46.465876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:46.501360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1157/2283] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:53:46.514573 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea10188-a086-444f-94b0-9958246b950b None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:46.515381 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea10188-a086-444f-94b0-9958246b950b None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:46.515381 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea10188-a086-444f-94b0-9958246b950b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:46.537576 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-6ea10188-a086-444f-94b0-9958246b950b None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:46.539016 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-6ea10188-a086-444f-94b0-9958246b950b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:46.548165 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1127/2284] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:53:46.554996 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ec162-b6e9-4897-9d6b-0900e89b1627 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:46.574198 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ec162-b6e9-4897-9d6b-0900e89b1627 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:46.579138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818b1c2-3691-4208-a1da-ed54cce6c31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:46.579818 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818b1c2-3691-4208-a1da-ed54cce6c31e admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:46.580143 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818b1c2-3691-4208-a1da-ed54cce6c31e admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:46.580371 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818b1c2-3691-4208-a1da-ed54cce6c31e admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:46.581123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818b1c2-3691-4208-a1da-ed54cce6c31e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:53:46.581436 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818b1c2-3691-4208-a1da-ed54cce6c31e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:46.583106 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818b1c2-3691-4208-a1da-ed54cce6c31e admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:46.596807 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1158/2285] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:53:46.601470 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea10188-a086-444f-94b0-9958246b950b None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:46.612685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea10188-a086-444f-94b0-9958246b950b None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:46.618225 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ecb27-d94c-4473-b0d8-1aab3129b718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:46.618950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ecb27-d94c-4473-b0d8-1aab3129b718 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:46.619313 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ecb27-d94c-4473-b0d8-1aab3129b718 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:46.619688 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ecb27-d94c-4473-b0d8-1aab3129b718 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:46.620617 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ecb27-d94c-4473-b0d8-1aab3129b718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:46.622949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ecb27-d94c-4473-b0d8-1aab3129b718 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:46.651141 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1128/2286] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:53:46 2022] POST /identity/v3/projects => generated 397 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:53:46.655577 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818b1c2-3691-4208-a1da-ed54cce6c31e admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:46.667648 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818b1c2-3691-4208-a1da-ed54cce6c31e admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:46.789592 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59159918-7e9a-4003-92b6-617c4f1cb73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:46.790221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59159918-7e9a-4003-92b6-617c4f1cb73b admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:46.792143 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59159918-7e9a-4003-92b6-617c4f1cb73b admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:46.792851 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59159918-7e9a-4003-92b6-617c4f1cb73b admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:46.794890 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59159918-7e9a-4003-92b6-617c4f1cb73b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:46.807672 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59159918-7e9a-4003-92b6-617c4f1cb73b admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:46.868771 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1159/2287] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:53:46 2022] POST /identity/v3/users => generated 299 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:53:46.875010 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ecb27-d94c-4473-b0d8-1aab3129b718 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:46.886908 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ecb27-d94c-4473-b0d8-1aab3129b718 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:46.910885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130d306-8077-42f3-b55f-73048ef536ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:46.911923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130d306-8077-42f3-b55f-73048ef536ad admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:46.912243 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130d306-8077-42f3-b55f-73048ef536ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:46.912700 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130d306-8077-42f3-b55f-73048ef536ad admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:46.913611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130d306-8077-42f3-b55f-73048ef536ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:46.915723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c130d306-8077-42f3-b55f-73048ef536ad admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:46.932205 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1129/2288] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:53:46.937120 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59159918-7e9a-4003-92b6-617c4f1cb73b admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:46.950273 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59159918-7e9a-4003-92b6-617c4f1cb73b admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:46.956117 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3566e-1dc3-48f4-8303-b44e0f0c4e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:46.956949 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3566e-1dc3-48f4-8303-b44e0f0c4e4c admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:46.957300 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3566e-1dc3-48f4-8303-b44e0f0c4e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:46.957583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3566e-1dc3-48f4-8303-b44e0f0c4e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:46.958463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3566e-1dc3-48f4-8303-b44e0f0c4e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:46.960311 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3566e-1dc3-48f4-8303-b44e0f0c4e4c admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:46.977533 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130d306-8077-42f3-b55f-73048ef536ad admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:46.977972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1160/2289] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:53:46.998717 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c130d306-8077-42f3-b55f-73048ef536ad admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:47.007755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0490d7-294a-4ba1-9cea-e395bd1c2670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:47.010060 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0490d7-294a-4ba1-9cea-e395bd1c2670 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:47.010870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0490d7-294a-4ba1-9cea-e395bd1c2670 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:47.012142 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0490d7-294a-4ba1-9cea-e395bd1c2670 admin admin] PATH_INFO: `/v3/projects/98bb7d4ac21f4792a969498a8fb40d8f/users/56f5b074355f494ea6b75e0e1d678a0c/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:47.016509 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:47.049600 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0490d7-294a-4ba1-9cea-e395bd1c2670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98bb7d4ac21f4792a969498a8fb40d8f, user_id=56f5b074355f494ea6b75e0e1d678a0c, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:47.054909 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0490d7-294a-4ba1-9cea-e395bd1c2670 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:47.082074 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1130/2290] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:53:46 2022] PUT /identity/v3/projects/98bb7d4ac21f4792a969498a8fb40d8f/users/56f5b074355f494ea6b75e0e1d678a0c/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:53:47.094680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c0d26-bf3c-4abe-a224-d92f257809b4 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:47.094948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c0d26-bf3c-4abe-a224-d92f257809b4 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:47.095248 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c0d26-bf3c-4abe-a224-d92f257809b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:47.161072 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-a20c0d26-bf3c-4abe-a224-d92f257809b4 None None] MFA Rules not processed for user `56f5b074355f494ea6b75e0e1d678a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:47.163628 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-a20c0d26-bf3c-4abe-a224-d92f257809b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:47.274328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1161/2291] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:53:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:53:47.288475 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0490d7-294a-4ba1-9cea-e395bd1c2670 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:47.291117 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-5d0490d7-294a-4ba1-9cea-e395bd1c2670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:47.365515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0490d7-294a-4ba1-9cea-e395bd1c2670 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:47.371291 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400dbd3-6187-4f8b-b477-c0e78c6aef86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:47.371291 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400dbd3-6187-4f8b-b477-c0e78c6aef86 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:47.371291 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400dbd3-6187-4f8b-b477-c0e78c6aef86 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:47.371291 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400dbd3-6187-4f8b-b477-c0e78c6aef86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:47.383651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400dbd3-6187-4f8b-b477-c0e78c6aef86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:47.386555 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400dbd3-6187-4f8b-b477-c0e78c6aef86 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:47.405953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1131/2292] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:53:47 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:53:47.942989 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ce731-e302-49cf-98de-41932d97dbb1 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:47.943531 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ce731-e302-49cf-98de-41932d97dbb1 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:47.943846 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ce731-e302-49cf-98de-41932d97dbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:47.965579 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-e66ce731-e302-49cf-98de-41932d97dbb1 None None] MFA Rules not processed for user `7fe974cf493c4545abc70a6745359a66`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:47.967227 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e66ce731-e302-49cf-98de-41932d97dbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:48.019622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:48.045053 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1162/2293] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:53:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:53:52.717819 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400dbd3-6187-4f8b-b477-c0e78c6aef86 service cinder] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:52.789646 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400dbd3-6187-4f8b-b477-c0e78c6aef86 service cinder] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:52.794398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652fbbf-ed48-4d66-8e2c-30bd2255d6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:52.795390 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652fbbf-ed48-4d66-8e2c-30bd2255d6ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:52.795842 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652fbbf-ed48-4d66-8e2c-30bd2255d6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:52.796185 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652fbbf-ed48-4d66-8e2c-30bd2255d6ea admin admin] PATH_INFO: `/v3/users/56f5b074355f494ea6b75e0e1d678a0c` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:52.798050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652fbbf-ed48-4d66-8e2c-30bd2255d6ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=56f5b074355f494ea6b75e0e1d678a0c)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:52.802623 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652fbbf-ed48-4d66-8e2c-30bd2255d6ea admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:52.868546 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-0652fbbf-ed48-4d66-8e2c-30bd2255d6ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56f5b074355f494ea6b75e0e1d678a0c'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:52.877728 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-0652fbbf-ed48-4d66-8e2c-30bd2255d6ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56f5b074355f494ea6b75e0e1d678a0c'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:52.878769 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-0652fbbf-ed48-4d66-8e2c-30bd2255d6ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56f5b074355f494ea6b75e0e1d678a0c'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:52.879634 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-0652fbbf-ed48-4d66-8e2c-30bd2255d6ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56f5b074355f494ea6b75e0e1d678a0c'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:52.894835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-0652fbbf-ed48-4d66-8e2c-30bd2255d6ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56f5b074355f494ea6b75e0e1d678a0c'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:52.911416 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1132/2294] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:53:52 2022] DELETE /identity/v3/users/56f5b074355f494ea6b75e0e1d678a0c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:53:52.917049 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9708b-61bd-45a6-b99a-1b1fcd2d7f18 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:52.918473 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9708b-61bd-45a6-b99a-1b1fcd2d7f18 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:52.918473 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9708b-61bd-45a6-b99a-1b1fcd2d7f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:52.946545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-e7a9708b-61bd-45a6-b99a-1b1fcd2d7f18 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:53:52.947823 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e7a9708b-61bd-45a6-b99a-1b1fcd2d7f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:53.020604 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1163/2295] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:53:53.033074 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652fbbf-ed48-4d66-8e2c-30bd2255d6ea admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:53.034908 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-0652fbbf-ed48-4d66-8e2c-30bd2255d6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:53.042229 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:53.098331 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652fbbf-ed48-4d66-8e2c-30bd2255d6ea admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:53.102061 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb406a-766b-41e7-93ce-62d9e4a8b126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:53.102714 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb406a-766b-41e7-93ce-62d9e4a8b126 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:53.102999 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb406a-766b-41e7-93ce-62d9e4a8b126 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:53.103282 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb406a-766b-41e7-93ce-62d9e4a8b126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:53.113807 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb406a-766b-41e7-93ce-62d9e4a8b126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:53.115211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb406a-766b-41e7-93ce-62d9e4a8b126 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:53.125362 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1133/2296] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:53:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:53:53.445121 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9708b-61bd-45a6-b99a-1b1fcd2d7f18 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:53:53.447025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e7a9708b-61bd-45a6-b99a-1b1fcd2d7f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:53:53.463077 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9708b-61bd-45a6-b99a-1b1fcd2d7f18 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:53:53.468619 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675b3a3-bfc1-422c-a966-86151cbfd413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:53:53.469547 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675b3a3-bfc1-422c-a966-86151cbfd413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:53:53.469904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675b3a3-bfc1-422c-a966-86151cbfd413 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:53:53.470174 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675b3a3-bfc1-422c-a966-86151cbfd413 admin admin] PATH_INFO: `/v3/projects/98bb7d4ac21f4792a969498a8fb40d8f` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:53:53.472244 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675b3a3-bfc1-422c-a966-86151cbfd413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98bb7d4ac21f4792a969498a8fb40d8f)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:53:53.474363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675b3a3-bfc1-422c-a966-86151cbfd413 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:53:53.544249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1675b3a3-bfc1-422c-a966-86151cbfd413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98bb7d4ac21f4792a969498a8fb40d8f', 'request_id': 'req-1675b3a3-bfc1-422c-a966-86151cbfd413'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:53.553616 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1675b3a3-bfc1-422c-a966-86151cbfd413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98bb7d4ac21f4792a969498a8fb40d8f', 'request_id': 'req-1675b3a3-bfc1-422c-a966-86151cbfd413'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:53.565233 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1675b3a3-bfc1-422c-a966-86151cbfd413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98bb7d4ac21f4792a969498a8fb40d8f', 'request_id': 'req-1675b3a3-bfc1-422c-a966-86151cbfd413'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:53.581182 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1675b3a3-bfc1-422c-a966-86151cbfd413 admin admin] The token cache is being invalidate because project 98bb7d4ac21f4792a969498a8fb40d8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:53:53.581472 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1675b3a3-bfc1-422c-a966-86151cbfd413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:53.582148 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1675b3a3-bfc1-422c-a966-86151cbfd413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:53:53.583906 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1164/2297] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:53:53 2022] DELETE /identity/v3/projects/98bb7d4ac21f4792a969498a8fb40d8f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:54:02.817025 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb406a-766b-41e7-93ce-62d9e4a8b126 service neutron] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:54:02.818696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-57eb406a-766b-41e7-93ce-62d9e4a8b126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:54:02.831437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb406a-766b-41e7-93ce-62d9e4a8b126 service neutron] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:54:02.894014 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b635c4-50c0-4592-bbf1-4ac76f68c51d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:54:02.894673 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b635c4-50c0-4592-bbf1-4ac76f68c51d service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:54:02.894987 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b635c4-50c0-4592-bbf1-4ac76f68c51d service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:54:02.895265 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b635c4-50c0-4592-bbf1-4ac76f68c51d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:54:02.897078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-98b635c4-50c0-4592-bbf1-4ac76f68c51d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:54:02.981358 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b635c4-50c0-4592-bbf1-4ac76f68c51d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:54:02.983109 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b635c4-50c0-4592-bbf1-4ac76f68c51d service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:54:02.994796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1134/2298] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:54:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:54:03.577172 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=63,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:54:12.805212 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1abf2-5e4d-4ded-b9d5-054e5b0b4eea None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:54:12.805920 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1abf2-5e4d-4ded-b9d5-054e5b0b4eea None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:54:12.805920 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1abf2-5e4d-4ded-b9d5-054e5b0b4eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:54:12.824011 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-02a1abf2-5e4d-4ded-b9d5-054e5b0b4eea None None] MFA Rules not processed for user `baaf74865f9849e49a7ccf2fe7ecb898`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:54:12.825674 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-02a1abf2-5e4d-4ded-b9d5-054e5b0b4eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:54:12.890457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1165/2299] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:54:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:54:12.989917 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=74 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:54:14.210589 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b635c4-50c0-4592-bbf1-4ac76f68c51d service neutron] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:54:14.213169 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-98b635c4-50c0-4592-bbf1-4ac76f68c51d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:54:14.324748 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b635c4-50c0-4592-bbf1-4ac76f68c51d service neutron] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:54:14.327054 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79837ab8-2054-49fa-af1b-06b308bfbabe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9300c3a803e94f9a93442f551fc9646f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:54:14.327549 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79837ab8-2054-49fa-af1b-06b308bfbabe service placement] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:54:14.327863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79837ab8-2054-49fa-af1b-06b308bfbabe service placement] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:54:14.328288 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79837ab8-2054-49fa-af1b-06b308bfbabe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:54:14.330162 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-79837ab8-2054-49fa-af1b-06b308bfbabe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:54:14.342639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79837ab8-2054-49fa-af1b-06b308bfbabe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:54:14.344235 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79837ab8-2054-49fa-af1b-06b308bfbabe service placement] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:54:14.355671 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1135/2300] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:54:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:54:22.883123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=25 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:54:24.350887 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=41 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:54:39.444297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da9a78-7b41-4ed2-8b5e-cd1fd39d1f6c None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:54:39.444855 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da9a78-7b41-4ed2-8b5e-cd1fd39d1f6c None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:54:39.444855 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da9a78-7b41-4ed2-8b5e-cd1fd39d1f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:54:39.498711 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-14da9a78-7b41-4ed2-8b5e-cd1fd39d1f6c None None] MFA Rules not processed for user `dbf2c12174e94e2db9be178973183ced`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:54:39.499920 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-14da9a78-7b41-4ed2-8b5e-cd1fd39d1f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:54:39.566668 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1166/2301] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 23 15:54:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:54:39.627855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79837ab8-2054-49fa-af1b-06b308bfbabe service placement] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:54:39.629397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-79837ab8-2054-49fa-af1b-06b308bfbabe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:54:39.727826 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79837ab8-2054-49fa-af1b-06b308bfbabe service placement] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:54:39.733036 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88268405-dee1-43d5-93ce-406bcf2e031a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5824ee17e276483faf20db88a93545f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:54:39.733702 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88268405-dee1-43d5-93ce-406bcf2e031a service swift] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:54:39.734027 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88268405-dee1-43d5-93ce-406bcf2e031a service swift] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:54:39.734316 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88268405-dee1-43d5-93ce-406bcf2e031a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:54:39.743098 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88268405-dee1-43d5-93ce-406bcf2e031a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:54:39.744701 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88268405-dee1-43d5-93ce-406bcf2e031a service swift] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:54:39.754460 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1136/2302] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 23 15:54:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 15:54:49.563666 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=40 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:54:49.750254 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=41 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:54:55.903822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a819a2-e26a-4fbc-85e2-37d0e74e6346 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:54:55.904490 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a819a2-e26a-4fbc-85e2-37d0e74e6346 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:54:55.904490 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a819a2-e26a-4fbc-85e2-37d0e74e6346 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:54:55.906097 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1167/2303] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jun 23 15:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:54:55.913250 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ebf70-137f-434f-9cbc-9878707553ac None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:54:55.913827 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ebf70-137f-434f-9cbc-9878707553ac None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:54:55.913827 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ebf70-137f-434f-9cbc-9878707553ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:54:55.973941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-7b4ebf70-137f-434f-9cbc-9878707553ac None None] MFA Rules not processed for user `d54521ea1dca44c98d6723d0b9fd6468`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:54:55.975208 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-7b4ebf70-137f-434f-9cbc-9878707553ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:54:56.054836 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1137/2304] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jun 23 15:54:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:54:56.066797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a819a2-e26a-4fbc-85e2-37d0e74e6346 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:54:56.068490 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-06a819a2-e26a-4fbc-85e2-37d0e74e6346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:54:56.147067 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a819a2-e26a-4fbc-85e2-37d0e74e6346 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:54:56.150549 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6809458-a873-4b4c-b9d8-d8909825aa3b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79239c95306c43f0a1a0b51715440009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:54:56.151189 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6809458-a873-4b4c-b9d8-d8909825aa3b service glance] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:54:56.151468 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6809458-a873-4b4c-b9d8-d8909825aa3b service glance] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:54:56.151742 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6809458-a873-4b4c-b9d8-d8909825aa3b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:54:56.162960 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6809458-a873-4b4c-b9d8-d8909825aa3b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:54:56.164407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6809458-a873-4b4c-b9d8-d8909825aa3b service glance] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:54:56.176102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1168/2305] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:54:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:54:56.243246 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77783950-8415-498a-88c8-76256d19cd53 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:54:56.243531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77783950-8415-498a-88c8-76256d19cd53 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:54:56.243812 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77783950-8415-498a-88c8-76256d19cd53 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:54:56.245194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1138/2306] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jun 23 15:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:54:56.249990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecb404-9c99-45c4-b033-59f68e0345c0 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:54:56.250381 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecb404-9c99-45c4-b033-59f68e0345c0 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:54:56.250671 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ecb404-9c99-45c4-b033-59f68e0345c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:54:56.269821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-75ecb404-9c99-45c4-b033-59f68e0345c0 None None] MFA Rules not processed for user `44e9fc6def5341a589221350067bb0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:54:56.271064 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-75ecb404-9c99-45c4-b033-59f68e0345c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:54:56.277674 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1169/2307] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jun 23 15:54:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:54:56.298313 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77783950-8415-498a-88c8-76256d19cd53 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:54:56.300051 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-77783950-8415-498a-88c8-76256d19cd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:54:56.313443 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77783950-8415-498a-88c8-76256d19cd53 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:54:56.317087 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b765e-9ffa-4cde-8af5-d65bb1a4ae38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:54:56.317729 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b765e-9ffa-4cde-8af5-d65bb1a4ae38 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:54:56.318052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b765e-9ffa-4cde-8af5-d65bb1a4ae38 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:54:56.318342 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b765e-9ffa-4cde-8af5-d65bb1a4ae38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:54:56.325619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b765e-9ffa-4cde-8af5-d65bb1a4ae38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:54:56.327117 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b765e-9ffa-4cde-8af5-d65bb1a4ae38 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:54:56.335097 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1139/2308] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:54:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:54:56.416416 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fff97-cb22-4896-8eb2-e713404706ef None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:54:56.416705 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fff97-cb22-4896-8eb2-e713404706ef None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:54:56.416986 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fff97-cb22-4896-8eb2-e713404706ef None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:54:56.418386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1170/2309] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jun 23 15:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:54:56.425036 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95627cf6-c896-498c-9e46-42181d1e8537 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:54:56.425380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95627cf6-c896-498c-9e46-42181d1e8537 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:54:56.425698 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95627cf6-c896-498c-9e46-42181d1e8537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:54:56.445058 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-95627cf6-c896-498c-9e46-42181d1e8537 None None] MFA Rules not processed for user `d54521ea1dca44c98d6723d0b9fd6468`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:54:56.446288 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-95627cf6-c896-498c-9e46-42181d1e8537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:54:56.455423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1140/2310] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jun 23 15:54:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:54:56.465923 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fff97-cb22-4896-8eb2-e713404706ef None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:54:56.477656 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fff97-cb22-4896-8eb2-e713404706ef None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:54:56.481325 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab85b9-f6f0-4700-a577-7b204c173223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:54:56.481996 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab85b9-f6f0-4700-a577-7b204c173223 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:54:56.482285 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab85b9-f6f0-4700-a577-7b204c173223 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:54:56.482567 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab85b9-f6f0-4700-a577-7b204c173223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:54:56.493427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab85b9-f6f0-4700-a577-7b204c173223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:54:56.494896 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab85b9-f6f0-4700-a577-7b204c173223 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:54:56.506321 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1171/2311] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:54:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:54:58.837068 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a08d2e-1b90-47dc-9da1-705abc4a1061 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:54:58.837579 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a08d2e-1b90-47dc-9da1-705abc4a1061 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:54:58.837677 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a08d2e-1b90-47dc-9da1-705abc4a1061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:54:58.855894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-93a08d2e-1b90-47dc-9da1-705abc4a1061 None None] MFA Rules not processed for user `dbf2c12174e94e2db9be178973183ced`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:54:58.857121 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-93a08d2e-1b90-47dc-9da1-705abc4a1061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:54:58.864384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1141/2312] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 23 15:54:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:54:58.876211 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab85b9-f6f0-4700-a577-7b204c173223 service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:54:58.887552 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab85b9-f6f0-4700-a577-7b204c173223 service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:54:58.893031 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc7eca-08a4-4db3-bf0f-64829da3c88c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5824ee17e276483faf20db88a93545f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:54:58.893693 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc7eca-08a4-4db3-bf0f-64829da3c88c service swift] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:54:58.894023 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc7eca-08a4-4db3-bf0f-64829da3c88c service swift] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:54:58.894312 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc7eca-08a4-4db3-bf0f-64829da3c88c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:54:58.902478 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc7eca-08a4-4db3-bf0f-64829da3c88c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:54:58.904055 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc7eca-08a4-4db3-bf0f-64829da3c88c service swift] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:54:58.913302 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1172/2313] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 23 15:54:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 15:55:08.850643 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=58 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:55:08.909949 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=50 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:55:23.439702 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fee6a-c4a7-45a2-8f5d-b41656bae15a None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:55:23.440213 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fee6a-c4a7-45a2-8f5d-b41656bae15a None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:55:23.440311 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fee6a-c4a7-45a2-8f5d-b41656bae15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:55:23.461705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-0d4fee6a-c4a7-45a2-8f5d-b41656bae15a None None] MFA Rules not processed for user `dbf2c12174e94e2db9be178973183ced`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:55:23.462966 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-0d4fee6a-c4a7-45a2-8f5d-b41656bae15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:55:23.471023 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1142/2314] 10.222.0.15 () {58 vars in 967 bytes} [Thu Jun 23 15:55:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:55:23.483269 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc7eca-08a4-4db3-bf0f-64829da3c88c service swift] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:55:23.495201 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc7eca-08a4-4db3-bf0f-64829da3c88c service swift] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:55:23.501002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80658055-851c-4bd6-be80-4bfe2a934de1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5824ee17e276483faf20db88a93545f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:55:23.501648 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80658055-851c-4bd6-be80-4bfe2a934de1 service swift] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:55:23.501962 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80658055-851c-4bd6-be80-4bfe2a934de1 service swift] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:55:23.502250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80658055-851c-4bd6-be80-4bfe2a934de1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:55:23.511678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80658055-851c-4bd6-be80-4bfe2a934de1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:55:23.512632 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80658055-851c-4bd6-be80-4bfe2a934de1 service swift] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:55:23.524157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1173/2315] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 23 15:55:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 15:55:33.455959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:55:33.519594 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=6 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:56:05.635521 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fee6a-c4a7-45a2-8f5d-b41656bae15a None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:56:05.646840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fee6a-c4a7-45a2-8f5d-b41656bae15a None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:56:05.658523 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf75660-ca0a-4a17-88c4-ad1c81d40321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:56:05.659191 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf75660-ca0a-4a17-88c4-ad1c81d40321 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:56:05.659475 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf75660-ca0a-4a17-88c4-ad1c81d40321 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:56:05.659751 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf75660-ca0a-4a17-88c4-ad1c81d40321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:56:05.661565 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-9cf75660-ca0a-4a17-88c4-ad1c81d40321 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:56:05.675388 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf75660-ca0a-4a17-88c4-ad1c81d40321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:56:05.676803 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf75660-ca0a-4a17-88c4-ad1c81d40321 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:56:05.687664 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1143/2316] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:56:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:56:06.573890 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80658055-851c-4bd6-be80-4bfe2a934de1 service swift] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:56:06.584191 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80658055-851c-4bd6-be80-4bfe2a934de1 service swift] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:56:06.588241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a825b-c8db-4df5-b266-a9cabb76c39a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:56:06.588887 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a825b-c8db-4df5-b266-a9cabb76c39a service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:56:06.589168 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a825b-c8db-4df5-b266-a9cabb76c39a service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:56:06.589453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a825b-c8db-4df5-b266-a9cabb76c39a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:56:06.591279 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-a84a825b-c8db-4df5-b266-a9cabb76c39a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:56:06.607147 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a825b-c8db-4df5-b266-a9cabb76c39a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:56:06.608575 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a825b-c8db-4df5-b266-a9cabb76c39a service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:56:06.620834 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1174/2317] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:56:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:56:13.778659 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963542e-2f8c-4082-a9e6-274fae5b171c None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:56:13.779228 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963542e-2f8c-4082-a9e6-274fae5b171c None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:56:13.779228 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1963542e-2f8c-4082-a9e6-274fae5b171c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:56:13.797115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-1963542e-2f8c-4082-a9e6-274fae5b171c None None] MFA Rules not processed for user `7fe974cf493c4545abc70a6745359a66`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:56:13.798359 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-1963542e-2f8c-4082-a9e6-274fae5b171c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:56:13.853947 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1144/2318] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:56:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:56:16.615633 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=6 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:56:19.588148 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a825b-c8db-4df5-b266-a9cabb76c39a service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:56:19.589901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-a84a825b-c8db-4df5-b266-a9cabb76c39a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:56:19.617573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a825b-c8db-4df5-b266-a9cabb76c39a service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:56:19.638155 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b5d6b-4c2a-4b82-86ae-5f230639fbc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:56:19.639130 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b5d6b-4c2a-4b82-86ae-5f230639fbc4 service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:56:19.639918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b5d6b-4c2a-4b82-86ae-5f230639fbc4 service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:56:19.640407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b5d6b-4c2a-4b82-86ae-5f230639fbc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:56:19.643876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-167b5d6b-4c2a-4b82-86ae-5f230639fbc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:56:19.671077 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b5d6b-4c2a-4b82-86ae-5f230639fbc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:56:19.674710 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b5d6b-4c2a-4b82-86ae-5f230639fbc4 service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:56:19.693631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1175/2319] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:56:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:56:23.846728 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=31 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:56:29.684186 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=6 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:56:30.759642 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aabfa7-a6ce-4f16-9f06-1adc816ae1ef None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:56:30.760192 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aabfa7-a6ce-4f16-9f06-1adc816ae1ef None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:56:30.760313 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aabfa7-a6ce-4f16-9f06-1adc816ae1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:56:30.778765 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-01aabfa7-a6ce-4f16-9f06-1adc816ae1ef None None] MFA Rules not processed for user `baaf74865f9849e49a7ccf2fe7ecb898`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:56:30.779985 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-01aabfa7-a6ce-4f16-9f06-1adc816ae1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:56:30.787435 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1145/2320] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:56:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:56:31.095086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b5d6b-4c2a-4b82-86ae-5f230639fbc4 service nova] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:56:31.104682 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b5d6b-4c2a-4b82-86ae-5f230639fbc4 service nova] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:56:31.108825 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba32625-163d-4b60-b58b-9c3510d6f4dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:56:31.109467 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba32625-163d-4b60-b58b-9c3510d6f4dc service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:56:31.109959 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba32625-163d-4b60-b58b-9c3510d6f4dc service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:56:31.110241 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba32625-163d-4b60-b58b-9c3510d6f4dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:56:31.112063 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-eba32625-163d-4b60-b58b-9c3510d6f4dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:56:31.122333 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba32625-163d-4b60-b58b-9c3510d6f4dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:56:31.124786 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba32625-163d-4b60-b58b-9c3510d6f4dc service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:56:31.134133 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1176/2321] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:56:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:56:31.457432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aabfa7-a6ce-4f16-9f06-1adc816ae1ef None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:56:31.470654 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aabfa7-a6ce-4f16-9f06-1adc816ae1ef None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:56:31.475599 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d5008-849b-48b7-bf8d-68c35a6ac525 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9300c3a803e94f9a93442f551fc9646f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:56:31.476414 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d5008-849b-48b7-bf8d-68c35a6ac525 service placement] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:56:31.476700 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d5008-849b-48b7-bf8d-68c35a6ac525 service placement] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:56:31.476977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d5008-849b-48b7-bf8d-68c35a6ac525 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:56:31.478820 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-347d5008-849b-48b7-bf8d-68c35a6ac525 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:56:31.492739 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d5008-849b-48b7-bf8d-68c35a6ac525 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:56:31.494361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d5008-849b-48b7-bf8d-68c35a6ac525 service placement] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:56:31.497544 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba32625-163d-4b60-b58b-9c3510d6f4dc service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:56:31.499093 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-eba32625-163d-4b60-b58b-9c3510d6f4dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:56:31.507394 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1146/2322] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:56:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:56:31.519055 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba32625-163d-4b60-b58b-9c3510d6f4dc service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:56:31.524652 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11858a70-34aa-43d7-bb50-101dfb0e38e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:56:31.525382 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11858a70-34aa-43d7-bb50-101dfb0e38e6 service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:56:31.525756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11858a70-34aa-43d7-bb50-101dfb0e38e6 service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:56:31.526128 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11858a70-34aa-43d7-bb50-101dfb0e38e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:56:31.527980 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-11858a70-34aa-43d7-bb50-101dfb0e38e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:56:31.598251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11858a70-34aa-43d7-bb50-101dfb0e38e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:56:31.599854 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11858a70-34aa-43d7-bb50-101dfb0e38e6 service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:56:31.610424 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1177/2323] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:56:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:56:41.457697 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d5008-849b-48b7-bf8d-68c35a6ac525 service placement] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:56:41.460077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-347d5008-849b-48b7-bf8d-68c35a6ac525 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:56:41.472489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d5008-849b-48b7-bf8d-68c35a6ac525 service placement] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:56:41.476361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8b1b5-6b37-4560-9cc4-6958636581e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:56:41.477018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8b1b5-6b37-4560-9cc4-6958636581e9 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:56:41.477304 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8b1b5-6b37-4560-9cc4-6958636581e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:56:41.477584 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea8b1b5-6b37-4560-9cc4-6958636581e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:56:41.479453 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-4ea8b1b5-6b37-4560-9cc4-6958636581e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:56:41.490445 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8b1b5-6b37-4560-9cc4-6958636581e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:56:41.492013 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea8b1b5-6b37-4560-9cc4-6958636581e9 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:56:41.501903 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1147/2324] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:56:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:56:41.605246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=34 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:56:42.500487 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639702c0-169f-4555-b3dc-c0e8c420879f None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:56:42.500709 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639702c0-169f-4555-b3dc-c0e8c420879f None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:56:42.500966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639702c0-169f-4555-b3dc-c0e8c420879f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:56:42.518692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-639702c0-169f-4555-b3dc-c0e8c420879f None None] MFA Rules not processed for user `7e678b395d334be399ecb6af37f9987b`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:56:42.519898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-639702c0-169f-4555-b3dc-c0e8c420879f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:56:42.526862 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1178/2325] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:56:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:56:42.834527 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8b1b5-6b37-4560-9cc4-6958636581e9 service neutron] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:56:42.843228 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea8b1b5-6b37-4560-9cc4-6958636581e9 service neutron] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:56:42.846895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe19f8-84d1-4660-9570-d01473e785ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:56:42.847534 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe19f8-84d1-4660-9570-d01473e785ae service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:56:42.847813 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe19f8-84d1-4660-9570-d01473e785ae service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:56:42.848088 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe19f8-84d1-4660-9570-d01473e785ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:56:42.849835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-eefe19f8-84d1-4660-9570-d01473e785ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:56:42.859662 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe19f8-84d1-4660-9570-d01473e785ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:56:42.861081 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe19f8-84d1-4660-9570-d01473e785ae service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:56:42.869526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1148/2326] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:56:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:56:52.513187 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:56:52.865796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=21 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:56:55.150584 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639702c0-169f-4555-b3dc-c0e8c420879f None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:56:55.163977 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639702c0-169f-4555-b3dc-c0e8c420879f None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:56:55.169621 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2045b-d8bb-4ab9-97c3-36ebbd4c8fed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:56:55.170858 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2045b-d8bb-4ab9-97c3-36ebbd4c8fed service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:56:55.171138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2045b-d8bb-4ab9-97c3-36ebbd4c8fed service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:56:55.171409 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2045b-d8bb-4ab9-97c3-36ebbd4c8fed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:56:55.173219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-84a2045b-d8bb-4ab9-97c3-36ebbd4c8fed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:56:55.186545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2045b-d8bb-4ab9-97c3-36ebbd4c8fed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:56:55.188142 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2045b-d8bb-4ab9-97c3-36ebbd4c8fed service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:56:55.199166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1179/2327] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:56:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:57:05.194524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=6 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:57:16.479548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe19f8-84d1-4660-9570-d01473e785ae service neutron] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:57:16.480952 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-eefe19f8-84d1-4660-9570-d01473e785ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:57:16.538639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe19f8-84d1-4660-9570-d01473e785ae service neutron] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:57:16.542452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84888115-050f-4605-a99b-8810a813fbf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:57:16.543028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84888115-050f-4605-a99b-8810a813fbf4 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:57:16.543310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84888115-050f-4605-a99b-8810a813fbf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:57:16.543589 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84888115-050f-4605-a99b-8810a813fbf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:57:16.546005 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-84888115-050f-4605-a99b-8810a813fbf4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:57:16.608232 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84888115-050f-4605-a99b-8810a813fbf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:57:16.609707 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84888115-050f-4605-a99b-8810a813fbf4 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:57:16.619513 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1149/2328] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:57:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:57:19.345683 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2045b-d8bb-4ab9-97c3-36ebbd4c8fed service nova] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:57:19.358521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2045b-d8bb-4ab9-97c3-36ebbd4c8fed service nova] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:57:19.364929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7feebd9-285a-457b-a6ad-fda8e55007ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:57:19.365770 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7feebd9-285a-457b-a6ad-fda8e55007ca service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:57:19.366091 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7feebd9-285a-457b-a6ad-fda8e55007ca service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:57:19.366554 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7feebd9-285a-457b-a6ad-fda8e55007ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:57:19.368595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-c7feebd9-285a-457b-a6ad-fda8e55007ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:57:19.382424 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7feebd9-285a-457b-a6ad-fda8e55007ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:57:19.384209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7feebd9-285a-457b-a6ad-fda8e55007ca service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:57:19.397597 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1180/2329] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:57:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:57:22.389383 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1182bce-a0b5-4a8c-bf6a-8d223f59ead9 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:57:22.389844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1182bce-a0b5-4a8c-bf6a-8d223f59ead9 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:57:22.390223 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1182bce-a0b5-4a8c-bf6a-8d223f59ead9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:57:22.409040 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-f1182bce-a0b5-4a8c-bf6a-8d223f59ead9 None None] MFA Rules not processed for user `fa813b65a2b141ffa2359e5f0b0ae4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:57:22.410514 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-f1182bce-a0b5-4a8c-bf6a-8d223f59ead9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:57:22.418583 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1150/2330] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:57:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:57:22.940971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b3fec-3f56-41d0-b984-c2a1c0087304 None None] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:57:22.941541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b3fec-3f56-41d0-b984-c2a1c0087304 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:57:22.941541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b3fec-3f56-41d0-b984-c2a1c0087304 None None] PATH_INFO: `/` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:57:22.942932 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1181/2331] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jun 23 15:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:57:22.949560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a860a5b-1128-4014-af9e-a93990340c2d None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:57:22.949849 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a860a5b-1128-4014-af9e-a93990340c2d None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:57:22.950242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a860a5b-1128-4014-af9e-a93990340c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:57:22.969520 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-8a860a5b-1128-4014-af9e-a93990340c2d None None] MFA Rules not processed for user `44e9fc6def5341a589221350067bb0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:57:22.970791 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-8a860a5b-1128-4014-af9e-a93990340c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:57:22.978509 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1151/2332] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jun 23 15:57:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:57:22.991603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b3fec-3f56-41d0-b984-c2a1c0087304 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:57:23.004936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b3fec-3f56-41d0-b984-c2a1c0087304 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:57:23.008523 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ed556b-c47c-4420-a278-2be416edd58e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:57:23.009166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed556b-c47c-4420-a278-2be416edd58e service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:57:23.009628 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed556b-c47c-4420-a278-2be416edd58e service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:57:23.009986 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ed556b-c47c-4420-a278-2be416edd58e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:57:23.017522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed556b-c47c-4420-a278-2be416edd58e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:57:23.018998 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ed556b-c47c-4420-a278-2be416edd58e service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:57:23.027370 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1182/2333] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:57:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:57:23.113779 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329c3f7-2c32-477c-9916-7bb785c274ac None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:57:23.114256 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329c3f7-2c32-477c-9916-7bb785c274ac None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:57:23.114449 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329c3f7-2c32-477c-9916-7bb785c274ac None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:57:23.115937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1152/2334] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jun 23 15:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:57:23.127479 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdc074-9fd1-439e-8730-02ba721fa917 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:57:23.127771 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdc074-9fd1-439e-8730-02ba721fa917 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:57:23.128057 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdc074-9fd1-439e-8730-02ba721fa917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:57:23.146235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-a1fdc074-9fd1-439e-8730-02ba721fa917 None None] MFA Rules not processed for user `d54521ea1dca44c98d6723d0b9fd6468`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:57:23.147517 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-a1fdc074-9fd1-439e-8730-02ba721fa917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:57:23.158055 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1183/2335] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jun 23 15:57:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:57:23.170929 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329c3f7-2c32-477c-9916-7bb785c274ac None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:57:23.182571 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329c3f7-2c32-477c-9916-7bb785c274ac None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:57:23.186513 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9adb4-caec-4ed6-89e7-996a1ccd8221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:57:23.187298 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9adb4-caec-4ed6-89e7-996a1ccd8221 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:57:23.187594 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9adb4-caec-4ed6-89e7-996a1ccd8221 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:57:23.187871 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9adb4-caec-4ed6-89e7-996a1ccd8221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:57:23.200213 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9adb4-caec-4ed6-89e7-996a1ccd8221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:57:23.201697 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9adb4-caec-4ed6-89e7-996a1ccd8221 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:57:23.218603 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1153/2336] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:57:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:57:25.312591 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdc074-9fd1-439e-8730-02ba721fa917 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:57:25.331637 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fdc074-9fd1-439e-8730-02ba721fa917 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:57:25.340308 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46a691-2a3d-4fee-86d9-bd7976cec898 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:57:25.340813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46a691-2a3d-4fee-86d9-bd7976cec898 service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:57:25.341848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46a691-2a3d-4fee-86d9-bd7976cec898 service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:57:25.341971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46a691-2a3d-4fee-86d9-bd7976cec898 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:57:25.344914 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-da46a691-2a3d-4fee-86d9-bd7976cec898 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:57:25.401454 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46a691-2a3d-4fee-86d9-bd7976cec898 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:57:25.404589 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46a691-2a3d-4fee-86d9-bd7976cec898 service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:57:25.428403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1184/2337] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:57:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:57:26.825021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9adb4-caec-4ed6-89e7-996a1ccd8221 service neutron] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:57:26.826557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-0eb9adb4-caec-4ed6-89e7-996a1ccd8221 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:57:26.840427 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9adb4-caec-4ed6-89e7-996a1ccd8221 service neutron] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:57:26.844756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87953835-bc14-4d5a-82b3-2e1e91b66fea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:57:26.845407 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87953835-bc14-4d5a-82b3-2e1e91b66fea service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:57:26.845688 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87953835-bc14-4d5a-82b3-2e1e91b66fea service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:57:26.845993 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87953835-bc14-4d5a-82b3-2e1e91b66fea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:57:26.847792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-87953835-bc14-4d5a-82b3-2e1e91b66fea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:57:26.863861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87953835-bc14-4d5a-82b3-2e1e91b66fea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:57:26.865342 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87953835-bc14-4d5a-82b3-2e1e91b66fea service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:57:26.876301 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1154/2338] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:57:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:57:35.417549 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=21 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:57:36.871710 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=66 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:57:53.145990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46a691-2a3d-4fee-86d9-bd7976cec898 service nova] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:57:53.155776 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46a691-2a3d-4fee-86d9-bd7976cec898 service nova] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:57:53.159725 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3276e-e4bf-4541-8874-d918da696030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:57:53.160335 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3276e-e4bf-4541-8874-d918da696030 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:57:53.160619 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3276e-e4bf-4541-8874-d918da696030 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:57:53.160915 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3276e-e4bf-4541-8874-d918da696030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:57:53.162677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-1cc3276e-e4bf-4541-8874-d918da696030 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:57:53.225314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3276e-e4bf-4541-8874-d918da696030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:57:53.226774 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3276e-e4bf-4541-8874-d918da696030 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:57:53.237061 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1185/2339] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:57:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:57:56.380103 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87953835-bc14-4d5a-82b3-2e1e91b66fea service cinder] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:57:56.393770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87953835-bc14-4d5a-82b3-2e1e91b66fea service cinder] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:57:56.399916 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ccb716-8b82-48c2-a7fd-66be0c7c9eef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9300c3a803e94f9a93442f551fc9646f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:57:56.400586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccb716-8b82-48c2-a7fd-66be0c7c9eef service placement] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:57:56.400873 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccb716-8b82-48c2-a7fd-66be0c7c9eef service placement] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:57:56.401297 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccb716-8b82-48c2-a7fd-66be0c7c9eef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:57:56.403938 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-d3ccb716-8b82-48c2-a7fd-66be0c7c9eef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:57:56.417397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ccb716-8b82-48c2-a7fd-66be0c7c9eef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:57:56.419701 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ccb716-8b82-48c2-a7fd-66be0c7c9eef service placement] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:57:56.432249 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1155/2340] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:57:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:57:56.462580 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3276e-e4bf-4541-8874-d918da696030 service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:57:56.464039 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-1cc3276e-e4bf-4541-8874-d918da696030 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:57:56.480921 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3276e-e4bf-4541-8874-d918da696030 service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:57:56.485440 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ed512-1900-47a6-8417-b59aa65cc63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:57:56.486373 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ed512-1900-47a6-8417-b59aa65cc63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:57:56.486687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ed512-1900-47a6-8417-b59aa65cc63b admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:57:56.486972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ed512-1900-47a6-8417-b59aa65cc63b admin admin] PATH_INFO: `/v3/users/7fe974cf493c4545abc70a6745359a66` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:57:56.488186 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ed512-1900-47a6-8417-b59aa65cc63b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fe974cf493c4545abc70a6745359a66)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:57:56.490210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ed512-1900-47a6-8417-b59aa65cc63b admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:57:56.540976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-454ed512-1900-47a6-8417-b59aa65cc63b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fe974cf493c4545abc70a6745359a66'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:57:56.548755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-454ed512-1900-47a6-8417-b59aa65cc63b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fe974cf493c4545abc70a6745359a66'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:57:56.549451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-454ed512-1900-47a6-8417-b59aa65cc63b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fe974cf493c4545abc70a6745359a66'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:57:56.550080 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-454ed512-1900-47a6-8417-b59aa65cc63b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fe974cf493c4545abc70a6745359a66'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:57:56.561715 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-454ed512-1900-47a6-8417-b59aa65cc63b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fe974cf493c4545abc70a6745359a66'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:57:56.577367 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1186/2341] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:57:56 2022] DELETE /identity/v3/users/7fe974cf493c4545abc70a6745359a66 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:57:56.754626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ccb716-8b82-48c2-a7fd-66be0c7c9eef service placement] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:57:56.766740 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ccb716-8b82-48c2-a7fd-66be0c7c9eef service placement] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:57:56.823458 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35347734-0bfe-4394-a4cd-f26b083e0d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:57:56.824475 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35347734-0bfe-4394-a4cd-f26b083e0d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:57:56.825316 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35347734-0bfe-4394-a4cd-f26b083e0d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:57:56.825595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35347734-0bfe-4394-a4cd-f26b083e0d00 admin admin] PATH_INFO: `/v3/projects/033fb50838fe43b0a216ec516bd1b50a` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:57:56.826806 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35347734-0bfe-4394-a4cd-f26b083e0d00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=033fb50838fe43b0a216ec516bd1b50a)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:57:56.828696 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35347734-0bfe-4394-a4cd-f26b083e0d00 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:57:56.874641 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-35347734-0bfe-4394-a4cd-f26b083e0d00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '033fb50838fe43b0a216ec516bd1b50a', 'request_id': 'req-35347734-0bfe-4394-a4cd-f26b083e0d00'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:57:56.881758 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-35347734-0bfe-4394-a4cd-f26b083e0d00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '033fb50838fe43b0a216ec516bd1b50a', 'request_id': 'req-35347734-0bfe-4394-a4cd-f26b083e0d00'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:57:56.888456 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-35347734-0bfe-4394-a4cd-f26b083e0d00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '033fb50838fe43b0a216ec516bd1b50a', 'request_id': 'req-35347734-0bfe-4394-a4cd-f26b083e0d00'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:57:56.898685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-35347734-0bfe-4394-a4cd-f26b083e0d00 admin admin] The token cache is being invalidate because project 033fb50838fe43b0a216ec516bd1b50a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:57:56.898972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-35347734-0bfe-4394-a4cd-f26b083e0d00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:57:56.899610 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-35347734-0bfe-4394-a4cd-f26b083e0d00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:57:56.901160 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1156/2342] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:57:56 2022] DELETE /identity/v3/projects/033fb50838fe43b0a216ec516bd1b50a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:57:56.908180 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb48a1b-c852-45fc-80df-ee215bd6347a None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:57:56.908474 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb48a1b-c852-45fc-80df-ee215bd6347a None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:57:56.908757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb48a1b-c852-45fc-80df-ee215bd6347a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:57:56.925831 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-4fb48a1b-c852-45fc-80df-ee215bd6347a None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:57:56.927085 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-4fb48a1b-c852-45fc-80df-ee215bd6347a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:57:56.986211 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1187/2343] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:57:56.994061 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdef28-db0a-46ac-84b1-6a744dc38495 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:57:56.994415 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdef28-db0a-46ac-84b1-6a744dc38495 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:57:56.994756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdef28-db0a-46ac-84b1-6a744dc38495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:57:57.014391 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-f8fdef28-db0a-46ac-84b1-6a744dc38495 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:57:57.015603 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-f8fdef28-db0a-46ac-84b1-6a744dc38495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:57:57.023537 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1157/2344] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:57:57.027873 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb48a1b-c852-45fc-80df-ee215bd6347a None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:57:57.037776 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb48a1b-c852-45fc-80df-ee215bd6347a None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:57:57.042331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f1379-0dca-4f05-9b2c-9c7b89196452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:57:57.042977 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f1379-0dca-4f05-9b2c-9c7b89196452 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:57:57.043262 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f1379-0dca-4f05-9b2c-9c7b89196452 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:57:57.043537 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f1379-0dca-4f05-9b2c-9c7b89196452 admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:57:57.044261 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f1379-0dca-4f05-9b2c-9c7b89196452 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:57:57.044569 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f1379-0dca-4f05-9b2c-9c7b89196452 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:57:57.046191 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0f1379-0dca-4f05-9b2c-9c7b89196452 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:57:57.047707 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:57:57.061010 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1188/2345] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:57:57.065215 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdef28-db0a-46ac-84b1-6a744dc38495 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:57:57.074534 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdef28-db0a-46ac-84b1-6a744dc38495 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:57:57.079791 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c37010-6f31-4ccd-874e-a0e5a2988928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:57:57.080443 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c37010-6f31-4ccd-874e-a0e5a2988928 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:57:57.080732 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c37010-6f31-4ccd-874e-a0e5a2988928 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:57:57.081015 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c37010-6f31-4ccd-874e-a0e5a2988928 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:57:57.081714 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c37010-6f31-4ccd-874e-a0e5a2988928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:57:57.083645 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c37010-6f31-4ccd-874e-a0e5a2988928 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:57:57.119580 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1158/2346] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:57:57 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:57:57.125410 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f1379-0dca-4f05-9b2c-9c7b89196452 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:57:57.135596 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f1379-0dca-4f05-9b2c-9c7b89196452 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:57:57.195764 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf4f34-0b33-4663-83d7-51272c62e6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:57:57.196440 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf4f34-0b33-4663-83d7-51272c62e6cc admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:57:57.196728 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf4f34-0b33-4663-83d7-51272c62e6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:57:57.197006 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf4f34-0b33-4663-83d7-51272c62e6cc admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:57:57.197741 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf4f34-0b33-4663-83d7-51272c62e6cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:57:57.199691 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf4f34-0b33-4663-83d7-51272c62e6cc admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:57:57.220050 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1189/2347] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:57:57 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:57:57.224283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c37010-6f31-4ccd-874e-a0e5a2988928 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:57:57.235374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c37010-6f31-4ccd-874e-a0e5a2988928 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:57:57.241394 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45bf15-e006-4594-aa92-24357c2d877d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:57:57.242124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45bf15-e006-4594-aa92-24357c2d877d admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:57:57.242416 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45bf15-e006-4594-aa92-24357c2d877d admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:57:57.242700 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45bf15-e006-4594-aa92-24357c2d877d admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:57:57.243446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45bf15-e006-4594-aa92-24357c2d877d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:57:57.245052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45bf15-e006-4594-aa92-24357c2d877d admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:57:57.257246 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1159/2348] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:57:57.261268 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf4f34-0b33-4663-83d7-51272c62e6cc admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:57:57.272422 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf4f34-0b33-4663-83d7-51272c62e6cc admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:57:57.277662 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e90df-517a-4d46-b581-0ef808bb51f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:57:57.278395 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e90df-517a-4d46-b581-0ef808bb51f9 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:57:57.278712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e90df-517a-4d46-b581-0ef808bb51f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:57:57.278989 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e90df-517a-4d46-b581-0ef808bb51f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:57:57.279749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e90df-517a-4d46-b581-0ef808bb51f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:57:57.281412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e90df-517a-4d46-b581-0ef808bb51f9 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:57:57.292211 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1190/2349] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 15:57:57.297007 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45bf15-e006-4594-aa92-24357c2d877d admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:57:57.307510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45bf15-e006-4594-aa92-24357c2d877d admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:57:57.314457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b771d03-9485-49f2-b997-2fd0f14b68e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:57:57.315341 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b771d03-9485-49f2-b997-2fd0f14b68e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:57:57.315652 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b771d03-9485-49f2-b997-2fd0f14b68e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:57:57.315924 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b771d03-9485-49f2-b997-2fd0f14b68e2 admin admin] PATH_INFO: `/v3/projects/9804081404514a5c9f7ce24af81f2003/users/97b7f44c70fe40d09e490467760f2b46/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:57:57.331177 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b771d03-9485-49f2-b997-2fd0f14b68e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9804081404514a5c9f7ce24af81f2003, user_id=97b7f44c70fe40d09e490467760f2b46, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:57:57.333810 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b771d03-9485-49f2-b997-2fd0f14b68e2 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:57:57.346770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1160/2350] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:57:57 2022] PUT /identity/v3/projects/9804081404514a5c9f7ce24af81f2003/users/97b7f44c70fe40d09e490467760f2b46/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:57:57.357197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9134f-5aa7-4132-b7b2-b5cb071d37ce None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:57:57.357488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9134f-5aa7-4132-b7b2-b5cb071d37ce None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:57:57.357773 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9134f-5aa7-4132-b7b2-b5cb071d37ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:57:57.384018 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-ece9134f-5aa7-4132-b7b2-b5cb071d37ce None None] MFA Rules not processed for user `97b7f44c70fe40d09e490467760f2b46`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:57:57.385224 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ece9134f-5aa7-4132-b7b2-b5cb071d37ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:57:57.447949 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1191/2351] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:57:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:57:57.459013 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b771d03-9485-49f2-b997-2fd0f14b68e2 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:57:57.460769 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-8b771d03-9485-49f2-b997-2fd0f14b68e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:57:57.467275 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:57:57.516964 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b771d03-9485-49f2-b997-2fd0f14b68e2 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:57:57.520522 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105afac-ac8f-4d59-a311-fcb95aba4d00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:57:57.521162 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105afac-ac8f-4d59-a311-fcb95aba4d00 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:57:57.521448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105afac-ac8f-4d59-a311-fcb95aba4d00 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:57:57.521728 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105afac-ac8f-4d59-a311-fcb95aba4d00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:57:57.530093 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105afac-ac8f-4d59-a311-fcb95aba4d00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:57:57.531515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105afac-ac8f-4d59-a311-fcb95aba4d00 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:57:57.540520 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1161/2352] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:57:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:58:07.445105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=69,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:58:07.536869 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=24 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:58:11.133447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9134f-5aa7-4132-b7b2-b5cb071d37ce None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:58:11.197508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9134f-5aa7-4132-b7b2-b5cb071d37ce None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:58:11.202095 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b137d86-f104-466b-81e5-e296ed173088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:58:11.202954 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b137d86-f104-466b-81e5-e296ed173088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:11.203236 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b137d86-f104-466b-81e5-e296ed173088 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:11.203512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b137d86-f104-466b-81e5-e296ed173088 admin admin] PATH_INFO: `/v3/users/97b7f44c70fe40d09e490467760f2b46` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:11.204703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b137d86-f104-466b-81e5-e296ed173088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97b7f44c70fe40d09e490467760f2b46)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:58:11.206639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b137d86-f104-466b-81e5-e296ed173088 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:58:11.253604 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6b137d86-f104-466b-81e5-e296ed173088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97b7f44c70fe40d09e490467760f2b46'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:58:11.261170 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6b137d86-f104-466b-81e5-e296ed173088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97b7f44c70fe40d09e490467760f2b46'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:58:11.261832 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6b137d86-f104-466b-81e5-e296ed173088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97b7f44c70fe40d09e490467760f2b46'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:58:11.262708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6b137d86-f104-466b-81e5-e296ed173088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97b7f44c70fe40d09e490467760f2b46'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:58:11.274842 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6b137d86-f104-466b-81e5-e296ed173088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97b7f44c70fe40d09e490467760f2b46'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:58:11.288020 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1192/2353] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:58:11 2022] DELETE /identity/v3/users/97b7f44c70fe40d09e490467760f2b46 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:58:11.292705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46737094-3feb-4926-acce-eaeaff833ac7 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:11.293164 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46737094-3feb-4926-acce-eaeaff833ac7 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:11.293258 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46737094-3feb-4926-acce-eaeaff833ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:11.310519 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-46737094-3feb-4926-acce-eaeaff833ac7 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:58:11.311843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-46737094-3feb-4926-acce-eaeaff833ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:58:11.370160 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1162/2354] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:58:11.379810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b137d86-f104-466b-81e5-e296ed173088 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:58:11.381226 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-6b137d86-f104-466b-81e5-e296ed173088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:58:11.437404 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b137d86-f104-466b-81e5-e296ed173088 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:58:11.441043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97634286-2f7c-47f1-adf1-c7565c6c627f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:58:11.441677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97634286-2f7c-47f1-adf1-c7565c6c627f service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:11.441993 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97634286-2f7c-47f1-adf1-c7565c6c627f service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:11.442266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97634286-2f7c-47f1-adf1-c7565c6c627f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:11.451192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97634286-2f7c-47f1-adf1-c7565c6c627f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:58:11.453139 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97634286-2f7c-47f1-adf1-c7565c6c627f service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:58:11.462698 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1193/2355] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:58:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:58:11.733019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46737094-3feb-4926-acce-eaeaff833ac7 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:58:11.734485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-46737094-3feb-4926-acce-eaeaff833ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:58:11.746939 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46737094-3feb-4926-acce-eaeaff833ac7 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:58:11.752685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de548a05-c973-488d-8583-6697a0176764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:58:11.753818 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de548a05-c973-488d-8583-6697a0176764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:11.754128 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de548a05-c973-488d-8583-6697a0176764 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:11.754305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de548a05-c973-488d-8583-6697a0176764 admin admin] PATH_INFO: `/v3/projects/9804081404514a5c9f7ce24af81f2003` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:11.755505 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de548a05-c973-488d-8583-6697a0176764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9804081404514a5c9f7ce24af81f2003)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:58:11.758371 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de548a05-c973-488d-8583-6697a0176764 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:58:11.805055 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-de548a05-c973-488d-8583-6697a0176764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9804081404514a5c9f7ce24af81f2003', 'request_id': 'req-de548a05-c973-488d-8583-6697a0176764'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:58:11.812974 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-de548a05-c973-488d-8583-6697a0176764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9804081404514a5c9f7ce24af81f2003', 'request_id': 'req-de548a05-c973-488d-8583-6697a0176764'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:58:11.819363 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-de548a05-c973-488d-8583-6697a0176764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9804081404514a5c9f7ce24af81f2003', 'request_id': 'req-de548a05-c973-488d-8583-6697a0176764'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:58:11.830307 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-de548a05-c973-488d-8583-6697a0176764 admin admin] The token cache is being invalidate because project 9804081404514a5c9f7ce24af81f2003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:58:11.830590 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-de548a05-c973-488d-8583-6697a0176764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:58:11.831229 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-de548a05-c973-488d-8583-6697a0176764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:58:11.832790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1163/2356] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:58:11 2022] DELETE /identity/v3/projects/9804081404514a5c9f7ce24af81f2003 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:58:11.838670 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2af11-0648-4cfc-a327-3ccfc55b9d76 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:11.838961 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2af11-0648-4cfc-a327-3ccfc55b9d76 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:11.839248 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2af11-0648-4cfc-a327-3ccfc55b9d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:11.856477 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-e5c2af11-0648-4cfc-a327-3ccfc55b9d76 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:58:11.857745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e5c2af11-0648-4cfc-a327-3ccfc55b9d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:58:11.875133 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:58:11.919435 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1194/2357] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:58:11.928353 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb3910-a5e9-41e9-a4bd-b97d4ef53d14 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:11.928646 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb3910-a5e9-41e9-a4bd-b97d4ef53d14 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:11.928925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb3910-a5e9-41e9-a4bd-b97d4ef53d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:11.947503 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-e2fb3910-a5e9-41e9-a4bd-b97d4ef53d14 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:58:11.948710 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-e2fb3910-a5e9-41e9-a4bd-b97d4ef53d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:58:11.957274 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1164/2358] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:58:11.961475 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2af11-0648-4cfc-a327-3ccfc55b9d76 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:58:11.971159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2af11-0648-4cfc-a327-3ccfc55b9d76 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:58:11.975776 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c72ef7-8b9a-4a36-b781-56241c5efc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:58:11.976426 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c72ef7-8b9a-4a36-b781-56241c5efc77 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:11.976713 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c72ef7-8b9a-4a36-b781-56241c5efc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:11.976995 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c72ef7-8b9a-4a36-b781-56241c5efc77 admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:11.977723 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c72ef7-8b9a-4a36-b781-56241c5efc77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:58:11.978080 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c72ef7-8b9a-4a36-b781-56241c5efc77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:58:11.979701 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c72ef7-8b9a-4a36-b781-56241c5efc77 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:58:11.991246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1195/2359] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:58:11.995559 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb3910-a5e9-41e9-a4bd-b97d4ef53d14 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:58:12.005803 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb3910-a5e9-41e9-a4bd-b97d4ef53d14 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:58:12.010662 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198166d-2b6c-40b1-aa57-88e299f54e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:58:12.011315 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198166d-2b6c-40b1-aa57-88e299f54e2f admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:12.011607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198166d-2b6c-40b1-aa57-88e299f54e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:12.011888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198166d-2b6c-40b1-aa57-88e299f54e2f admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:12.012595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198166d-2b6c-40b1-aa57-88e299f54e2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:58:12.015163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198166d-2b6c-40b1-aa57-88e299f54e2f admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:58:12.040409 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1165/2360] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:58:11 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:58:12.044555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c72ef7-8b9a-4a36-b781-56241c5efc77 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:58:12.054840 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c72ef7-8b9a-4a36-b781-56241c5efc77 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:58:12.112784 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bff09-3775-4bc7-9408-4b051b5555e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:58:12.113392 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bff09-3775-4bc7-9408-4b051b5555e4 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:12.113680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bff09-3775-4bc7-9408-4b051b5555e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:12.114144 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bff09-3775-4bc7-9408-4b051b5555e4 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:12.114835 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bff09-3775-4bc7-9408-4b051b5555e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:58:12.116743 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bff09-3775-4bc7-9408-4b051b5555e4 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:58:12.136669 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1196/2361] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:58:12 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:58:12.141455 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198166d-2b6c-40b1-aa57-88e299f54e2f admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:58:12.151802 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198166d-2b6c-40b1-aa57-88e299f54e2f admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:58:12.156554 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a65619-886d-4c0f-a8a5-1655e3f051a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:58:12.157492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a65619-886d-4c0f-a8a5-1655e3f051a5 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:12.157779 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a65619-886d-4c0f-a8a5-1655e3f051a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:12.158091 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a65619-886d-4c0f-a8a5-1655e3f051a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:12.158860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a65619-886d-4c0f-a8a5-1655e3f051a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:58:12.160549 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a65619-886d-4c0f-a8a5-1655e3f051a5 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:58:12.171775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1166/2362] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:58:12.175826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bff09-3775-4bc7-9408-4b051b5555e4 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:58:12.186398 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bff09-3775-4bc7-9408-4b051b5555e4 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:58:12.191128 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656a4ba-7d38-4ce1-a8dd-67a99cc26791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:58:12.191776 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656a4ba-7d38-4ce1-a8dd-67a99cc26791 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:12.192063 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656a4ba-7d38-4ce1-a8dd-67a99cc26791 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:12.192343 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656a4ba-7d38-4ce1-a8dd-67a99cc26791 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:12.193068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656a4ba-7d38-4ce1-a8dd-67a99cc26791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:58:12.194696 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656a4ba-7d38-4ce1-a8dd-67a99cc26791 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:58:12.204798 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1197/2363] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:58:12.213907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a65619-886d-4c0f-a8a5-1655e3f051a5 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:58:12.224184 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a65619-886d-4c0f-a8a5-1655e3f051a5 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:58:12.229026 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc916437-6912-41f8-bcf2-a174d76cfc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:58:12.229988 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc916437-6912-41f8-bcf2-a174d76cfc99 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:12.230328 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc916437-6912-41f8-bcf2-a174d76cfc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:12.230612 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc916437-6912-41f8-bcf2-a174d76cfc99 admin admin] PATH_INFO: `/v3/projects/464b2b85d3bf4fffbc90ef930952f886/users/766d521839c64b54a9eb29c4f40225dd/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:12.247081 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc916437-6912-41f8-bcf2-a174d76cfc99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=464b2b85d3bf4fffbc90ef930952f886, user_id=766d521839c64b54a9eb29c4f40225dd, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:58:12.250378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc916437-6912-41f8-bcf2-a174d76cfc99 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:58:12.262924 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1167/2364] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:58:12 2022] PUT /identity/v3/projects/464b2b85d3bf4fffbc90ef930952f886/users/766d521839c64b54a9eb29c4f40225dd/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:58:12.273263 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16f411-780f-4bd6-badd-3ff15e3e9a00 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:12.273556 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16f411-780f-4bd6-badd-3ff15e3e9a00 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:12.273837 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16f411-780f-4bd6-badd-3ff15e3e9a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:12.300389 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-fb16f411-780f-4bd6-badd-3ff15e3e9a00 None None] MFA Rules not processed for user `766d521839c64b54a9eb29c4f40225dd`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:58:12.301586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-fb16f411-780f-4bd6-badd-3ff15e3e9a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:58:12.366365 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1198/2365] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:58:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:58:12.377845 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc916437-6912-41f8-bcf2-a174d76cfc99 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:58:12.379555 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-bc916437-6912-41f8-bcf2-a174d76cfc99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:58:12.401570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:58:12.438642 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc916437-6912-41f8-bcf2-a174d76cfc99 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:58:12.442306 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3dec30-78e4-4676-a8e1-30df833a42bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:58:12.442937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dec30-78e4-4676-a8e1-30df833a42bc service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:12.443221 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dec30-78e4-4676-a8e1-30df833a42bc service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:12.443498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dec30-78e4-4676-a8e1-30df833a42bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:12.452158 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3dec30-78e4-4676-a8e1-30df833a42bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:58:12.453560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3dec30-78e4-4676-a8e1-30df833a42bc service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:58:12.462207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1168/2366] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:58:12 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:58:22.363180 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:58:22.458375 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=17 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:58:25.897680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03acc63-03df-4ce8-8847-2b47587e22a2 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:25.898363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03acc63-03df-4ce8-8847-2b47587e22a2 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:25.898363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03acc63-03df-4ce8-8847-2b47587e22a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:25.918054 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-c03acc63-03df-4ce8-8847-2b47587e22a2 None None] MFA Rules not processed for user `baaf74865f9849e49a7ccf2fe7ecb898`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:58:25.919305 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-c03acc63-03df-4ce8-8847-2b47587e22a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:58:25.983620 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1199/2367] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:58:35.976246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=25 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:58:49.481496 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3dec30-78e4-4676-a8e1-30df833a42bc service cinder] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:58:49.544460 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3dec30-78e4-4676-a8e1-30df833a42bc service cinder] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:58:49.549001 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d524c3b-0125-414d-a003-742dca05e78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:58:49.549893 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d524c3b-0125-414d-a003-742dca05e78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:49.550184 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d524c3b-0125-414d-a003-742dca05e78c admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:49.550463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d524c3b-0125-414d-a003-742dca05e78c admin admin] PATH_INFO: `/v3/users/766d521839c64b54a9eb29c4f40225dd` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:49.551648 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d524c3b-0125-414d-a003-742dca05e78c admin admin] RBAC: Authorizing `identity:delete_user(user_id=766d521839c64b54a9eb29c4f40225dd)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:58:49.553562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d524c3b-0125-414d-a003-742dca05e78c admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:58:49.603485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-1d524c3b-0125-414d-a003-742dca05e78c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '766d521839c64b54a9eb29c4f40225dd'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:58:49.611212 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-1d524c3b-0125-414d-a003-742dca05e78c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '766d521839c64b54a9eb29c4f40225dd'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:58:49.611907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-1d524c3b-0125-414d-a003-742dca05e78c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '766d521839c64b54a9eb29c4f40225dd'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:58:49.612518 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-1d524c3b-0125-414d-a003-742dca05e78c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '766d521839c64b54a9eb29c4f40225dd'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:58:49.625819 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-1d524c3b-0125-414d-a003-742dca05e78c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '766d521839c64b54a9eb29c4f40225dd'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:58:49.639167 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1169/2368] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:58:49 2022] DELETE /identity/v3/users/766d521839c64b54a9eb29c4f40225dd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:58:49.643355 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1059bd-7769-42b4-905c-2231eee9acc0 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:49.643875 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1059bd-7769-42b4-905c-2231eee9acc0 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:49.644150 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1059bd-7769-42b4-905c-2231eee9acc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:49.661754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-ab1059bd-7769-42b4-905c-2231eee9acc0 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:58:49.663132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ab1059bd-7769-42b4-905c-2231eee9acc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:58:49.725173 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1200/2369] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:58:49.736528 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d524c3b-0125-414d-a003-742dca05e78c admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:58:49.737910 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-1d524c3b-0125-414d-a003-742dca05e78c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:58:49.801188 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d524c3b-0125-414d-a003-742dca05e78c admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:58:49.805064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071e479-4906-4bbd-a0e9-00950df3399c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:58:49.805791 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071e479-4906-4bbd-a0e9-00950df3399c service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:49.806111 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071e479-4906-4bbd-a0e9-00950df3399c service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:49.806397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071e479-4906-4bbd-a0e9-00950df3399c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:49.817013 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071e479-4906-4bbd-a0e9-00950df3399c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:58:49.818557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071e479-4906-4bbd-a0e9-00950df3399c service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:58:49.827953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1170/2370] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:58:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:58:50.122984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1059bd-7769-42b4-905c-2231eee9acc0 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:58:50.125370 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ab1059bd-7769-42b4-905c-2231eee9acc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:58:50.140824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1059bd-7769-42b4-905c-2231eee9acc0 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:58:50.146454 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e0d5a-2e69-43a3-92ce-775760fb9874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:58:50.147785 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e0d5a-2e69-43a3-92ce-775760fb9874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:50.148347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e0d5a-2e69-43a3-92ce-775760fb9874 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:50.148818 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e0d5a-2e69-43a3-92ce-775760fb9874 admin admin] PATH_INFO: `/v3/projects/464b2b85d3bf4fffbc90ef930952f886` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:50.150897 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e0d5a-2e69-43a3-92ce-775760fb9874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=464b2b85d3bf4fffbc90ef930952f886)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:58:50.153145 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e0d5a-2e69-43a3-92ce-775760fb9874 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:58:50.196186 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fcff9-b10b-455b-98fa-190edab107e2 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:50.196489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fcff9-b10b-455b-98fa-190edab107e2 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:50.196781 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fcff9-b10b-455b-98fa-190edab107e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:50.212570 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-366e0d5a-2e69-43a3-92ce-775760fb9874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '464b2b85d3bf4fffbc90ef930952f886', 'request_id': 'req-366e0d5a-2e69-43a3-92ce-775760fb9874'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:58:50.216991 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-432fcff9-b10b-455b-98fa-190edab107e2 None None] MFA Rules not processed for user `dbf2c12174e94e2db9be178973183ced`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:58:50.218861 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-432fcff9-b10b-455b-98fa-190edab107e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:58:50.219778 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-366e0d5a-2e69-43a3-92ce-775760fb9874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '464b2b85d3bf4fffbc90ef930952f886', 'request_id': 'req-366e0d5a-2e69-43a3-92ce-775760fb9874'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:58:50.228254 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-366e0d5a-2e69-43a3-92ce-775760fb9874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '464b2b85d3bf4fffbc90ef930952f886', 'request_id': 'req-366e0d5a-2e69-43a3-92ce-775760fb9874'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:58:50.241754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-366e0d5a-2e69-43a3-92ce-775760fb9874 admin admin] The token cache is being invalidate because project 464b2b85d3bf4fffbc90ef930952f886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:58:50.242079 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-366e0d5a-2e69-43a3-92ce-775760fb9874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:58:50.242828 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-366e0d5a-2e69-43a3-92ce-775760fb9874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:58:50.244701 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1201/2371] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:58:50 2022] DELETE /identity/v3/projects/464b2b85d3bf4fffbc90ef930952f886 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:58:50.247291 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:58:50.249571 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350cadd-6b97-4550-b51b-7257a6772a86 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:50.249878 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350cadd-6b97-4550-b51b-7257a6772a86 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:50.250162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350cadd-6b97-4550-b51b-7257a6772a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:50.269983 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-0350cadd-6b97-4550-b51b-7257a6772a86 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:58:50.271689 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-0350cadd-6b97-4550-b51b-7257a6772a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:58:50.302411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1171/2372] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 23 15:58:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:58:50.341936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1202/2373] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:58:50.352297 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe0e63-e475-4835-9c69-21e14c7b701b None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:50.352596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe0e63-e475-4835-9c69-21e14c7b701b None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:50.352881 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe0e63-e475-4835-9c69-21e14c7b701b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:50.361838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350cadd-6b97-4550-b51b-7257a6772a86 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:58:50.363284 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-0350cadd-6b97-4550-b51b-7257a6772a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:58:50.375084 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-03fe0e63-e475-4835-9c69-21e14c7b701b None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:58:50.376463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-03fe0e63-e475-4835-9c69-21e14c7b701b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:58:50.388710 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1172/2374] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:58:50.390461 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe0e63-e475-4835-9c69-21e14c7b701b None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:58:50.393603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:58:50.400463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe0e63-e475-4835-9c69-21e14c7b701b None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:58:50.405756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd47f65-6e4b-4868-82e3-b8b5c3a67f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:58:50.406441 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd47f65-6e4b-4868-82e3-b8b5c3a67f6e admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:50.406724 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd47f65-6e4b-4868-82e3-b8b5c3a67f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:50.407287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd47f65-6e4b-4868-82e3-b8b5c3a67f6e admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:50.408016 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd47f65-6e4b-4868-82e3-b8b5c3a67f6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:58:50.408325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd47f65-6e4b-4868-82e3-b8b5c3a67f6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:58:50.409938 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd47f65-6e4b-4868-82e3-b8b5c3a67f6e admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:58:50.425043 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1173/2375] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 15:58:50.426085 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd47f65-6e4b-4868-82e3-b8b5c3a67f6e admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:58:50.436796 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd47f65-6e4b-4868-82e3-b8b5c3a67f6e admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:58:50.441949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321648e3-6575-4d87-ac6c-9fc7d22c7c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:58:50.442610 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321648e3-6575-4d87-ac6c-9fc7d22c7c73 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:50.442898 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321648e3-6575-4d87-ac6c-9fc7d22c7c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:50.443174 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321648e3-6575-4d87-ac6c-9fc7d22c7c73 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:50.443872 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321648e3-6575-4d87-ac6c-9fc7d22c7c73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:58:50.445763 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321648e3-6575-4d87-ac6c-9fc7d22c7c73 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:58:50.446081 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350cadd-6b97-4550-b51b-7257a6772a86 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:58:50.451346 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed5a0b-208e-4f6c-ad67-892c0d529efa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5824ee17e276483faf20db88a93545f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:58:50.452526 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed5a0b-208e-4f6c-ad67-892c0d529efa service swift] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:50.452816 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed5a0b-208e-4f6c-ad67-892c0d529efa service swift] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:50.453100 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed5a0b-208e-4f6c-ad67-892c0d529efa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:50.462523 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed5a0b-208e-4f6c-ad67-892c0d529efa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:58:50.464693 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed5a0b-208e-4f6c-ad67-892c0d529efa service swift] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:58:50.478650 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1174/2376] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:58:50 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:58:50.479276 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1203/2377] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 23 15:58:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 15:58:50.479767 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321648e3-6575-4d87-ac6c-9fc7d22c7c73 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:58:50.597242 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321648e3-6575-4d87-ac6c-9fc7d22c7c73 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:58:50.603238 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa903f7-96b0-4d8b-bf73-13cc389b9bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:58:50.603970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa903f7-96b0-4d8b-bf73-13cc389b9bbc admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:50.604274 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa903f7-96b0-4d8b-bf73-13cc389b9bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:50.604559 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa903f7-96b0-4d8b-bf73-13cc389b9bbc admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:50.605315 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa903f7-96b0-4d8b-bf73-13cc389b9bbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:58:50.607352 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa903f7-96b0-4d8b-bf73-13cc389b9bbc admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:58:50.640152 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1175/2378] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:58:50 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:58:50.641473 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed5a0b-208e-4f6c-ad67-892c0d529efa service swift] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:58:50.657390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed5a0b-208e-4f6c-ad67-892c0d529efa service swift] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:58:50.669546 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14234194-b00f-4604-b882-c641b8a7a1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:58:50.672468 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14234194-b00f-4604-b882-c641b8a7a1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:50.672825 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14234194-b00f-4604-b882-c641b8a7a1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:50.673171 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14234194-b00f-4604-b882-c641b8a7a1b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:50.674034 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14234194-b00f-4604-b882-c641b8a7a1b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:58:50.675694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14234194-b00f-4604-b882-c641b8a7a1b1 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:58:50.698447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1204/2379] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:58:50.699461 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa903f7-96b0-4d8b-bf73-13cc389b9bbc admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:58:50.713421 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa903f7-96b0-4d8b-bf73-13cc389b9bbc admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:58:50.735639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d9e4d-edaf-42c7-bc72-3260334d5865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:58:50.736337 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d9e4d-edaf-42c7-bc72-3260334d5865 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:50.736625 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d9e4d-edaf-42c7-bc72-3260334d5865 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:50.736909 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d9e4d-edaf-42c7-bc72-3260334d5865 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:50.737646 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d9e4d-edaf-42c7-bc72-3260334d5865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:58:50.739317 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d9e4d-edaf-42c7-bc72-3260334d5865 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:58:50.751618 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1176/2380] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:58:50.755964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14234194-b00f-4604-b882-c641b8a7a1b1 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:58:50.772930 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14234194-b00f-4604-b882-c641b8a7a1b1 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:58:50.781474 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2782ad-c13d-417d-ad48-6afb2e6d19d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:58:50.784231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2782ad-c13d-417d-ad48-6afb2e6d19d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:50.784870 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2782ad-c13d-417d-ad48-6afb2e6d19d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:50.785479 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2782ad-c13d-417d-ad48-6afb2e6d19d8 admin admin] PATH_INFO: `/v3/projects/00dd7350898d4b9cababb3697a017592/users/123f04114fcd449598eda2324232be27/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:50.811823 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2782ad-c13d-417d-ad48-6afb2e6d19d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00dd7350898d4b9cababb3697a017592, user_id=123f04114fcd449598eda2324232be27, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:58:50.815731 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2782ad-c13d-417d-ad48-6afb2e6d19d8 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:58:50.841953 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1205/2381] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:58:50 2022] PUT /identity/v3/projects/00dd7350898d4b9cababb3697a017592/users/123f04114fcd449598eda2324232be27/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:58:50.852018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407077b-7f6a-4d16-8d55-ecd4431d5f41 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:50.852687 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407077b-7f6a-4d16-8d55-ecd4431d5f41 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:50.853389 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407077b-7f6a-4d16-8d55-ecd4431d5f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:50.893149 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-c407077b-7f6a-4d16-8d55-ecd4431d5f41 None None] MFA Rules not processed for user `123f04114fcd449598eda2324232be27`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:58:50.894870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-c407077b-7f6a-4d16-8d55-ecd4431d5f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:58:50.965440 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:58:50.982097 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1177/2382] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:58:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:58:50.994430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2782ad-c13d-417d-ad48-6afb2e6d19d8 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:58:50.996673 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-9a2782ad-c13d-417d-ad48-6afb2e6d19d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:58:51.075086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2782ad-c13d-417d-ad48-6afb2e6d19d8 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:58:51.079630 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a978426-12ab-48ab-ac11-293d5d24b6d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:58:51.080526 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a978426-12ab-48ab-ac11-293d5d24b6d5 service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:58:51.080976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a978426-12ab-48ab-ac11-293d5d24b6d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:58:51.081240 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a978426-12ab-48ab-ac11-293d5d24b6d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:58:51.091302 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a978426-12ab-48ab-ac11-293d5d24b6d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:58:51.092778 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a978426-12ab-48ab-ac11-293d5d24b6d5 service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:58:51.104095 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1206/2383] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:58:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:59:00.979342 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:59:01.098372 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=62,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:59:01.753755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407077b-7f6a-4d16-8d55-ecd4431d5f41 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:01.818313 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407077b-7f6a-4d16-8d55-ecd4431d5f41 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:01.822898 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588d0a3-18df-4ffb-9658-505287f3264d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:01.823762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588d0a3-18df-4ffb-9658-505287f3264d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:01.824046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588d0a3-18df-4ffb-9658-505287f3264d admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:01.824323 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588d0a3-18df-4ffb-9658-505287f3264d admin admin] PATH_INFO: `/v3/users/123f04114fcd449598eda2324232be27` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:01.825524 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588d0a3-18df-4ffb-9658-505287f3264d admin admin] RBAC: Authorizing `identity:delete_user(user_id=123f04114fcd449598eda2324232be27)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:01.827628 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588d0a3-18df-4ffb-9658-505287f3264d admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:01.874022 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-6588d0a3-18df-4ffb-9658-505287f3264d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '123f04114fcd449598eda2324232be27'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:01.880955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-6588d0a3-18df-4ffb-9658-505287f3264d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '123f04114fcd449598eda2324232be27'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:01.881649 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-6588d0a3-18df-4ffb-9658-505287f3264d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '123f04114fcd449598eda2324232be27'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:01.882308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-6588d0a3-18df-4ffb-9658-505287f3264d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '123f04114fcd449598eda2324232be27'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:01.894186 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-6588d0a3-18df-4ffb-9658-505287f3264d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '123f04114fcd449598eda2324232be27'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:01.907899 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1178/2384] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:59:01 2022] DELETE /identity/v3/users/123f04114fcd449598eda2324232be27 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:59:01.912494 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e78a6-93dc-40fa-8ef8-ab45bf361b4a None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:01.912781 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e78a6-93dc-40fa-8ef8-ab45bf361b4a None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:01.913058 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e78a6-93dc-40fa-8ef8-ab45bf361b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:01.930597 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-b62e78a6-93dc-40fa-8ef8-ab45bf361b4a None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:59:01.931824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-b62e78a6-93dc-40fa-8ef8-ab45bf361b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:01.991343 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1207/2385] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:59:02.001228 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588d0a3-18df-4ffb-9658-505287f3264d admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:02.002822 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-6588d0a3-18df-4ffb-9658-505287f3264d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:02.061775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588d0a3-18df-4ffb-9658-505287f3264d admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:02.065487 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f288c-4dc0-48e5-876f-2f994f2df2c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:02.066178 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f288c-4dc0-48e5-876f-2f994f2df2c6 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:02.066469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f288c-4dc0-48e5-876f-2f994f2df2c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:02.066751 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f288c-4dc0-48e5-876f-2f994f2df2c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:02.076195 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f288c-4dc0-48e5-876f-2f994f2df2c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:02.077620 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f288c-4dc0-48e5-876f-2f994f2df2c6 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:02.087162 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1179/2386] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:59:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:59:02.372775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e78a6-93dc-40fa-8ef8-ab45bf361b4a None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:02.374245 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-b62e78a6-93dc-40fa-8ef8-ab45bf361b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:02.389171 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e78a6-93dc-40fa-8ef8-ab45bf361b4a None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:02.394207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5a3f2-fbfc-4b93-943c-80f1d01900d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:02.395631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5a3f2-fbfc-4b93-943c-80f1d01900d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:02.395922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5a3f2-fbfc-4b93-943c-80f1d01900d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:02.396413 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5a3f2-fbfc-4b93-943c-80f1d01900d2 admin admin] PATH_INFO: `/v3/projects/00dd7350898d4b9cababb3697a017592` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:02.398033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5a3f2-fbfc-4b93-943c-80f1d01900d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00dd7350898d4b9cababb3697a017592)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:02.400054 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee5a3f2-fbfc-4b93-943c-80f1d01900d2 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:02.450283 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1ee5a3f2-fbfc-4b93-943c-80f1d01900d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00dd7350898d4b9cababb3697a017592', 'request_id': 'req-1ee5a3f2-fbfc-4b93-943c-80f1d01900d2'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:02.458457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1ee5a3f2-fbfc-4b93-943c-80f1d01900d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00dd7350898d4b9cababb3697a017592', 'request_id': 'req-1ee5a3f2-fbfc-4b93-943c-80f1d01900d2'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:02.469109 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1ee5a3f2-fbfc-4b93-943c-80f1d01900d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00dd7350898d4b9cababb3697a017592', 'request_id': 'req-1ee5a3f2-fbfc-4b93-943c-80f1d01900d2'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:02.481314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1ee5a3f2-fbfc-4b93-943c-80f1d01900d2 admin admin] The token cache is being invalidate because project 00dd7350898d4b9cababb3697a017592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:59:02.481609 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1ee5a3f2-fbfc-4b93-943c-80f1d01900d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:02.482313 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1ee5a3f2-fbfc-4b93-943c-80f1d01900d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:02.483919 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1208/2387] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:59:02 2022] DELETE /identity/v3/projects/00dd7350898d4b9cababb3697a017592 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:59:06.995153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f46af-be7e-47bd-8575-618be153767d None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:06.995714 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f46af-be7e-47bd-8575-618be153767d None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:06.995714 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f46af-be7e-47bd-8575-618be153767d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:07.014464 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-084f46af-be7e-47bd-8575-618be153767d None None] MFA Rules not processed for user `dbf2c12174e94e2db9be178973183ced`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:59:07.015689 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-084f46af-be7e-47bd-8575-618be153767d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:07.033969 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:59:07.073942 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1180/2388] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 23 15:59:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:59:07.086405 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5a3f2-fbfc-4b93-943c-80f1d01900d2 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:07.087800 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-1ee5a3f2-fbfc-4b93-943c-80f1d01900d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:07.166199 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5a3f2-fbfc-4b93-943c-80f1d01900d2 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:07.171076 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a358c-6529-4aaa-90f6-3de3ad454174 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5824ee17e276483faf20db88a93545f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:07.171762 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a358c-6529-4aaa-90f6-3de3ad454174 service swift] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:07.172048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a358c-6529-4aaa-90f6-3de3ad454174 service swift] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:07.172345 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a358c-6529-4aaa-90f6-3de3ad454174 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:07.181444 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a358c-6529-4aaa-90f6-3de3ad454174 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:07.183135 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a358c-6529-4aaa-90f6-3de3ad454174 service swift] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:07.196272 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1209/2389] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 23 15:59:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 15:59:17.066506 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=15 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:59:17.190388 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:59:30.242914 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77b5a3-7ced-4a45-a415-950d6ac23667 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:30.243646 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77b5a3-7ced-4a45-a415-950d6ac23667 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:30.243646 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77b5a3-7ced-4a45-a415-950d6ac23667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:30.262816 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-6a77b5a3-7ced-4a45-a415-950d6ac23667 None None] MFA Rules not processed for user `dbf2c12174e94e2db9be178973183ced`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:59:30.264034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-6a77b5a3-7ced-4a45-a415-950d6ac23667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:30.271792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1181/2390] 10.222.0.15 () {58 vars in 967 bytes} [Thu Jun 23 15:59:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:59:30.284273 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a358c-6529-4aaa-90f6-3de3ad454174 service swift] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:30.294935 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a358c-6529-4aaa-90f6-3de3ad454174 service swift] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:30.300683 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c86fcf-c332-4e1b-97ed-b36ebd5c56d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5824ee17e276483faf20db88a93545f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:30.301328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c86fcf-c332-4e1b-97ed-b36ebd5c56d8 service swift] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:30.301646 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c86fcf-c332-4e1b-97ed-b36ebd5c56d8 service swift] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:30.301952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c86fcf-c332-4e1b-97ed-b36ebd5c56d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:30.310319 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c86fcf-c332-4e1b-97ed-b36ebd5c56d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:30.311904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c86fcf-c332-4e1b-97ed-b36ebd5c56d8 service swift] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:30.320594 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1210/2391] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 23 15:59:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 15:59:39.613526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77b5a3-7ced-4a45-a415-950d6ac23667 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:39.615207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-6a77b5a3-7ced-4a45-a415-950d6ac23667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:39.696618 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77b5a3-7ced-4a45-a415-950d6ac23667 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:39.702120 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93228fb0-5c8e-4728-b7f0-249c9f1ea2f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9300c3a803e94f9a93442f551fc9646f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:39.702778 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93228fb0-5c8e-4728-b7f0-249c9f1ea2f5 service placement] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:39.703059 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93228fb0-5c8e-4728-b7f0-249c9f1ea2f5 service placement] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:39.703343 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93228fb0-5c8e-4728-b7f0-249c9f1ea2f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:39.705247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-93228fb0-5c8e-4728-b7f0-249c9f1ea2f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:39.717831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93228fb0-5c8e-4728-b7f0-249c9f1ea2f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:39.719494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93228fb0-5c8e-4728-b7f0-249c9f1ea2f5 service placement] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:39.730934 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1182/2392] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:59:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:59:40.317313 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=6 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:59:44.923731 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c86fcf-c332-4e1b-97ed-b36ebd5c56d8 service swift] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:44.925778 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-b4c86fcf-c332-4e1b-97ed-b36ebd5c56d8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:44.982852 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c86fcf-c332-4e1b-97ed-b36ebd5c56d8 service swift] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:44.986537 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aeb028-959e-4268-b5ff-a4a3016e0242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:44.987199 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeb028-959e-4268-b5ff-a4a3016e0242 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:44.987483 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeb028-959e-4268-b5ff-a4a3016e0242 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:44.987762 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aeb028-959e-4268-b5ff-a4a3016e0242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:44.989576 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-29aeb028-959e-4268-b5ff-a4a3016e0242 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:45.053033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aeb028-959e-4268-b5ff-a4a3016e0242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:45.054529 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aeb028-959e-4268-b5ff-a4a3016e0242 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:45.064302 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1211/2393] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:59:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 15:59:48.177810 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93228fb0-5c8e-4728-b7f0-249c9f1ea2f5 service placement] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:48.179400 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-93228fb0-5c8e-4728-b7f0-249c9f1ea2f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:48.196898 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93228fb0-5c8e-4728-b7f0-249c9f1ea2f5 service placement] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:48.201479 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c75f727-119e-4a32-9abf-d57a975ab18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:48.202369 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75f727-119e-4a32-9abf-d57a975ab18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:48.202654 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75f727-119e-4a32-9abf-d57a975ab18a admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:48.202934 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c75f727-119e-4a32-9abf-d57a975ab18a admin admin] PATH_INFO: `/v3/users/fa813b65a2b141ffa2359e5f0b0ae4c0` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:48.204133 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75f727-119e-4a32-9abf-d57a975ab18a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa813b65a2b141ffa2359e5f0b0ae4c0)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:48.206086 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c75f727-119e-4a32-9abf-d57a975ab18a admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:48.254462 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-5c75f727-119e-4a32-9abf-d57a975ab18a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa813b65a2b141ffa2359e5f0b0ae4c0'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:48.261645 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-5c75f727-119e-4a32-9abf-d57a975ab18a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa813b65a2b141ffa2359e5f0b0ae4c0'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:48.262337 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-5c75f727-119e-4a32-9abf-d57a975ab18a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa813b65a2b141ffa2359e5f0b0ae4c0'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:48.262933 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-5c75f727-119e-4a32-9abf-d57a975ab18a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa813b65a2b141ffa2359e5f0b0ae4c0'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:48.274381 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-5c75f727-119e-4a32-9abf-d57a975ab18a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa813b65a2b141ffa2359e5f0b0ae4c0'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:48.288935 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1183/2394] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:59:48 2022] DELETE /identity/v3/users/fa813b65a2b141ffa2359e5f0b0ae4c0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:59:48.463192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aeb028-959e-4268-b5ff-a4a3016e0242 service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:48.475391 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aeb028-959e-4268-b5ff-a4a3016e0242 service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:48.532918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e4e87-0f29-4316-8e16-80925ae00450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:48.534318 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e4e87-0f29-4316-8e16-80925ae00450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:48.534599 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e4e87-0f29-4316-8e16-80925ae00450 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:48.534872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e4e87-0f29-4316-8e16-80925ae00450 admin admin] PATH_INFO: `/v3/projects/621bfa2a49434ddcb0f6b3f5bdbc4ae3` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:48.536046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e4e87-0f29-4316-8e16-80925ae00450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=621bfa2a49434ddcb0f6b3f5bdbc4ae3)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:48.537951 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e4e87-0f29-4316-8e16-80925ae00450 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:48.583729 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-c30e4e87-0f29-4316-8e16-80925ae00450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '621bfa2a49434ddcb0f6b3f5bdbc4ae3', 'request_id': 'req-c30e4e87-0f29-4316-8e16-80925ae00450'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:48.585613 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:59:48.590729 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-c30e4e87-0f29-4316-8e16-80925ae00450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '621bfa2a49434ddcb0f6b3f5bdbc4ae3', 'request_id': 'req-c30e4e87-0f29-4316-8e16-80925ae00450'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:48.599397 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-c30e4e87-0f29-4316-8e16-80925ae00450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '621bfa2a49434ddcb0f6b3f5bdbc4ae3', 'request_id': 'req-c30e4e87-0f29-4316-8e16-80925ae00450'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:48.610245 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-c30e4e87-0f29-4316-8e16-80925ae00450 admin admin] The token cache is being invalidate because project 621bfa2a49434ddcb0f6b3f5bdbc4ae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:59:48.610538 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-c30e4e87-0f29-4316-8e16-80925ae00450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:48.611181 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-c30e4e87-0f29-4316-8e16-80925ae00450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:48.613328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1212/2395] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:59:48 2022] DELETE /identity/v3/projects/621bfa2a49434ddcb0f6b3f5bdbc4ae3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:59:48.618264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d2b2c-8829-4339-b986-31d01ff3442b None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:48.618559 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d2b2c-8829-4339-b986-31d01ff3442b None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:48.618842 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d2b2c-8829-4339-b986-31d01ff3442b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:48.636134 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-c06d2b2c-8829-4339-b986-31d01ff3442b None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:59:48.637382 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-c06d2b2c-8829-4339-b986-31d01ff3442b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:48.685231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:59:48.698367 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1184/2396] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:59:48.707399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4079a5-38e5-46e9-a74f-47b258162600 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:48.707773 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4079a5-38e5-46e9-a74f-47b258162600 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:48.708066 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4079a5-38e5-46e9-a74f-47b258162600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:48.727056 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-7f4079a5-38e5-46e9-a74f-47b258162600 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:59:48.728273 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-7f4079a5-38e5-46e9-a74f-47b258162600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:48.736381 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1213/2397] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:59:48.740620 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d2b2c-8829-4339-b986-31d01ff3442b None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:48.750469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d2b2c-8829-4339-b986-31d01ff3442b None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:48.756524 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8ac31-38d9-4167-a86b-6e7d9105dff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:48.757312 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8ac31-38d9-4167-a86b-6e7d9105dff8 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:48.757592 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8ac31-38d9-4167-a86b-6e7d9105dff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:48.757905 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8ac31-38d9-4167-a86b-6e7d9105dff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:48.758625 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8ac31-38d9-4167-a86b-6e7d9105dff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:59:48.758931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8ac31-38d9-4167-a86b-6e7d9105dff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:48.760515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8ac31-38d9-4167-a86b-6e7d9105dff8 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:48.773566 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1185/2398] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:59:48.777775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4079a5-38e5-46e9-a74f-47b258162600 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:48.788047 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4079a5-38e5-46e9-a74f-47b258162600 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:48.793183 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d31bb2-14f9-4941-8bf7-9371f8fff3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:48.793831 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d31bb2-14f9-4941-8bf7-9371f8fff3aa admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:48.794143 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d31bb2-14f9-4941-8bf7-9371f8fff3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:48.794436 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d31bb2-14f9-4941-8bf7-9371f8fff3aa admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:48.795107 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d31bb2-14f9-4941-8bf7-9371f8fff3aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:48.797001 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d31bb2-14f9-4941-8bf7-9371f8fff3aa admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:48.823629 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1214/2399] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:59:48 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:59:48.827921 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8ac31-38d9-4167-a86b-6e7d9105dff8 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:48.838666 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8ac31-38d9-4167-a86b-6e7d9105dff8 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:48.897518 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb126a-989c-48d2-8e79-709529e22042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:48.898213 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb126a-989c-48d2-8e79-709529e22042 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:48.898497 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb126a-989c-48d2-8e79-709529e22042 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:48.898771 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb126a-989c-48d2-8e79-709529e22042 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:48.899471 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb126a-989c-48d2-8e79-709529e22042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:48.901369 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb126a-989c-48d2-8e79-709529e22042 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:48.923634 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1186/2400] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:59:48 2022] POST /identity/v3/users => generated 303 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:59:48.927778 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d31bb2-14f9-4941-8bf7-9371f8fff3aa admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:48.938478 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d31bb2-14f9-4941-8bf7-9371f8fff3aa admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:48.943422 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40313b47-936f-4134-969e-7dce364b1cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:48.944111 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40313b47-936f-4134-969e-7dce364b1cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:48.944399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40313b47-936f-4134-969e-7dce364b1cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:48.944680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40313b47-936f-4134-969e-7dce364b1cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:48.945414 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40313b47-936f-4134-969e-7dce364b1cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:48.947070 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40313b47-936f-4134-969e-7dce364b1cc4 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:48.958650 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1215/2401] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:59:48.962728 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb126a-989c-48d2-8e79-709529e22042 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:48.973716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb126a-989c-48d2-8e79-709529e22042 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:48.978503 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f2963-7cd1-427c-a41b-bf05002e424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:48.979133 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f2963-7cd1-427c-a41b-bf05002e424e admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:48.979420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f2963-7cd1-427c-a41b-bf05002e424e admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:48.979701 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f2963-7cd1-427c-a41b-bf05002e424e admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:48.980440 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f2963-7cd1-427c-a41b-bf05002e424e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:48.982078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f2963-7cd1-427c-a41b-bf05002e424e admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:48.992585 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1187/2402] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:59:48.997028 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40313b47-936f-4134-969e-7dce364b1cc4 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:49.007346 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40313b47-936f-4134-969e-7dce364b1cc4 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:49.012302 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3279abd-7a08-4be4-b3e9-4f573322b7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:49.013332 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3279abd-7a08-4be4-b3e9-4f573322b7a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:49.013622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3279abd-7a08-4be4-b3e9-4f573322b7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:49.014041 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3279abd-7a08-4be4-b3e9-4f573322b7a7 admin admin] PATH_INFO: `/v3/projects/87d36616cc9f429dbff641bb86d86311/users/b7dda457ea8647b397a454e81b84d4f2/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:49.030482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3279abd-7a08-4be4-b3e9-4f573322b7a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87d36616cc9f429dbff641bb86d86311, user_id=b7dda457ea8647b397a454e81b84d4f2, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:49.033415 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3279abd-7a08-4be4-b3e9-4f573322b7a7 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:49.046793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1216/2403] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:59:48 2022] PUT /identity/v3/projects/87d36616cc9f429dbff641bb86d86311/users/b7dda457ea8647b397a454e81b84d4f2/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:59:49.051949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118c6dd-eae3-4812-a868-4fdc942e8066 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:49.052246 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118c6dd-eae3-4812-a868-4fdc942e8066 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:49.052571 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118c6dd-eae3-4812-a868-4fdc942e8066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:49.070373 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-6118c6dd-eae3-4812-a868-4fdc942e8066 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:59:49.071577 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-6118c6dd-eae3-4812-a868-4fdc942e8066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:49.131336 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1188/2404] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:59:49.141090 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3279abd-7a08-4be4-b3e9-4f573322b7a7 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:49.142803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-c3279abd-7a08-4be4-b3e9-4f573322b7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:49.209014 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3279abd-7a08-4be4-b3e9-4f573322b7a7 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:49.212573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a0a96-2bbe-4367-b4f2-db93f465e90b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:49.213228 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a0a96-2bbe-4367-b4f2-db93f465e90b service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:49.213516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a0a96-2bbe-4367-b4f2-db93f465e90b service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:49.213796 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a0a96-2bbe-4367-b4f2-db93f465e90b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:49.223278 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a0a96-2bbe-4367-b4f2-db93f465e90b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:49.224723 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366a0a96-2bbe-4367-b4f2-db93f465e90b service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:49.235163 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1217/2405] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:59:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:59:49.873881 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dd2c1-282f-45bf-8c1a-fe96ddc423e2 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:49.874414 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dd2c1-282f-45bf-8c1a-fe96ddc423e2 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:49.874414 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87dd2c1-282f-45bf-8c1a-fe96ddc423e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:49.901355 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-a87dd2c1-282f-45bf-8c1a-fe96ddc423e2 None None] MFA Rules not processed for user `b7dda457ea8647b397a454e81b84d4f2`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:59:49.902625 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-a87dd2c1-282f-45bf-8c1a-fe96ddc423e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:49.955123 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:59:49.975194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1189/2406] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:59:49 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:59:49.979805 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a0a96-2bbe-4367-b4f2-db93f465e90b service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:49.990770 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a0a96-2bbe-4367-b4f2-db93f465e90b service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:49.995418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82309bbb-484f-4e16-9387-8c7dcf539cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:49.996107 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82309bbb-484f-4e16-9387-8c7dcf539cce admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:49.996551 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82309bbb-484f-4e16-9387-8c7dcf539cce admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:49.996891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82309bbb-484f-4e16-9387-8c7dcf539cce admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:49.997534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82309bbb-484f-4e16-9387-8c7dcf539cce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:49.999466 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82309bbb-484f-4e16-9387-8c7dcf539cce admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:50.027795 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1218/2407] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:59:49 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:59:50.032419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87dd2c1-282f-45bf-8c1a-fe96ddc423e2 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:50.044343 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87dd2c1-282f-45bf-8c1a-fe96ddc423e2 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:50.100510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e260537-d88e-46de-a5ef-235566400c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:50.101202 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e260537-d88e-46de-a5ef-235566400c42 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:50.101484 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e260537-d88e-46de-a5ef-235566400c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:50.101758 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e260537-d88e-46de-a5ef-235566400c42 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:50.102487 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e260537-d88e-46de-a5ef-235566400c42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:50.104427 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e260537-d88e-46de-a5ef-235566400c42 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:50.125003 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1190/2408] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:59:50 2022] POST /identity/v3/users => generated 309 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 15:59:50.129121 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82309bbb-484f-4e16-9387-8c7dcf539cce admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:50.139774 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82309bbb-484f-4e16-9387-8c7dcf539cce admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:50.144571 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1fe74-9286-4139-9ac3-71b9cc4dff04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:50.145264 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1fe74-9286-4139-9ac3-71b9cc4dff04 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:50.145546 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1fe74-9286-4139-9ac3-71b9cc4dff04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:50.145826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1fe74-9286-4139-9ac3-71b9cc4dff04 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:50.146817 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1fe74-9286-4139-9ac3-71b9cc4dff04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:50.148218 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1fe74-9286-4139-9ac3-71b9cc4dff04 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:50.161965 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1219/2409] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 15:59:50.166300 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e260537-d88e-46de-a5ef-235566400c42 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:50.176933 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e260537-d88e-46de-a5ef-235566400c42 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:50.181613 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001033a-db3c-4892-bd19-9363c58f94a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:50.182540 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001033a-db3c-4892-bd19-9363c58f94a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:50.182829 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001033a-db3c-4892-bd19-9363c58f94a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:50.183112 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001033a-db3c-4892-bd19-9363c58f94a7 admin admin] PATH_INFO: `/v3/projects/d62852ae9f7443efa7949f13716a17db/users/4abf05cd1ed740d79ba97941db7debe7/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:50.199244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001033a-db3c-4892-bd19-9363c58f94a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d62852ae9f7443efa7949f13716a17db, user_id=4abf05cd1ed740d79ba97941db7debe7, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:50.201960 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001033a-db3c-4892-bd19-9363c58f94a7 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:50.215932 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1191/2410] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:59:50 2022] PUT /identity/v3/projects/d62852ae9f7443efa7949f13716a17db/users/4abf05cd1ed740d79ba97941db7debe7/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:59:50.219751 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1fe74-9286-4139-9ac3-71b9cc4dff04 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:50.230568 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1fe74-9286-4139-9ac3-71b9cc4dff04 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:50.273532 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:59:50.289204 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ce7ae-d70b-44c9-96c6-31889fda3b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:50.289835 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ce7ae-d70b-44c9-96c6-31889fda3b8a admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:50.290256 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ce7ae-d70b-44c9-96c6-31889fda3b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:50.290457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ce7ae-d70b-44c9-96c6-31889fda3b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:50.291193 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ce7ae-d70b-44c9-96c6-31889fda3b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:50.292776 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ce7ae-d70b-44c9-96c6-31889fda3b8a admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:50.302772 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1220/2411] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:59:50.306994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001033a-db3c-4892-bd19-9363c58f94a7 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:50.317472 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001033a-db3c-4892-bd19-9363c58f94a7 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:50.322386 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef0e28-2f48-4c69-85ea-34bf5193ac24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:50.323280 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef0e28-2f48-4c69-85ea-34bf5193ac24 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:50.323563 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef0e28-2f48-4c69-85ea-34bf5193ac24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:50.323845 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef0e28-2f48-4c69-85ea-34bf5193ac24 admin admin] PATH_INFO: `/v3/projects/d62852ae9f7443efa7949f13716a17db/users/4abf05cd1ed740d79ba97941db7debe7/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:50.325827 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef0e28-2f48-4c69-85ea-34bf5193ac24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d62852ae9f7443efa7949f13716a17db, user_id=4abf05cd1ed740d79ba97941db7debe7, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:50.328514 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef0e28-2f48-4c69-85ea-34bf5193ac24 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:50.342316 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1192/2412] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:59:50 2022] PUT /identity/v3/projects/d62852ae9f7443efa7949f13716a17db/users/4abf05cd1ed740d79ba97941db7debe7/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:59:50.959406 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2b355-856a-4d9b-ae17-03ca3174abe6 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:50.959694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2b355-856a-4d9b-ae17-03ca3174abe6 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:50.960078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2b355-856a-4d9b-ae17-03ca3174abe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:50.990678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-24d2b355-856a-4d9b-ae17-03ca3174abe6 None None] MFA Rules not processed for user `4abf05cd1ed740d79ba97941db7debe7`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:59:50.992126 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-24d2b355-856a-4d9b-ae17-03ca3174abe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:51.066051 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1221/2413] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:59:50 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:59:51.618198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdd708-5feb-4ef6-9263-4ce1cdcacda9 None None] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:51.618817 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdd708-5feb-4ef6-9263-4ce1cdcacda9 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:51.618817 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdd708-5feb-4ef6-9263-4ce1cdcacda9 None None] PATH_INFO: `/` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:51.620256 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1193/2414] 10.222.0.15 () {54 vars in 921 bytes} [Thu Jun 23 15:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 15:59:51.626538 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c1e90-83f5-4e01-b7d9-49ac76f597fb None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:51.626887 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c1e90-83f5-4e01-b7d9-49ac76f597fb None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:51.627183 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c1e90-83f5-4e01-b7d9-49ac76f597fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:51.666889 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-b76c1e90-83f5-4e01-b7d9-49ac76f597fb None None] MFA Rules not processed for user `9300c3a803e94f9a93442f551fc9646f`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:59:51.668054 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-b76c1e90-83f5-4e01-b7d9-49ac76f597fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:51.741028 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1222/2415] 10.222.0.15 () {58 vars in 1018 bytes} [Thu Jun 23 15:59:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 15:59:51.752055 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdd708-5feb-4ef6-9263-4ce1cdcacda9 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:51.754423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-f6bdd708-5feb-4ef6-9263-4ce1cdcacda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:51.772117 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdd708-5feb-4ef6-9263-4ce1cdcacda9 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:51.777805 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa632084-5d83-405b-bf83-eaf949aa520a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9300c3a803e94f9a93442f551fc9646f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:51.778369 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa632084-5d83-405b-bf83-eaf949aa520a service placement] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:51.778603 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa632084-5d83-405b-bf83-eaf949aa520a service placement] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:51.778882 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa632084-5d83-405b-bf83-eaf949aa520a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:51.788485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa632084-5d83-405b-bf83-eaf949aa520a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:51.790088 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa632084-5d83-405b-bf83-eaf949aa520a service placement] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:51.802382 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1194/2416] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:59:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:59:52.210930 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c1e90-83f5-4e01-b7d9-49ac76f597fb None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:52.264386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:59:52.278068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c1e90-83f5-4e01-b7d9-49ac76f597fb None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:52.283727 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc30582-e9d3-42c5-9879-be5abf3aaa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:52.284631 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc30582-e9d3-42c5-9879-be5abf3aaa32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:52.284908 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc30582-e9d3-42c5-9879-be5abf3aaa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:52.285177 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc30582-e9d3-42c5-9879-be5abf3aaa32 admin admin] PATH_INFO: `/v3/users/b7dda457ea8647b397a454e81b84d4f2` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:52.286482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc30582-e9d3-42c5-9879-be5abf3aaa32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7dda457ea8647b397a454e81b84d4f2)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:52.288443 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc30582-e9d3-42c5-9879-be5abf3aaa32 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:52.338749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-bdc30582-e9d3-42c5-9879-be5abf3aaa32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7dda457ea8647b397a454e81b84d4f2'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:52.345716 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-bdc30582-e9d3-42c5-9879-be5abf3aaa32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7dda457ea8647b397a454e81b84d4f2'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:52.346701 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-bdc30582-e9d3-42c5-9879-be5abf3aaa32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7dda457ea8647b397a454e81b84d4f2'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:52.347341 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-bdc30582-e9d3-42c5-9879-be5abf3aaa32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7dda457ea8647b397a454e81b84d4f2'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:52.360099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-bdc30582-e9d3-42c5-9879-be5abf3aaa32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7dda457ea8647b397a454e81b84d4f2'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:52.372736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1223/2417] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:59:52 2022] DELETE /identity/v3/users/b7dda457ea8647b397a454e81b84d4f2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:59:52.547549 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa632084-5d83-405b-bf83-eaf949aa520a service placement] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:52.559204 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa632084-5d83-405b-bf83-eaf949aa520a service placement] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:52.625531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbf4b4-66b9-4d39-8f0a-f0b2c4065b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:52.626427 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf4b4-66b9-4d39-8f0a-f0b2c4065b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:52.626712 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf4b4-66b9-4d39-8f0a-f0b2c4065b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:52.626991 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bbf4b4-66b9-4d39-8f0a-f0b2c4065b95 admin admin] PATH_INFO: `/v3/projects/87d36616cc9f429dbff641bb86d86311` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:52.628881 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbf4b4-66b9-4d39-8f0a-f0b2c4065b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87d36616cc9f429dbff641bb86d86311)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:52.630811 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bbf4b4-66b9-4d39-8f0a-f0b2c4065b95 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:52.666838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:59:52.680904 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e7bbf4b4-66b9-4d39-8f0a-f0b2c4065b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87d36616cc9f429dbff641bb86d86311', 'request_id': 'req-e7bbf4b4-66b9-4d39-8f0a-f0b2c4065b95'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:52.688413 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e7bbf4b4-66b9-4d39-8f0a-f0b2c4065b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87d36616cc9f429dbff641bb86d86311', 'request_id': 'req-e7bbf4b4-66b9-4d39-8f0a-f0b2c4065b95'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:52.695536 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e7bbf4b4-66b9-4d39-8f0a-f0b2c4065b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87d36616cc9f429dbff641bb86d86311', 'request_id': 'req-e7bbf4b4-66b9-4d39-8f0a-f0b2c4065b95'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:52.709042 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e7bbf4b4-66b9-4d39-8f0a-f0b2c4065b95 admin admin] The token cache is being invalidate because project 87d36616cc9f429dbff641bb86d86311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:59:52.709334 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e7bbf4b4-66b9-4d39-8f0a-f0b2c4065b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:52.710031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e7bbf4b4-66b9-4d39-8f0a-f0b2c4065b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:52.711575 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1195/2418] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:59:52 2022] DELETE /identity/v3/projects/87d36616cc9f429dbff641bb86d86311 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:59:52.715544 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc30582-e9d3-42c5-9879-be5abf3aaa32 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:52.716945 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-bdc30582-e9d3-42c5-9879-be5abf3aaa32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:52.730027 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc30582-e9d3-42c5-9879-be5abf3aaa32 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:52.786731 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f94df1-02d0-4718-a11f-af16274d0fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:52.787597 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f94df1-02d0-4718-a11f-af16274d0fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:52.787885 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f94df1-02d0-4718-a11f-af16274d0fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:52.788166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f94df1-02d0-4718-a11f-af16274d0fa2 admin admin] PATH_INFO: `/v3/users/4abf05cd1ed740d79ba97941db7debe7` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:52.789353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f94df1-02d0-4718-a11f-af16274d0fa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4abf05cd1ed740d79ba97941db7debe7)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:52.791386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f94df1-02d0-4718-a11f-af16274d0fa2 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:52.839132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-a7f94df1-02d0-4718-a11f-af16274d0fa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4abf05cd1ed740d79ba97941db7debe7'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:52.847071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-a7f94df1-02d0-4718-a11f-af16274d0fa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4abf05cd1ed740d79ba97941db7debe7'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:52.847814 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-a7f94df1-02d0-4718-a11f-af16274d0fa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4abf05cd1ed740d79ba97941db7debe7'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:52.848433 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-a7f94df1-02d0-4718-a11f-af16274d0fa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4abf05cd1ed740d79ba97941db7debe7'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:52.861037 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:59:52.863148 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-a7f94df1-02d0-4718-a11f-af16274d0fa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4abf05cd1ed740d79ba97941db7debe7'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:52.878960 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1224/2419] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 15:59:52 2022] DELETE /identity/v3/users/4abf05cd1ed740d79ba97941db7debe7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:59:53.076424 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbf4b4-66b9-4d39-8f0a-f0b2c4065b95 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:53.077952 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-e7bbf4b4-66b9-4d39-8f0a-f0b2c4065b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:53.091580 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bbf4b4-66b9-4d39-8f0a-f0b2c4065b95 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:53.155816 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c034984b-47f2-4a94-befa-de6b346cfe68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:53.156695 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034984b-47f2-4a94-befa-de6b346cfe68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:53.157244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034984b-47f2-4a94-befa-de6b346cfe68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:53.157595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034984b-47f2-4a94-befa-de6b346cfe68 admin admin] PATH_INFO: `/v3/projects/d62852ae9f7443efa7949f13716a17db` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:53.159482 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034984b-47f2-4a94-befa-de6b346cfe68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d62852ae9f7443efa7949f13716a17db)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:53.161452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c034984b-47f2-4a94-befa-de6b346cfe68 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:53.215157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c034984b-47f2-4a94-befa-de6b346cfe68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd62852ae9f7443efa7949f13716a17db', 'request_id': 'req-c034984b-47f2-4a94-befa-de6b346cfe68'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:53.223529 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c034984b-47f2-4a94-befa-de6b346cfe68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd62852ae9f7443efa7949f13716a17db', 'request_id': 'req-c034984b-47f2-4a94-befa-de6b346cfe68'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:53.230668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c034984b-47f2-4a94-befa-de6b346cfe68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd62852ae9f7443efa7949f13716a17db', 'request_id': 'req-c034984b-47f2-4a94-befa-de6b346cfe68'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:53.242307 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c034984b-47f2-4a94-befa-de6b346cfe68 admin admin] The token cache is being invalidate because project d62852ae9f7443efa7949f13716a17db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 15:59:53.242604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c034984b-47f2-4a94-befa-de6b346cfe68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:53.243271 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c034984b-47f2-4a94-befa-de6b346cfe68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 15:59:53.244834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1196/2420] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 15:59:53 2022] DELETE /identity/v3/projects/d62852ae9f7443efa7949f13716a17db => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:59:53.249842 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae9cdb-675f-4990-b969-b4d8d57f7ab8 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:53.250405 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae9cdb-675f-4990-b969-b4d8d57f7ab8 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:53.250405 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae9cdb-675f-4990-b969-b4d8d57f7ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:53.270392 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-9dae9cdb-675f-4990-b969-b4d8d57f7ab8 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:59:53.271644 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-9dae9cdb-675f-4990-b969-b4d8d57f7ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:53.334887 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1225/2421] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:59:53.343025 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cb4be-b9e0-428c-b715-1e991b63ae54 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:53.343317 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cb4be-b9e0-428c-b715-1e991b63ae54 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:53.343825 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cb4be-b9e0-428c-b715-1e991b63ae54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:53.363298 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-c09cb4be-b9e0-428c-b715-1e991b63ae54 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:59:53.364508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-c09cb4be-b9e0-428c-b715-1e991b63ae54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:53.372478 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1197/2422] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:59:53.376660 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae9cdb-675f-4990-b969-b4d8d57f7ab8 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:53.386329 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae9cdb-675f-4990-b969-b4d8d57f7ab8 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:53.390944 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650d420-5a54-4f5e-856a-79a4264d0591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:53.391589 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650d420-5a54-4f5e-856a-79a4264d0591 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:53.391870 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650d420-5a54-4f5e-856a-79a4264d0591 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:53.392147 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650d420-5a54-4f5e-856a-79a4264d0591 admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:53.393369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650d420-5a54-4f5e-856a-79a4264d0591 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 15:59:53.393671 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650d420-5a54-4f5e-856a-79a4264d0591 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:53.395308 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650d420-5a54-4f5e-856a-79a4264d0591 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:53.406641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1226/2423] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 15:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 15:59:53.411839 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cb4be-b9e0-428c-b715-1e991b63ae54 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:53.420984 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cb4be-b9e0-428c-b715-1e991b63ae54 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:53.425655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a7719-176f-41cc-a2da-39f8d0ff79d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:53.426340 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a7719-176f-41cc-a2da-39f8d0ff79d8 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:53.426627 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a7719-176f-41cc-a2da-39f8d0ff79d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:53.426906 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a7719-176f-41cc-a2da-39f8d0ff79d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:53.427594 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a7719-176f-41cc-a2da-39f8d0ff79d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:53.429474 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a7719-176f-41cc-a2da-39f8d0ff79d8 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:53.454655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1198/2424] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:59:53 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:59:53.464477 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650d420-5a54-4f5e-856a-79a4264d0591 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:53.475403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650d420-5a54-4f5e-856a-79a4264d0591 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:53.532437 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669a27e-961e-4564-9a1d-2bdd1686d33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:53.533099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669a27e-961e-4564-9a1d-2bdd1686d33e admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:53.533378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669a27e-961e-4564-9a1d-2bdd1686d33e admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:53.534281 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669a27e-961e-4564-9a1d-2bdd1686d33e admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:53.534970 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669a27e-961e-4564-9a1d-2bdd1686d33e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:53.536852 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669a27e-961e-4564-9a1d-2bdd1686d33e admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:53.556875 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1227/2425] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:59:53 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:59:53.561137 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a7719-176f-41cc-a2da-39f8d0ff79d8 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:53.571573 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a7719-176f-41cc-a2da-39f8d0ff79d8 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:53.576223 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e7136-936d-410f-8a7f-69cc42728872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:53.576877 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e7136-936d-410f-8a7f-69cc42728872 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:53.577163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e7136-936d-410f-8a7f-69cc42728872 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:53.577444 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e7136-936d-410f-8a7f-69cc42728872 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:53.578211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e7136-936d-410f-8a7f-69cc42728872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:53.579811 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e7136-936d-410f-8a7f-69cc42728872 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:53.593530 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1199/2426] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:59:53.598211 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669a27e-961e-4564-9a1d-2bdd1686d33e admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:53.608995 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669a27e-961e-4564-9a1d-2bdd1686d33e admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:53.613765 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410215f9-a594-4e70-ba24-6337cd77f418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:53.614463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410215f9-a594-4e70-ba24-6337cd77f418 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:53.614747 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410215f9-a594-4e70-ba24-6337cd77f418 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:53.615024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410215f9-a594-4e70-ba24-6337cd77f418 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:53.615761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410215f9-a594-4e70-ba24-6337cd77f418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:53.617356 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410215f9-a594-4e70-ba24-6337cd77f418 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:53.628973 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1228/2427] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:59:53.633131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e7136-936d-410f-8a7f-69cc42728872 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:53.644032 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e7136-936d-410f-8a7f-69cc42728872 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:53.648677 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25eb17-db25-4607-ad7d-77d423881c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:53.649542 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25eb17-db25-4607-ad7d-77d423881c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:53.649821 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25eb17-db25-4607-ad7d-77d423881c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:53.650130 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25eb17-db25-4607-ad7d-77d423881c0b admin admin] PATH_INFO: `/v3/projects/eeb304f3cd9d4682a9c1c25aa9354a08/users/7bf86c60763640c992932824f9b8db91/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:53.658220 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:59:53.667223 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25eb17-db25-4607-ad7d-77d423881c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb304f3cd9d4682a9c1c25aa9354a08, user_id=7bf86c60763640c992932824f9b8db91, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:53.670088 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25eb17-db25-4607-ad7d-77d423881c0b admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:53.682700 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1200/2428] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:59:53 2022] PUT /identity/v3/projects/eeb304f3cd9d4682a9c1c25aa9354a08/users/7bf86c60763640c992932824f9b8db91/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:59:53.694462 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1914ee0-a4f0-4393-ae0e-ad1c073477f3 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:53.694753 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1914ee0-a4f0-4393-ae0e-ad1c073477f3 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:53.695033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1914ee0-a4f0-4393-ae0e-ad1c073477f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:53.722386 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-f1914ee0-a4f0-4393-ae0e-ad1c073477f3 None None] MFA Rules not processed for user `7bf86c60763640c992932824f9b8db91`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:59:53.723607 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-f1914ee0-a4f0-4393-ae0e-ad1c073477f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:53.766576 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:59:53.788988 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1229/2429] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:59:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:59:53.793622 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25eb17-db25-4607-ad7d-77d423881c0b admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:53.853925 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25eb17-db25-4607-ad7d-77d423881c0b admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:53.858474 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6112215-f3a2-47e8-bff3-652a724c0f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:53.859123 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6112215-f3a2-47e8-bff3-652a724c0f06 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:53.859402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6112215-f3a2-47e8-bff3-652a724c0f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:53.859673 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6112215-f3a2-47e8-bff3-652a724c0f06 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:53.860345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6112215-f3a2-47e8-bff3-652a724c0f06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:53.862386 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6112215-f3a2-47e8-bff3-652a724c0f06 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:53.887301 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1201/2430] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 15:59:53 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:59:53.891486 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1914ee0-a4f0-4393-ae0e-ad1c073477f3 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:53.903246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1914ee0-a4f0-4393-ae0e-ad1c073477f3 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:53.960595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f086e-2e6a-4671-bd25-82a771cff792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:53.961284 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f086e-2e6a-4671-bd25-82a771cff792 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:53.961574 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f086e-2e6a-4671-bd25-82a771cff792 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:53.961901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f086e-2e6a-4671-bd25-82a771cff792 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:53.962590 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f086e-2e6a-4671-bd25-82a771cff792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:53.964508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f086e-2e6a-4671-bd25-82a771cff792 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:53.983625 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1230/2431] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 15:59:53 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 15:59:53.988174 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6112215-f3a2-47e8-bff3-652a724c0f06 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:53.998597 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6112215-f3a2-47e8-bff3-652a724c0f06 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:54.003810 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ec5a3-7b42-4198-81da-b2d053e5e85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:54.004467 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ec5a3-7b42-4198-81da-b2d053e5e85b admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:54.004777 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ec5a3-7b42-4198-81da-b2d053e5e85b admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:54.005058 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ec5a3-7b42-4198-81da-b2d053e5e85b admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:54.005785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ec5a3-7b42-4198-81da-b2d053e5e85b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:54.007406 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ec5a3-7b42-4198-81da-b2d053e5e85b admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:54.018362 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1202/2432] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:59:54.022516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f086e-2e6a-4671-bd25-82a771cff792 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:54.032654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f086e-2e6a-4671-bd25-82a771cff792 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:54.037367 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12926891-e47a-4c39-b0d4-801e1cdf01cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:54.038266 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12926891-e47a-4c39-b0d4-801e1cdf01cf admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:54.038550 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12926891-e47a-4c39-b0d4-801e1cdf01cf admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:54.038824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12926891-e47a-4c39-b0d4-801e1cdf01cf admin admin] PATH_INFO: `/v3/projects/037b679eb05b4ea9b3b60a2d8b585c7d/users/ae882355f51a422aa1627be82ffe759c/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:54.053704 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12926891-e47a-4c39-b0d4-801e1cdf01cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=037b679eb05b4ea9b3b60a2d8b585c7d, user_id=ae882355f51a422aa1627be82ffe759c, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:54.056366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12926891-e47a-4c39-b0d4-801e1cdf01cf admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:54.070082 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1231/2433] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:59:54 2022] PUT /identity/v3/projects/037b679eb05b4ea9b3b60a2d8b585c7d/users/ae882355f51a422aa1627be82ffe759c/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 15:59:54.074018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ec5a3-7b42-4198-81da-b2d053e5e85b admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:54.084072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ec5a3-7b42-4198-81da-b2d053e5e85b admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:54.140580 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012b998-ff36-40ed-a2cb-f8e251e7d8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:54.141161 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012b998-ff36-40ed-a2cb-f8e251e7d8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:54.141443 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012b998-ff36-40ed-a2cb-f8e251e7d8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:54.141721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012b998-ff36-40ed-a2cb-f8e251e7d8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:54.142484 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012b998-ff36-40ed-a2cb-f8e251e7d8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:54.144092 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012b998-ff36-40ed-a2cb-f8e251e7d8e1 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:54.153656 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1203/2434] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 15:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 15:59:54.158138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12926891-e47a-4c39-b0d4-801e1cdf01cf admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:54.168122 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12926891-e47a-4c39-b0d4-801e1cdf01cf admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:54.172638 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9886d35-616a-4363-b5cf-6c0523f9261d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:54.173506 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9886d35-616a-4363-b5cf-6c0523f9261d admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:54.173789 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9886d35-616a-4363-b5cf-6c0523f9261d admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:54.174823 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9886d35-616a-4363-b5cf-6c0523f9261d admin admin] PATH_INFO: `/v3/projects/037b679eb05b4ea9b3b60a2d8b585c7d/users/ae882355f51a422aa1627be82ffe759c/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:54.176976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9886d35-616a-4363-b5cf-6c0523f9261d admin admin] RBAC: Authorizing `identity:create_grant(project_id=037b679eb05b4ea9b3b60a2d8b585c7d, user_id=ae882355f51a422aa1627be82ffe759c, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:54.179767 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9886d35-616a-4363-b5cf-6c0523f9261d admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:54.189644 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1232/2435] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 15:59:54 2022] PUT /identity/v3/projects/037b679eb05b4ea9b3b60a2d8b585c7d/users/ae882355f51a422aa1627be82ffe759c/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 15:59:54.199605 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5b2c2-7ee3-40ff-ae8c-d760dc3dc34a None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:54.199902 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5b2c2-7ee3-40ff-ae8c-d760dc3dc34a None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:54.200191 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5b2c2-7ee3-40ff-ae8c-d760dc3dc34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:54.229598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-78a5b2c2-7ee3-40ff-ae8c-d760dc3dc34a None None] MFA Rules not processed for user `ae882355f51a422aa1627be82ffe759c`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 15:59:54.231699 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-78a5b2c2-7ee3-40ff-ae8c-d760dc3dc34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:54.275973 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:59:54.300622 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1204/2436] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 15:59:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 15:59:54.312115 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9886d35-616a-4363-b5cf-6c0523f9261d admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:54.314185 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-f9886d35-616a-4363-b5cf-6c0523f9261d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 15:59:54.372095 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9886d35-616a-4363-b5cf-6c0523f9261d admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:54.376240 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31a929-75de-4331-8ca9-5a3b0f5400e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:54.376889 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31a929-75de-4331-8ca9-5a3b0f5400e7 service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:54.377677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31a929-75de-4331-8ca9-5a3b0f5400e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:54.378005 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31a929-75de-4331-8ca9-5a3b0f5400e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:54.388096 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31a929-75de-4331-8ca9-5a3b0f5400e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:54.389539 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31a929-75de-4331-8ca9-5a3b0f5400e7 service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:54.400330 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1233/2437] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:59:54 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 15:59:54.472832 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5b2c2-7ee3-40ff-ae8c-d760dc3dc34a None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 15:59:54.482652 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5b2c2-7ee3-40ff-ae8c-d760dc3dc34a None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 15:59:54.486651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b8095-8b67-4808-b6ae-cb77b1582b64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 15:59:54.487302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b8095-8b67-4808-b6ae-cb77b1582b64 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 15:59:54.487585 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b8095-8b67-4808-b6ae-cb77b1582b64 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 15:59:54.487863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b8095-8b67-4808-b6ae-cb77b1582b64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 15:59:54.550234 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b8095-8b67-4808-b6ae-cb77b1582b64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 15:59:54.551813 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b8095-8b67-4808-b6ae-cb77b1582b64 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 15:59:54.561122 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1205/2438] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 15:59:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:00:01.526006 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31a929-75de-4331-8ca9-5a3b0f5400e7 service cinder] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:01.569197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:01.590540 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31a929-75de-4331-8ca9-5a3b0f5400e7 service cinder] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:01.595063 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b560c1b-da04-4f13-9f15-6c66591231f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:01.595936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b560c1b-da04-4f13-9f15-6c66591231f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:01.596267 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b560c1b-da04-4f13-9f15-6c66591231f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:01.597087 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b560c1b-da04-4f13-9f15-6c66591231f2 admin admin] PATH_INFO: `/v3/users/7bf86c60763640c992932824f9b8db91` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:01.598350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b560c1b-da04-4f13-9f15-6c66591231f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bf86c60763640c992932824f9b8db91)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:01.600229 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b560c1b-da04-4f13-9f15-6c66591231f2 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:01.647197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6b560c1b-da04-4f13-9f15-6c66591231f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bf86c60763640c992932824f9b8db91'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:01.653976 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6b560c1b-da04-4f13-9f15-6c66591231f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bf86c60763640c992932824f9b8db91'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:01.654641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6b560c1b-da04-4f13-9f15-6c66591231f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bf86c60763640c992932824f9b8db91'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:01.655238 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6b560c1b-da04-4f13-9f15-6c66591231f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bf86c60763640c992932824f9b8db91'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:01.667849 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6b560c1b-da04-4f13-9f15-6c66591231f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bf86c60763640c992932824f9b8db91'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:01.681905 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1234/2439] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:00:01 2022] DELETE /identity/v3/users/7bf86c60763640c992932824f9b8db91 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:01.686382 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d89a3c-e723-4cb7-affb-0b81dad714e8 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:01.686820 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d89a3c-e723-4cb7-affb-0b81dad714e8 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:01.686915 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d89a3c-e723-4cb7-affb-0b81dad714e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:01.704383 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-e3d89a3c-e723-4cb7-affb-0b81dad714e8 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:01.706124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-e3d89a3c-e723-4cb7-affb-0b81dad714e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:01.775867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1206/2440] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:01.789180 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b560c1b-da04-4f13-9f15-6c66591231f2 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:01.790729 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-6b560c1b-da04-4f13-9f15-6c66591231f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:01.851936 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b560c1b-da04-4f13-9f15-6c66591231f2 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:01.856846 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74284b9b-8530-4f48-a772-68b3455f6781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:01.857506 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74284b9b-8530-4f48-a772-68b3455f6781 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:01.857825 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74284b9b-8530-4f48-a772-68b3455f6781 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:01.858153 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74284b9b-8530-4f48-a772-68b3455f6781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:01.868150 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74284b9b-8530-4f48-a772-68b3455f6781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:01.869582 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74284b9b-8530-4f48-a772-68b3455f6781 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:01.879707 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1235/2441] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:00:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:00:02.169318 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d89a3c-e723-4cb7-affb-0b81dad714e8 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:02.170891 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-e3d89a3c-e723-4cb7-affb-0b81dad714e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:02.183686 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d89a3c-e723-4cb7-affb-0b81dad714e8 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:02.188732 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c15ca6-ce2c-4bcf-9daf-e6e9f168599b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:02.190650 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c15ca6-ce2c-4bcf-9daf-e6e9f168599b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:02.191206 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c15ca6-ce2c-4bcf-9daf-e6e9f168599b admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:02.191487 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c15ca6-ce2c-4bcf-9daf-e6e9f168599b admin admin] PATH_INFO: `/v3/projects/eeb304f3cd9d4682a9c1c25aa9354a08` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:02.192744 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c15ca6-ce2c-4bcf-9daf-e6e9f168599b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeb304f3cd9d4682a9c1c25aa9354a08)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:02.194704 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c15ca6-ce2c-4bcf-9daf-e6e9f168599b admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:02.243047 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-80c15ca6-ce2c-4bcf-9daf-e6e9f168599b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeb304f3cd9d4682a9c1c25aa9354a08', 'request_id': 'req-80c15ca6-ce2c-4bcf-9daf-e6e9f168599b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:02.250746 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-80c15ca6-ce2c-4bcf-9daf-e6e9f168599b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeb304f3cd9d4682a9c1c25aa9354a08', 'request_id': 'req-80c15ca6-ce2c-4bcf-9daf-e6e9f168599b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:02.257839 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-80c15ca6-ce2c-4bcf-9daf-e6e9f168599b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeb304f3cd9d4682a9c1c25aa9354a08', 'request_id': 'req-80c15ca6-ce2c-4bcf-9daf-e6e9f168599b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:02.268122 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-80c15ca6-ce2c-4bcf-9daf-e6e9f168599b admin admin] The token cache is being invalidate because project eeb304f3cd9d4682a9c1c25aa9354a08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:00:02.268411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-80c15ca6-ce2c-4bcf-9daf-e6e9f168599b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:02.269059 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-80c15ca6-ce2c-4bcf-9daf-e6e9f168599b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:02.270625 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1207/2442] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:00:02 2022] DELETE /identity/v3/projects/eeb304f3cd9d4682a9c1c25aa9354a08 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:02.274668 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74284b9b-8530-4f48-a772-68b3455f6781 service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:02.284859 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74284b9b-8530-4f48-a772-68b3455f6781 service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:02.342125 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58b378-54aa-4dca-9f43-0149e47d265b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:02.342999 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58b378-54aa-4dca-9f43-0149e47d265b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:02.343284 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58b378-54aa-4dca-9f43-0149e47d265b admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:02.343556 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58b378-54aa-4dca-9f43-0149e47d265b admin admin] PATH_INFO: `/v3/users/ae882355f51a422aa1627be82ffe759c` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:02.344749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58b378-54aa-4dca-9f43-0149e47d265b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae882355f51a422aa1627be82ffe759c)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:02.346824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58b378-54aa-4dca-9f43-0149e47d265b admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:02.349318 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:02.396597 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-cb58b378-54aa-4dca-9f43-0149e47d265b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae882355f51a422aa1627be82ffe759c'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:02.403491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-cb58b378-54aa-4dca-9f43-0149e47d265b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae882355f51a422aa1627be82ffe759c'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:02.404187 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-cb58b378-54aa-4dca-9f43-0149e47d265b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae882355f51a422aa1627be82ffe759c'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:02.404796 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-cb58b378-54aa-4dca-9f43-0149e47d265b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae882355f51a422aa1627be82ffe759c'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:02.417124 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-cb58b378-54aa-4dca-9f43-0149e47d265b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae882355f51a422aa1627be82ffe759c'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:02.430846 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1236/2443] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:00:02 2022] DELETE /identity/v3/users/ae882355f51a422aa1627be82ffe759c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:02.705254 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c15ca6-ce2c-4bcf-9daf-e6e9f168599b admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:02.707358 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-80c15ca6-ce2c-4bcf-9daf-e6e9f168599b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:02.717523 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:02.721776 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c15ca6-ce2c-4bcf-9daf-e6e9f168599b admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:02.786935 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204191d1-d7c2-4a02-a3c7-342d19edcce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:02.787800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204191d1-d7c2-4a02-a3c7-342d19edcce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:02.788080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204191d1-d7c2-4a02-a3c7-342d19edcce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:02.788356 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204191d1-d7c2-4a02-a3c7-342d19edcce9 admin admin] PATH_INFO: `/v3/projects/037b679eb05b4ea9b3b60a2d8b585c7d` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:02.789626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204191d1-d7c2-4a02-a3c7-342d19edcce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=037b679eb05b4ea9b3b60a2d8b585c7d)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:02.791470 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204191d1-d7c2-4a02-a3c7-342d19edcce9 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:02.845520 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-204191d1-d7c2-4a02-a3c7-342d19edcce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '037b679eb05b4ea9b3b60a2d8b585c7d', 'request_id': 'req-204191d1-d7c2-4a02-a3c7-342d19edcce9'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:02.855071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-204191d1-d7c2-4a02-a3c7-342d19edcce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '037b679eb05b4ea9b3b60a2d8b585c7d', 'request_id': 'req-204191d1-d7c2-4a02-a3c7-342d19edcce9'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:02.862859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-204191d1-d7c2-4a02-a3c7-342d19edcce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '037b679eb05b4ea9b3b60a2d8b585c7d', 'request_id': 'req-204191d1-d7c2-4a02-a3c7-342d19edcce9'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:02.873941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-204191d1-d7c2-4a02-a3c7-342d19edcce9 admin admin] The token cache is being invalidate because project 037b679eb05b4ea9b3b60a2d8b585c7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:00:02.874238 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-204191d1-d7c2-4a02-a3c7-342d19edcce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:02.874949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-204191d1-d7c2-4a02-a3c7-342d19edcce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:02.876527 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1208/2444] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:00:02 2022] DELETE /identity/v3/projects/037b679eb05b4ea9b3b60a2d8b585c7d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:02.881764 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e99ce-bbd0-414b-a6c8-e1facd1ceafa None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:02.882347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e99ce-bbd0-414b-a6c8-e1facd1ceafa None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:02.882347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e99ce-bbd0-414b-a6c8-e1facd1ceafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:02.900111 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-9e6e99ce-bbd0-414b-a6c8-e1facd1ceafa None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:02.901350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-9e6e99ce-bbd0-414b-a6c8-e1facd1ceafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:02.966446 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1237/2445] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:02.975789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218c23d-37ae-49c7-9a68-291c20b9887d None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:02.976080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218c23d-37ae-49c7-9a68-291c20b9887d None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:02.977162 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218c23d-37ae-49c7-9a68-291c20b9887d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:02.995164 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-a218c23d-37ae-49c7-9a68-291c20b9887d None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:02.996385 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-a218c23d-37ae-49c7-9a68-291c20b9887d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:03.004553 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1209/2446] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:03.008863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e99ce-bbd0-414b-a6c8-e1facd1ceafa None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:03.019305 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e99ce-bbd0-414b-a6c8-e1facd1ceafa None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:03.024172 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c4d69-208f-4a93-b9e7-ac57c0492eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:03.024834 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c4d69-208f-4a93-b9e7-ac57c0492eba admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:03.025121 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c4d69-208f-4a93-b9e7-ac57c0492eba admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:03.025404 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c4d69-208f-4a93-b9e7-ac57c0492eba admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:03.026186 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c4d69-208f-4a93-b9e7-ac57c0492eba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:00:03.026504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c4d69-208f-4a93-b9e7-ac57c0492eba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:03.028106 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c4d69-208f-4a93-b9e7-ac57c0492eba admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:03.041090 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1238/2447] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 16:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:00:03.045418 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218c23d-37ae-49c7-9a68-291c20b9887d None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:03.055123 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218c23d-37ae-49c7-9a68-291c20b9887d None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:03.059843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6990719-dd5e-41c1-9ce9-026e98bd5a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:03.060494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6990719-dd5e-41c1-9ce9-026e98bd5a59 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:03.060776 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6990719-dd5e-41c1-9ce9-026e98bd5a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:03.061051 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6990719-dd5e-41c1-9ce9-026e98bd5a59 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:03.061776 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6990719-dd5e-41c1-9ce9-026e98bd5a59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:03.063686 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6990719-dd5e-41c1-9ce9-026e98bd5a59 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:03.089198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1210/2448] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:00:03 2022] POST /identity/v3/projects => generated 401 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:03.093322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c4d69-208f-4a93-b9e7-ac57c0492eba admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:03.104130 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c4d69-208f-4a93-b9e7-ac57c0492eba admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:03.161362 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebacfe-27e7-4011-9fcd-a574d6aeb655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:03.162055 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebacfe-27e7-4011-9fcd-a574d6aeb655 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:03.162333 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebacfe-27e7-4011-9fcd-a574d6aeb655 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:03.162637 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebacfe-27e7-4011-9fcd-a574d6aeb655 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:03.163297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aebacfe-27e7-4011-9fcd-a574d6aeb655 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:03.165279 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aebacfe-27e7-4011-9fcd-a574d6aeb655 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:03.179679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:03.186537 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1239/2449] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:00:03 2022] POST /identity/v3/users => generated 301 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:03.190756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6990719-dd5e-41c1-9ce9-026e98bd5a59 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:03.201127 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6990719-dd5e-41c1-9ce9-026e98bd5a59 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:03.206304 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530d8b9-99ae-48c3-bb11-cbd7d33605fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:03.207000 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530d8b9-99ae-48c3-bb11-cbd7d33605fa admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:03.207243 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530d8b9-99ae-48c3-bb11-cbd7d33605fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:03.207740 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530d8b9-99ae-48c3-bb11-cbd7d33605fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:03.208478 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530d8b9-99ae-48c3-bb11-cbd7d33605fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:03.210080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530d8b9-99ae-48c3-bb11-cbd7d33605fa admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:03.220670 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1211/2450] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:00:03.225247 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebacfe-27e7-4011-9fcd-a574d6aeb655 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:03.235405 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebacfe-27e7-4011-9fcd-a574d6aeb655 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:03.241084 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16686240-c80e-45ce-9603-3e30f284b718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:03.241749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16686240-c80e-45ce-9603-3e30f284b718 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:03.242064 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16686240-c80e-45ce-9603-3e30f284b718 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:03.242347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16686240-c80e-45ce-9603-3e30f284b718 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:03.243079 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16686240-c80e-45ce-9603-3e30f284b718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:03.244702 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16686240-c80e-45ce-9603-3e30f284b718 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:03.255379 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1240/2451] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:00:03.259802 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530d8b9-99ae-48c3-bb11-cbd7d33605fa admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:03.270528 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530d8b9-99ae-48c3-bb11-cbd7d33605fa admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:03.275577 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72094f60-863c-4170-88ae-a30f30293556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:03.276463 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72094f60-863c-4170-88ae-a30f30293556 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:03.276750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72094f60-863c-4170-88ae-a30f30293556 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:03.277056 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72094f60-863c-4170-88ae-a30f30293556 admin admin] PATH_INFO: `/v3/projects/a37b93ce7e0142259369e02efc40f93f/users/c24af5950c77460b837b12941e342561/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:03.293713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72094f60-863c-4170-88ae-a30f30293556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a37b93ce7e0142259369e02efc40f93f, user_id=c24af5950c77460b837b12941e342561, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:03.296404 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72094f60-863c-4170-88ae-a30f30293556 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:03.309288 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1212/2452] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:00:03 2022] PUT /identity/v3/projects/a37b93ce7e0142259369e02efc40f93f/users/c24af5950c77460b837b12941e342561/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:03.320941 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de90f3-e54d-4d8f-b573-c76d99182b03 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:03.321235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de90f3-e54d-4d8f-b573-c76d99182b03 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:03.321519 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de90f3-e54d-4d8f-b573-c76d99182b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:03.347975 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-95de90f3-e54d-4d8f-b573-c76d99182b03 None None] MFA Rules not processed for user `c24af5950c77460b837b12941e342561`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:03.349175 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-95de90f3-e54d-4d8f-b573-c76d99182b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:03.414989 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1241/2453] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:03.419433 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72094f60-863c-4170-88ae-a30f30293556 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:03.452784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:03.483494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72094f60-863c-4170-88ae-a30f30293556 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:03.488199 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245d7a9-6d71-4afb-8189-401bb4723d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:03.488859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245d7a9-6d71-4afb-8189-401bb4723d7d admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:03.489142 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245d7a9-6d71-4afb-8189-401bb4723d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:03.489419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245d7a9-6d71-4afb-8189-401bb4723d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:03.490139 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245d7a9-6d71-4afb-8189-401bb4723d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:03.492034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245d7a9-6d71-4afb-8189-401bb4723d7d admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:03.518163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1213/2454] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:00:03 2022] POST /identity/v3/projects => generated 401 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:03.522793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de90f3-e54d-4d8f-b573-c76d99182b03 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:03.533794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de90f3-e54d-4d8f-b573-c76d99182b03 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:03.592228 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8746c21-62d6-4284-be9e-34b7aef5a750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:03.592892 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8746c21-62d6-4284-be9e-34b7aef5a750 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:03.593170 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8746c21-62d6-4284-be9e-34b7aef5a750 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:03.593442 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8746c21-62d6-4284-be9e-34b7aef5a750 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:03.594181 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8746c21-62d6-4284-be9e-34b7aef5a750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:03.596084 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8746c21-62d6-4284-be9e-34b7aef5a750 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:03.616821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1242/2455] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:00:03 2022] POST /identity/v3/users => generated 307 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:03.620880 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245d7a9-6d71-4afb-8189-401bb4723d7d admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:03.631921 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245d7a9-6d71-4afb-8189-401bb4723d7d admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:03.636637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727bea9-dd42-4026-8b46-92de95a21567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:03.637304 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727bea9-dd42-4026-8b46-92de95a21567 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:03.637590 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727bea9-dd42-4026-8b46-92de95a21567 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:03.637916 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727bea9-dd42-4026-8b46-92de95a21567 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:03.638715 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727bea9-dd42-4026-8b46-92de95a21567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:03.640311 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727bea9-dd42-4026-8b46-92de95a21567 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:03.653138 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1214/2456] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:00:03.659577 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8746c21-62d6-4284-be9e-34b7aef5a750 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:03.670220 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8746c21-62d6-4284-be9e-34b7aef5a750 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:03.674784 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b4ea2-cf49-4e7a-b340-36bd03f9e4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:03.675661 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b4ea2-cf49-4e7a-b340-36bd03f9e4cd admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:03.675943 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b4ea2-cf49-4e7a-b340-36bd03f9e4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:03.676215 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b4ea2-cf49-4e7a-b340-36bd03f9e4cd admin admin] PATH_INFO: `/v3/projects/725ed2c2c55a4eecaa69f7a35b22bbd2/users/ce942c41b8ff45b3a7dc29fdc7379a57/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:03.691397 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b4ea2-cf49-4e7a-b340-36bd03f9e4cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=725ed2c2c55a4eecaa69f7a35b22bbd2, user_id=ce942c41b8ff45b3a7dc29fdc7379a57, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:03.694063 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b4ea2-cf49-4e7a-b340-36bd03f9e4cd admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:03.707611 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1243/2457] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:00:03 2022] PUT /identity/v3/projects/725ed2c2c55a4eecaa69f7a35b22bbd2/users/ce942c41b8ff45b3a7dc29fdc7379a57/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:03.711633 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727bea9-dd42-4026-8b46-92de95a21567 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:03.721544 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727bea9-dd42-4026-8b46-92de95a21567 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:03.777448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98ab10-9f3a-47ee-9bf0-40f9847cb7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:03.778174 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98ab10-9f3a-47ee-9bf0-40f9847cb7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:03.778568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98ab10-9f3a-47ee-9bf0-40f9847cb7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:03.778858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98ab10-9f3a-47ee-9bf0-40f9847cb7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:03.779600 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98ab10-9f3a-47ee-9bf0-40f9847cb7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:03.781302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98ab10-9f3a-47ee-9bf0-40f9847cb7b3 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:03.791982 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1215/2458] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:00:03.796295 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b4ea2-cf49-4e7a-b340-36bd03f9e4cd admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:03.807449 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b4ea2-cf49-4e7a-b340-36bd03f9e4cd admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:03.812257 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18109e49-f6df-433b-858a-aafb16fa8c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:03.813151 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18109e49-f6df-433b-858a-aafb16fa8c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:03.813443 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18109e49-f6df-433b-858a-aafb16fa8c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:03.813722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18109e49-f6df-433b-858a-aafb16fa8c1a admin admin] PATH_INFO: `/v3/projects/725ed2c2c55a4eecaa69f7a35b22bbd2/users/ce942c41b8ff45b3a7dc29fdc7379a57/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:03.816516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18109e49-f6df-433b-858a-aafb16fa8c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=725ed2c2c55a4eecaa69f7a35b22bbd2, user_id=ce942c41b8ff45b3a7dc29fdc7379a57, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:03.819983 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18109e49-f6df-433b-858a-aafb16fa8c1a admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:03.830914 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1244/2459] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:00:03 2022] PUT /identity/v3/projects/725ed2c2c55a4eecaa69f7a35b22bbd2/users/ce942c41b8ff45b3a7dc29fdc7379a57/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:03.841494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f456ce4-70a3-432a-84e8-56590465e05b None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:03.841842 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f456ce4-70a3-432a-84e8-56590465e05b None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:03.842236 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f456ce4-70a3-432a-84e8-56590465e05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:03.869882 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-9f456ce4-70a3-432a-84e8-56590465e05b None None] MFA Rules not processed for user `ce942c41b8ff45b3a7dc29fdc7379a57`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:03.871115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-9f456ce4-70a3-432a-84e8-56590465e05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:03.950299 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1216/2460] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:03 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:03.961582 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18109e49-f6df-433b-858a-aafb16fa8c1a admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:03.963486 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-18109e49-f6df-433b-858a-aafb16fa8c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:03.995823 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:04.023560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18109e49-f6df-433b-858a-aafb16fa8c1a admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:04.028268 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2883878-12f6-42de-8a2a-10608e0b545a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:04.028268 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2883878-12f6-42de-8a2a-10608e0b545a service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:04.028268 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2883878-12f6-42de-8a2a-10608e0b545a service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:04.028757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2883878-12f6-42de-8a2a-10608e0b545a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:04.038047 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2883878-12f6-42de-8a2a-10608e0b545a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:04.039483 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2883878-12f6-42de-8a2a-10608e0b545a service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:04.052742 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1245/2461] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:00:03 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:00:04.124771 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f456ce4-70a3-432a-84e8-56590465e05b None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:04.134915 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f456ce4-70a3-432a-84e8-56590465e05b None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:04.138572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa779e1-1356-4f27-922e-32790b0ba0de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:04.139225 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa779e1-1356-4f27-922e-32790b0ba0de service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:04.139506 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa779e1-1356-4f27-922e-32790b0ba0de service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:04.139783 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa779e1-1356-4f27-922e-32790b0ba0de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:04.165934 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:04.199307 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa779e1-1356-4f27-922e-32790b0ba0de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:04.200817 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa779e1-1356-4f27-922e-32790b0ba0de service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:04.210142 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1217/2462] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:00:04 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:00:08.573047 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2883878-12f6-42de-8a2a-10608e0b545a service cinder] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:08.637122 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2883878-12f6-42de-8a2a-10608e0b545a service cinder] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:08.641677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660f7dc-6d23-494f-9ae1-952f9b8f452a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:08.642573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660f7dc-6d23-494f-9ae1-952f9b8f452a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:08.642880 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660f7dc-6d23-494f-9ae1-952f9b8f452a admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:08.643750 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660f7dc-6d23-494f-9ae1-952f9b8f452a admin admin] PATH_INFO: `/v3/users/c24af5950c77460b837b12941e342561` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:08.644964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660f7dc-6d23-494f-9ae1-952f9b8f452a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c24af5950c77460b837b12941e342561)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:08.646921 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660f7dc-6d23-494f-9ae1-952f9b8f452a admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:08.694614 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6660f7dc-6d23-494f-9ae1-952f9b8f452a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c24af5950c77460b837b12941e342561'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:08.701507 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6660f7dc-6d23-494f-9ae1-952f9b8f452a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c24af5950c77460b837b12941e342561'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:08.702201 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6660f7dc-6d23-494f-9ae1-952f9b8f452a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c24af5950c77460b837b12941e342561'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:08.702805 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6660f7dc-6d23-494f-9ae1-952f9b8f452a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c24af5950c77460b837b12941e342561'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:08.715054 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6660f7dc-6d23-494f-9ae1-952f9b8f452a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c24af5950c77460b837b12941e342561'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:08.727293 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1246/2463] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:00:08 2022] DELETE /identity/v3/users/c24af5950c77460b837b12941e342561 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:08.731805 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945874ae-dd08-4571-b755-9d82c8ba1de0 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:08.732276 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945874ae-dd08-4571-b755-9d82c8ba1de0 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:08.732372 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945874ae-dd08-4571-b755-9d82c8ba1de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:08.750707 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-945874ae-dd08-4571-b755-9d82c8ba1de0 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:08.752103 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-945874ae-dd08-4571-b755-9d82c8ba1de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:08.816040 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1218/2464] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:08.827002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660f7dc-6d23-494f-9ae1-952f9b8f452a admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:08.828416 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-6660f7dc-6d23-494f-9ae1-952f9b8f452a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:08.885918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660f7dc-6d23-494f-9ae1-952f9b8f452a admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:08.889530 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d69566-68b1-402c-bb11-99ec04552874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:08.890150 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d69566-68b1-402c-bb11-99ec04552874 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:08.890427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d69566-68b1-402c-bb11-99ec04552874 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:08.890703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d69566-68b1-402c-bb11-99ec04552874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:08.897411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:08.902416 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d69566-68b1-402c-bb11-99ec04552874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:08.903948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d69566-68b1-402c-bb11-99ec04552874 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:08.915297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1247/2465] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:00:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 16:00:09.184995 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945874ae-dd08-4571-b755-9d82c8ba1de0 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:09.186556 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-945874ae-dd08-4571-b755-9d82c8ba1de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:09.199267 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945874ae-dd08-4571-b755-9d82c8ba1de0 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:09.203989 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ca2cc-e738-48e2-b4ba-551bb650639d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:09.204844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ca2cc-e738-48e2-b4ba-551bb650639d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:09.205133 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ca2cc-e738-48e2-b4ba-551bb650639d admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:09.205447 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ca2cc-e738-48e2-b4ba-551bb650639d admin admin] PATH_INFO: `/v3/projects/a37b93ce7e0142259369e02efc40f93f` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:09.206685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ca2cc-e738-48e2-b4ba-551bb650639d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a37b93ce7e0142259369e02efc40f93f)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:09.208587 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ca2cc-e738-48e2-b4ba-551bb650639d admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:09.257961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-f97ca2cc-e738-48e2-b4ba-551bb650639d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a37b93ce7e0142259369e02efc40f93f', 'request_id': 'req-f97ca2cc-e738-48e2-b4ba-551bb650639d'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:09.265433 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-f97ca2cc-e738-48e2-b4ba-551bb650639d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a37b93ce7e0142259369e02efc40f93f', 'request_id': 'req-f97ca2cc-e738-48e2-b4ba-551bb650639d'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:09.271779 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-f97ca2cc-e738-48e2-b4ba-551bb650639d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a37b93ce7e0142259369e02efc40f93f', 'request_id': 'req-f97ca2cc-e738-48e2-b4ba-551bb650639d'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:09.283003 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-f97ca2cc-e738-48e2-b4ba-551bb650639d admin admin] The token cache is being invalidate because project a37b93ce7e0142259369e02efc40f93f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:00:09.283290 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-f97ca2cc-e738-48e2-b4ba-551bb650639d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:09.283966 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-f97ca2cc-e738-48e2-b4ba-551bb650639d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:09.285517 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1219/2466] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:00:09 2022] DELETE /identity/v3/projects/a37b93ce7e0142259369e02efc40f93f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:09.289444 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d69566-68b1-402c-bb11-99ec04552874 service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:09.298958 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d69566-68b1-402c-bb11-99ec04552874 service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:09.370105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43904d-b861-4873-b699-a55f71d31f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:09.370983 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43904d-b861-4873-b699-a55f71d31f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:09.371268 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43904d-b861-4873-b699-a55f71d31f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:09.371546 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43904d-b861-4873-b699-a55f71d31f32 admin admin] PATH_INFO: `/v3/users/ce942c41b8ff45b3a7dc29fdc7379a57` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:09.372744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43904d-b861-4873-b699-a55f71d31f32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce942c41b8ff45b3a7dc29fdc7379a57)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:09.374691 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43904d-b861-4873-b699-a55f71d31f32 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:09.421025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6e43904d-b861-4873-b699-a55f71d31f32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce942c41b8ff45b3a7dc29fdc7379a57'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:09.428567 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6e43904d-b861-4873-b699-a55f71d31f32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce942c41b8ff45b3a7dc29fdc7379a57'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:09.429184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6e43904d-b861-4873-b699-a55f71d31f32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce942c41b8ff45b3a7dc29fdc7379a57'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:09.430216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6e43904d-b861-4873-b699-a55f71d31f32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce942c41b8ff45b3a7dc29fdc7379a57'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:09.441841 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6e43904d-b861-4873-b699-a55f71d31f32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce942c41b8ff45b3a7dc29fdc7379a57'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:09.454512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1248/2467] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:00:09 2022] DELETE /identity/v3/users/ce942c41b8ff45b3a7dc29fdc7379a57 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:09.749662 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ca2cc-e738-48e2-b4ba-551bb650639d admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:09.751161 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-f97ca2cc-e738-48e2-b4ba-551bb650639d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:09.765083 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ca2cc-e738-48e2-b4ba-551bb650639d admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:09.813066 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:09.827626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92552d75-68ea-4ebb-908e-959c152fbd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:09.828490 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92552d75-68ea-4ebb-908e-959c152fbd0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:09.828771 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92552d75-68ea-4ebb-908e-959c152fbd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:09.829046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92552d75-68ea-4ebb-908e-959c152fbd0f admin admin] PATH_INFO: `/v3/projects/725ed2c2c55a4eecaa69f7a35b22bbd2` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:09.830265 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92552d75-68ea-4ebb-908e-959c152fbd0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=725ed2c2c55a4eecaa69f7a35b22bbd2)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:09.832688 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92552d75-68ea-4ebb-908e-959c152fbd0f admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:09.878440 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-92552d75-68ea-4ebb-908e-959c152fbd0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '725ed2c2c55a4eecaa69f7a35b22bbd2', 'request_id': 'req-92552d75-68ea-4ebb-908e-959c152fbd0f'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:09.885849 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-92552d75-68ea-4ebb-908e-959c152fbd0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '725ed2c2c55a4eecaa69f7a35b22bbd2', 'request_id': 'req-92552d75-68ea-4ebb-908e-959c152fbd0f'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:09.893380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-92552d75-68ea-4ebb-908e-959c152fbd0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '725ed2c2c55a4eecaa69f7a35b22bbd2', 'request_id': 'req-92552d75-68ea-4ebb-908e-959c152fbd0f'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:09.903676 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-92552d75-68ea-4ebb-908e-959c152fbd0f admin admin] The token cache is being invalidate because project 725ed2c2c55a4eecaa69f7a35b22bbd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:00:09.903967 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-92552d75-68ea-4ebb-908e-959c152fbd0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:09.904614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-92552d75-68ea-4ebb-908e-959c152fbd0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:09.906189 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1220/2468] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:00:09 2022] DELETE /identity/v3/projects/725ed2c2c55a4eecaa69f7a35b22bbd2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:09.912144 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61c4c1-39a2-4bc3-808c-2e3660fe3c2e None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:09.912638 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61c4c1-39a2-4bc3-808c-2e3660fe3c2e None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:09.912741 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61c4c1-39a2-4bc3-808c-2e3660fe3c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:09.930222 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-7d61c4c1-39a2-4bc3-808c-2e3660fe3c2e None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:09.931481 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-7d61c4c1-39a2-4bc3-808c-2e3660fe3c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:09.993995 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1249/2469] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:10.002139 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f78c3-492a-4319-9955-11ea83dab00a None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:10.002470 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f78c3-492a-4319-9955-11ea83dab00a None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:10.002755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f78c3-492a-4319-9955-11ea83dab00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:10.021322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-614f78c3-492a-4319-9955-11ea83dab00a None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:10.022563 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-614f78c3-492a-4319-9955-11ea83dab00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:10.030521 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1221/2470] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:10.035664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61c4c1-39a2-4bc3-808c-2e3660fe3c2e None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:10.045389 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61c4c1-39a2-4bc3-808c-2e3660fe3c2e None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:10.050050 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29884701-06c3-4e2f-a99f-45463a4aa278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:10.050703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29884701-06c3-4e2f-a99f-45463a4aa278 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:10.050982 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29884701-06c3-4e2f-a99f-45463a4aa278 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:10.051257 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29884701-06c3-4e2f-a99f-45463a4aa278 admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:10.052034 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29884701-06c3-4e2f-a99f-45463a4aa278 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:00:10.052340 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29884701-06c3-4e2f-a99f-45463a4aa278 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:10.053949 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29884701-06c3-4e2f-a99f-45463a4aa278 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:10.062469 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:10.066555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1250/2471] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 16:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:00:10.070824 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f78c3-492a-4319-9955-11ea83dab00a None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:10.081147 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f78c3-492a-4319-9955-11ea83dab00a None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:10.086111 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719f44f-5428-44cc-a01d-82d8bfb05222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:10.086794 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719f44f-5428-44cc-a01d-82d8bfb05222 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:10.087081 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719f44f-5428-44cc-a01d-82d8bfb05222 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:10.087363 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d719f44f-5428-44cc-a01d-82d8bfb05222 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:10.088059 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719f44f-5428-44cc-a01d-82d8bfb05222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:10.090008 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d719f44f-5428-44cc-a01d-82d8bfb05222 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:10.118156 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1222/2472] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:00:10 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:10.119334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29884701-06c3-4e2f-a99f-45463a4aa278 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:10.129811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29884701-06c3-4e2f-a99f-45463a4aa278 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:10.186626 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c2f36-3477-4962-8602-b05fcf2ffcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:10.187289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c2f36-3477-4962-8602-b05fcf2ffcf6 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:10.187571 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c2f36-3477-4962-8602-b05fcf2ffcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:10.187844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c2f36-3477-4962-8602-b05fcf2ffcf6 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:10.188523 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c2f36-3477-4962-8602-b05fcf2ffcf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:10.190978 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c2f36-3477-4962-8602-b05fcf2ffcf6 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:10.212078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1251/2473] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:00:10 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:10.216274 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719f44f-5428-44cc-a01d-82d8bfb05222 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:10.227577 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d719f44f-5428-44cc-a01d-82d8bfb05222 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:10.232275 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a3810-4d6e-4373-b15f-ff4c3cd023a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:10.232940 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a3810-4d6e-4373-b15f-ff4c3cd023a6 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:10.233251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a3810-4d6e-4373-b15f-ff4c3cd023a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:10.233533 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a3810-4d6e-4373-b15f-ff4c3cd023a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:10.234321 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a3810-4d6e-4373-b15f-ff4c3cd023a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:10.236019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a3810-4d6e-4373-b15f-ff4c3cd023a6 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:10.246720 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1223/2474] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:00:10.250844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c2f36-3477-4962-8602-b05fcf2ffcf6 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:10.261559 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c2f36-3477-4962-8602-b05fcf2ffcf6 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:10.266205 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7053f6-de56-45e8-a073-1755b023b3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:10.266860 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7053f6-de56-45e8-a073-1755b023b3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:10.267143 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7053f6-de56-45e8-a073-1755b023b3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:10.267418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7053f6-de56-45e8-a073-1755b023b3b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:10.268721 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7053f6-de56-45e8-a073-1755b023b3b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:10.270323 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7053f6-de56-45e8-a073-1755b023b3b1 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:10.284240 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1252/2475] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:00:10.285441 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a3810-4d6e-4373-b15f-ff4c3cd023a6 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:10.295608 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a3810-4d6e-4373-b15f-ff4c3cd023a6 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:10.300302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305e22f-9984-4b93-b004-2b87467a6100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:10.301174 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305e22f-9984-4b93-b004-2b87467a6100 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:10.301459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305e22f-9984-4b93-b004-2b87467a6100 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:10.301741 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305e22f-9984-4b93-b004-2b87467a6100 admin admin] PATH_INFO: `/v3/projects/67bf0bb707f34e93b3b4f4e956d992a1/users/e999b246707f46b8b890a0cb7a3b6496/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:10.316669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305e22f-9984-4b93-b004-2b87467a6100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67bf0bb707f34e93b3b4f4e956d992a1, user_id=e999b246707f46b8b890a0cb7a3b6496, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:10.319337 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305e22f-9984-4b93-b004-2b87467a6100 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:10.334595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1224/2476] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:00:10 2022] PUT /identity/v3/projects/67bf0bb707f34e93b3b4f4e956d992a1/users/e999b246707f46b8b890a0cb7a3b6496/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:10.346554 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9d4a8-c824-4d87-8c47-8a23123cb9da None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:10.346842 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9d4a8-c824-4d87-8c47-8a23123cb9da None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:10.347149 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9d4a8-c824-4d87-8c47-8a23123cb9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:10.372980 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-91f9d4a8-c824-4d87-8c47-8a23123cb9da None None] MFA Rules not processed for user `e999b246707f46b8b890a0cb7a3b6496`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:10.374219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-91f9d4a8-c824-4d87-8c47-8a23123cb9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:10.442229 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1253/2477] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:10.446858 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305e22f-9984-4b93-b004-2b87467a6100 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:10.509070 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305e22f-9984-4b93-b004-2b87467a6100 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:10.513650 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e78d83-d5da-43a0-9842-4c6a9304dadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:10.514332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e78d83-d5da-43a0-9842-4c6a9304dadd admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:10.514616 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e78d83-d5da-43a0-9842-4c6a9304dadd admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:10.514896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e78d83-d5da-43a0-9842-4c6a9304dadd admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:10.515603 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e78d83-d5da-43a0-9842-4c6a9304dadd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:10.517482 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e78d83-d5da-43a0-9842-4c6a9304dadd admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:10.536553 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:10.544938 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1225/2478] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:00:10 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:10.549019 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9d4a8-c824-4d87-8c47-8a23123cb9da None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:10.560187 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9d4a8-c824-4d87-8c47-8a23123cb9da None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:10.619928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf6fd7-02ee-44a5-89e1-a145c1f44586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:10.620601 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf6fd7-02ee-44a5-89e1-a145c1f44586 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:10.620884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf6fd7-02ee-44a5-89e1-a145c1f44586 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:10.621174 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf6fd7-02ee-44a5-89e1-a145c1f44586 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:10.621890 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf6fd7-02ee-44a5-89e1-a145c1f44586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:10.623800 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf6fd7-02ee-44a5-89e1-a145c1f44586 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:10.638894 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:10.645541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1254/2479] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:00:10 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:10.649300 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e78d83-d5da-43a0-9842-4c6a9304dadd admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:10.659774 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e78d83-d5da-43a0-9842-4c6a9304dadd admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:10.664397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808442c-3d9a-4496-a73d-2f75b71437c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:10.665048 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808442c-3d9a-4496-a73d-2f75b71437c1 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:10.665337 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808442c-3d9a-4496-a73d-2f75b71437c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:10.665618 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d808442c-3d9a-4496-a73d-2f75b71437c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:10.666379 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808442c-3d9a-4496-a73d-2f75b71437c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:10.667961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d808442c-3d9a-4496-a73d-2f75b71437c1 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:10.678871 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1226/2480] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:00:10.682680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf6fd7-02ee-44a5-89e1-a145c1f44586 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:10.693008 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf6fd7-02ee-44a5-89e1-a145c1f44586 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:10.697673 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b503c-f48a-4349-81b2-be57e33e936a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:10.698360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b503c-f48a-4349-81b2-be57e33e936a admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:10.698646 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b503c-f48a-4349-81b2-be57e33e936a admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:10.698926 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b503c-f48a-4349-81b2-be57e33e936a admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:10.699642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b503c-f48a-4349-81b2-be57e33e936a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:10.701229 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b503c-f48a-4349-81b2-be57e33e936a admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:10.710998 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1255/2481] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:00:10.715124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808442c-3d9a-4496-a73d-2f75b71437c1 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:10.725013 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d808442c-3d9a-4496-a73d-2f75b71437c1 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:10.729674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2370e-87f5-4b86-9885-9de52ed01d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:10.730814 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2370e-87f5-4b86-9885-9de52ed01d0b admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:10.731134 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2370e-87f5-4b86-9885-9de52ed01d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:10.731420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2370e-87f5-4b86-9885-9de52ed01d0b admin admin] PATH_INFO: `/v3/projects/cefaeed14f8e4ed3b2d44a2617fa6be0/users/33bcd258f01540f5a54ff51bfe281ef1/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:10.746455 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2370e-87f5-4b86-9885-9de52ed01d0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cefaeed14f8e4ed3b2d44a2617fa6be0, user_id=33bcd258f01540f5a54ff51bfe281ef1, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:10.749129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2370e-87f5-4b86-9885-9de52ed01d0b admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:10.762838 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1227/2482] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:00:10 2022] PUT /identity/v3/projects/cefaeed14f8e4ed3b2d44a2617fa6be0/users/33bcd258f01540f5a54ff51bfe281ef1/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:10.773149 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23656adc-6cac-42b9-878c-b85020541f6d None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:10.773448 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23656adc-6cac-42b9-878c-b85020541f6d None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:10.773730 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23656adc-6cac-42b9-878c-b85020541f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:10.808030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-23656adc-6cac-42b9-878c-b85020541f6d None None] MFA Rules not processed for user `33bcd258f01540f5a54ff51bfe281ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:10.809277 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-23656adc-6cac-42b9-878c-b85020541f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:10.874096 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1256/2483] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:10.878620 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2370e-87f5-4b86-9885-9de52ed01d0b admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:10.949046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2370e-87f5-4b86-9885-9de52ed01d0b admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:10.953727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bd0f2-a279-4b5e-91e8-a5d14da496c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:10.954409 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bd0f2-a279-4b5e-91e8-a5d14da496c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:10.954694 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bd0f2-a279-4b5e-91e8-a5d14da496c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:10.954971 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14bd0f2-a279-4b5e-91e8-a5d14da496c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:10.955670 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bd0f2-a279-4b5e-91e8-a5d14da496c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:10.957555 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14bd0f2-a279-4b5e-91e8-a5d14da496c1 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:10.983184 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1228/2484] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:00:10 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:10.987723 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23656adc-6cac-42b9-878c-b85020541f6d None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:10.998421 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23656adc-6cac-42b9-878c-b85020541f6d None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:11.059013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ee0d9-b213-46c3-98a2-f9a0b9cdc213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:11.059632 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ee0d9-b213-46c3-98a2-f9a0b9cdc213 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:11.059917 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ee0d9-b213-46c3-98a2-f9a0b9cdc213 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:11.060195 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ee0d9-b213-46c3-98a2-f9a0b9cdc213 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:11.060935 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ee0d9-b213-46c3-98a2-f9a0b9cdc213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:11.062928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ee0d9-b213-46c3-98a2-f9a0b9cdc213 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:11.083956 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1257/2485] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:00:10 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:11.088289 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bd0f2-a279-4b5e-91e8-a5d14da496c1 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:11.099820 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14bd0f2-a279-4b5e-91e8-a5d14da496c1 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:11.104615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36993a19-61b0-48f1-baa3-a5cf7656c542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:11.105299 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36993a19-61b0-48f1-baa3-a5cf7656c542 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:11.105622 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36993a19-61b0-48f1-baa3-a5cf7656c542 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:11.105997 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36993a19-61b0-48f1-baa3-a5cf7656c542 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:11.106743 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36993a19-61b0-48f1-baa3-a5cf7656c542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:11.108399 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36993a19-61b0-48f1-baa3-a5cf7656c542 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:11.120610 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1229/2486] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:00:11.125917 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ee0d9-b213-46c3-98a2-f9a0b9cdc213 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:11.137060 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ee0d9-b213-46c3-98a2-f9a0b9cdc213 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:11.141948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c089d43-82bf-47d6-87d1-659ff42a2cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:11.142864 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c089d43-82bf-47d6-87d1-659ff42a2cba admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:11.143151 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c089d43-82bf-47d6-87d1-659ff42a2cba admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:11.143440 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c089d43-82bf-47d6-87d1-659ff42a2cba admin admin] PATH_INFO: `/v3/projects/589f416459f74dbea971b20894b8723e/users/9c0cc7d78f1442ec904661e59132ba9b/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:11.160605 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c089d43-82bf-47d6-87d1-659ff42a2cba admin admin] RBAC: Authorizing `identity:create_grant(project_id=589f416459f74dbea971b20894b8723e, user_id=9c0cc7d78f1442ec904661e59132ba9b, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:11.163378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c089d43-82bf-47d6-87d1-659ff42a2cba admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:11.178133 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1258/2487] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:00:11 2022] PUT /identity/v3/projects/589f416459f74dbea971b20894b8723e/users/9c0cc7d78f1442ec904661e59132ba9b/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:11.182184 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36993a19-61b0-48f1-baa3-a5cf7656c542 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:11.192285 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36993a19-61b0-48f1-baa3-a5cf7656c542 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:11.248293 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000775af-ceae-47d5-8125-e9f850fc5808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:11.248977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000775af-ceae-47d5-8125-e9f850fc5808 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:11.249264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000775af-ceae-47d5-8125-e9f850fc5808 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:11.249541 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000775af-ceae-47d5-8125-e9f850fc5808 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:11.250320 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000775af-ceae-47d5-8125-e9f850fc5808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:11.251933 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000775af-ceae-47d5-8125-e9f850fc5808 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:11.262120 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1230/2488] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:00:11.266248 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c089d43-82bf-47d6-87d1-659ff42a2cba admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:11.277541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c089d43-82bf-47d6-87d1-659ff42a2cba admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:11.284135 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec48532-569b-47ae-bcb7-c3768d7ec033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:11.285042 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec48532-569b-47ae-bcb7-c3768d7ec033 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:11.285331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec48532-569b-47ae-bcb7-c3768d7ec033 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:11.285610 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec48532-569b-47ae-bcb7-c3768d7ec033 admin admin] PATH_INFO: `/v3/projects/589f416459f74dbea971b20894b8723e/users/9c0cc7d78f1442ec904661e59132ba9b/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:11.287679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec48532-569b-47ae-bcb7-c3768d7ec033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=589f416459f74dbea971b20894b8723e, user_id=9c0cc7d78f1442ec904661e59132ba9b, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:11.290356 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec48532-569b-47ae-bcb7-c3768d7ec033 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:11.301123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1259/2489] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:00:11 2022] PUT /identity/v3/projects/589f416459f74dbea971b20894b8723e/users/9c0cc7d78f1442ec904661e59132ba9b/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:11.321160 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21275d4d-c9c0-491e-bee0-c7b103b03fd8 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:11.321367 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21275d4d-c9c0-491e-bee0-c7b103b03fd8 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:11.321646 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21275d4d-c9c0-491e-bee0-c7b103b03fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:11.353998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-21275d4d-c9c0-491e-bee0-c7b103b03fd8 None None] MFA Rules not processed for user `9c0cc7d78f1442ec904661e59132ba9b`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:11.355813 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-21275d4d-c9c0-491e-bee0-c7b103b03fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:11.382722 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:11.428050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1231/2490] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:11.439749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec48532-569b-47ae-bcb7-c3768d7ec033 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:11.441486 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-4ec48532-569b-47ae-bcb7-c3768d7ec033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:11.475248 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:11.501701 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec48532-569b-47ae-bcb7-c3768d7ec033 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:11.505393 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b25ab6-d7c1-42c7-8fd6-87b58632cdc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:11.506069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b25ab6-d7c1-42c7-8fd6-87b58632cdc9 service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:11.506353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b25ab6-d7c1-42c7-8fd6-87b58632cdc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:11.506628 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b25ab6-d7c1-42c7-8fd6-87b58632cdc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:11.515662 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b25ab6-d7c1-42c7-8fd6-87b58632cdc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:11.517078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b25ab6-d7c1-42c7-8fd6-87b58632cdc9 service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:11.529075 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1260/2491] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:00:11 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:00:11.570905 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21275d4d-c9c0-491e-bee0-c7b103b03fd8 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:11.572412 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-21275d4d-c9c0-491e-bee0-c7b103b03fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:11.585398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21275d4d-c9c0-491e-bee0-c7b103b03fd8 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:11.589116 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777c480-8688-4fff-9c28-5e985df9e161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:11.589767 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777c480-8688-4fff-9c28-5e985df9e161 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:11.590086 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777c480-8688-4fff-9c28-5e985df9e161 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:11.590370 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777c480-8688-4fff-9c28-5e985df9e161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:11.653139 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777c480-8688-4fff-9c28-5e985df9e161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:11.654996 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777c480-8688-4fff-9c28-5e985df9e161 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:11.665370 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1232/2492] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:00:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:00:14.591591 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b25ab6-d7c1-42c7-8fd6-87b58632cdc9 service cinder] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:14.660403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b25ab6-d7c1-42c7-8fd6-87b58632cdc9 service cinder] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:14.664964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b04c7b-f02b-4616-bf1e-6bf5c9a26e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:14.665824 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b04c7b-f02b-4616-bf1e-6bf5c9a26e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:14.666137 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b04c7b-f02b-4616-bf1e-6bf5c9a26e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:14.666415 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b04c7b-f02b-4616-bf1e-6bf5c9a26e77 admin admin] PATH_INFO: `/v3/users/e999b246707f46b8b890a0cb7a3b6496` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:14.667610 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b04c7b-f02b-4616-bf1e-6bf5c9a26e77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e999b246707f46b8b890a0cb7a3b6496)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:14.669531 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b04c7b-f02b-4616-bf1e-6bf5c9a26e77 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:14.716154 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-e0b04c7b-f02b-4616-bf1e-6bf5c9a26e77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e999b246707f46b8b890a0cb7a3b6496'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:14.723185 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-e0b04c7b-f02b-4616-bf1e-6bf5c9a26e77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e999b246707f46b8b890a0cb7a3b6496'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:14.723886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-e0b04c7b-f02b-4616-bf1e-6bf5c9a26e77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e999b246707f46b8b890a0cb7a3b6496'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:14.724492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-e0b04c7b-f02b-4616-bf1e-6bf5c9a26e77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e999b246707f46b8b890a0cb7a3b6496'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:14.736129 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-e0b04c7b-f02b-4616-bf1e-6bf5c9a26e77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e999b246707f46b8b890a0cb7a3b6496'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:14.749667 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1261/2493] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:00:14 2022] DELETE /identity/v3/users/e999b246707f46b8b890a0cb7a3b6496 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:14.754646 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc278378-bebd-49c8-b21d-d9adbe73cef1 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:14.755142 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc278378-bebd-49c8-b21d-d9adbe73cef1 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:14.755276 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc278378-bebd-49c8-b21d-d9adbe73cef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:14.774201 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-fc278378-bebd-49c8-b21d-d9adbe73cef1 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:14.775477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-fc278378-bebd-49c8-b21d-d9adbe73cef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:14.838201 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1233/2494] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:14.847871 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b04c7b-f02b-4616-bf1e-6bf5c9a26e77 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:14.849329 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e0b04c7b-f02b-4616-bf1e-6bf5c9a26e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:14.913236 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b04c7b-f02b-4616-bf1e-6bf5c9a26e77 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:14.917217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee833e57-4a5f-4ad3-bf7d-a21fbf64c333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:14.917909 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee833e57-4a5f-4ad3-bf7d-a21fbf64c333 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:14.918203 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee833e57-4a5f-4ad3-bf7d-a21fbf64c333 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:14.918502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee833e57-4a5f-4ad3-bf7d-a21fbf64c333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:14.925224 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:14.932561 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee833e57-4a5f-4ad3-bf7d-a21fbf64c333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:14.934274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee833e57-4a5f-4ad3-bf7d-a21fbf64c333 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:14.944782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1262/2495] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:00:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:00:15.216527 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc278378-bebd-49c8-b21d-d9adbe73cef1 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:15.217990 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-fc278378-bebd-49c8-b21d-d9adbe73cef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:15.231480 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc278378-bebd-49c8-b21d-d9adbe73cef1 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:15.236238 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe9c4c-51fe-471a-a92e-71f223aa48dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:15.237622 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe9c4c-51fe-471a-a92e-71f223aa48dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:15.237961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe9c4c-51fe-471a-a92e-71f223aa48dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:15.238298 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe9c4c-51fe-471a-a92e-71f223aa48dd admin admin] PATH_INFO: `/v3/projects/67bf0bb707f34e93b3b4f4e956d992a1` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:15.239593 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe9c4c-51fe-471a-a92e-71f223aa48dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=67bf0bb707f34e93b3b4f4e956d992a1)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:15.241375 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe9c4c-51fe-471a-a92e-71f223aa48dd admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:15.290606 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-53fe9c4c-51fe-471a-a92e-71f223aa48dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67bf0bb707f34e93b3b4f4e956d992a1', 'request_id': 'req-53fe9c4c-51fe-471a-a92e-71f223aa48dd'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:15.294072 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:15.298202 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-53fe9c4c-51fe-471a-a92e-71f223aa48dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67bf0bb707f34e93b3b4f4e956d992a1', 'request_id': 'req-53fe9c4c-51fe-471a-a92e-71f223aa48dd'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:15.307226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-53fe9c4c-51fe-471a-a92e-71f223aa48dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67bf0bb707f34e93b3b4f4e956d992a1', 'request_id': 'req-53fe9c4c-51fe-471a-a92e-71f223aa48dd'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:15.318095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-53fe9c4c-51fe-471a-a92e-71f223aa48dd admin admin] The token cache is being invalidate because project 67bf0bb707f34e93b3b4f4e956d992a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:00:15.318390 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-53fe9c4c-51fe-471a-a92e-71f223aa48dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:15.319041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-53fe9c4c-51fe-471a-a92e-71f223aa48dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:15.320577 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1234/2496] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:00:15 2022] DELETE /identity/v3/projects/67bf0bb707f34e93b3b4f4e956d992a1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:15.324690 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee833e57-4a5f-4ad3-bf7d-a21fbf64c333 service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:15.334279 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee833e57-4a5f-4ad3-bf7d-a21fbf64c333 service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:15.391073 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6def5-0c75-42b8-9971-3b77a38dc08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:15.391929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6def5-0c75-42b8-9971-3b77a38dc08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:15.392211 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6def5-0c75-42b8-9971-3b77a38dc08c admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:15.392483 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6def5-0c75-42b8-9971-3b77a38dc08c admin admin] PATH_INFO: `/v3/users/33bcd258f01540f5a54ff51bfe281ef1` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:15.393662 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6def5-0c75-42b8-9971-3b77a38dc08c admin admin] RBAC: Authorizing `identity:delete_user(user_id=33bcd258f01540f5a54ff51bfe281ef1)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:15.395597 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6def5-0c75-42b8-9971-3b77a38dc08c admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:15.442265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-2ed6def5-0c75-42b8-9971-3b77a38dc08c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33bcd258f01540f5a54ff51bfe281ef1'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:15.449111 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-2ed6def5-0c75-42b8-9971-3b77a38dc08c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33bcd258f01540f5a54ff51bfe281ef1'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:15.449842 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-2ed6def5-0c75-42b8-9971-3b77a38dc08c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33bcd258f01540f5a54ff51bfe281ef1'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:15.450489 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-2ed6def5-0c75-42b8-9971-3b77a38dc08c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33bcd258f01540f5a54ff51bfe281ef1'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:15.462122 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-2ed6def5-0c75-42b8-9971-3b77a38dc08c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33bcd258f01540f5a54ff51bfe281ef1'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:15.476162 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1263/2497] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:00:15 2022] DELETE /identity/v3/users/33bcd258f01540f5a54ff51bfe281ef1 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:00:15.750863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe9c4c-51fe-471a-a92e-71f223aa48dd admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:15.752486 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-53fe9c4c-51fe-471a-a92e-71f223aa48dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:15.765985 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe9c4c-51fe-471a-a92e-71f223aa48dd admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:15.843411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fd50d-138d-455a-98fe-3c752db584c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:15.844284 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fd50d-138d-455a-98fe-3c752db584c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:15.844569 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fd50d-138d-455a-98fe-3c752db584c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:15.844857 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fd50d-138d-455a-98fe-3c752db584c3 admin admin] PATH_INFO: `/v3/projects/cefaeed14f8e4ed3b2d44a2617fa6be0` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:15.846764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91fd50d-138d-455a-98fe-3c752db584c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cefaeed14f8e4ed3b2d44a2617fa6be0)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:15.848663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91fd50d-138d-455a-98fe-3c752db584c3 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:15.901227 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-f91fd50d-138d-455a-98fe-3c752db584c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cefaeed14f8e4ed3b2d44a2617fa6be0', 'request_id': 'req-f91fd50d-138d-455a-98fe-3c752db584c3'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:15.910979 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-f91fd50d-138d-455a-98fe-3c752db584c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cefaeed14f8e4ed3b2d44a2617fa6be0', 'request_id': 'req-f91fd50d-138d-455a-98fe-3c752db584c3'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:15.918820 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-f91fd50d-138d-455a-98fe-3c752db584c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cefaeed14f8e4ed3b2d44a2617fa6be0', 'request_id': 'req-f91fd50d-138d-455a-98fe-3c752db584c3'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:15.932879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-f91fd50d-138d-455a-98fe-3c752db584c3 admin admin] The token cache is being invalidate because project cefaeed14f8e4ed3b2d44a2617fa6be0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:00:15.933323 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-f91fd50d-138d-455a-98fe-3c752db584c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:15.934180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-f91fd50d-138d-455a-98fe-3c752db584c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:15.935955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1235/2498] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:00:15 2022] DELETE /identity/v3/projects/cefaeed14f8e4ed3b2d44a2617fa6be0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:15.940135 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6def5-0c75-42b8-9971-3b77a38dc08c admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:15.941838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-2ed6def5-0c75-42b8-9971-3b77a38dc08c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:15.956096 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6def5-0c75-42b8-9971-3b77a38dc08c admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:16.015613 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e96cf-c215-4e25-9b18-390cad50caa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:16.016503 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e96cf-c215-4e25-9b18-390cad50caa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:16.016786 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e96cf-c215-4e25-9b18-390cad50caa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:16.017061 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e96cf-c215-4e25-9b18-390cad50caa5 admin admin] PATH_INFO: `/v3/users/9c0cc7d78f1442ec904661e59132ba9b` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:16.018785 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e96cf-c215-4e25-9b18-390cad50caa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c0cc7d78f1442ec904661e59132ba9b)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:16.020703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e96cf-c215-4e25-9b18-390cad50caa5 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:16.035641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:16.077739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-899e96cf-c215-4e25-9b18-390cad50caa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c0cc7d78f1442ec904661e59132ba9b'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:16.087089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-899e96cf-c215-4e25-9b18-390cad50caa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c0cc7d78f1442ec904661e59132ba9b'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:16.087811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-899e96cf-c215-4e25-9b18-390cad50caa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c0cc7d78f1442ec904661e59132ba9b'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:16.088506 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-899e96cf-c215-4e25-9b18-390cad50caa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c0cc7d78f1442ec904661e59132ba9b'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:16.102219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-899e96cf-c215-4e25-9b18-390cad50caa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c0cc7d78f1442ec904661e59132ba9b'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:16.119963 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1264/2499] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:00:15 2022] DELETE /identity/v3/users/9c0cc7d78f1442ec904661e59132ba9b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:16.397168 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fd50d-138d-455a-98fe-3c752db584c3 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:16.398610 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-f91fd50d-138d-455a-98fe-3c752db584c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:16.413528 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fd50d-138d-455a-98fe-3c752db584c3 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:16.474760 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f29d9-b305-4be3-b153-081cc93b4233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:16.475627 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f29d9-b305-4be3-b153-081cc93b4233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:16.475914 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f29d9-b305-4be3-b153-081cc93b4233 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:16.476223 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f29d9-b305-4be3-b153-081cc93b4233 admin admin] PATH_INFO: `/v3/projects/589f416459f74dbea971b20894b8723e` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:16.477452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f29d9-b305-4be3-b153-081cc93b4233 admin admin] RBAC: Authorizing `identity:delete_project(project_id=589f416459f74dbea971b20894b8723e)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:16.479396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f29d9-b305-4be3-b153-081cc93b4233 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:16.495348 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:16.526575 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-967f29d9-b305-4be3-b153-081cc93b4233 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '589f416459f74dbea971b20894b8723e', 'request_id': 'req-967f29d9-b305-4be3-b153-081cc93b4233'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:16.535073 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-967f29d9-b305-4be3-b153-081cc93b4233 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '589f416459f74dbea971b20894b8723e', 'request_id': 'req-967f29d9-b305-4be3-b153-081cc93b4233'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:16.541748 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-967f29d9-b305-4be3-b153-081cc93b4233 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '589f416459f74dbea971b20894b8723e', 'request_id': 'req-967f29d9-b305-4be3-b153-081cc93b4233'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:16.553534 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-967f29d9-b305-4be3-b153-081cc93b4233 admin admin] The token cache is being invalidate because project 589f416459f74dbea971b20894b8723e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:00:16.553839 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-967f29d9-b305-4be3-b153-081cc93b4233 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:16.554645 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-967f29d9-b305-4be3-b153-081cc93b4233 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:16.556359 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1236/2500] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:00:16 2022] DELETE /identity/v3/projects/589f416459f74dbea971b20894b8723e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:16.562793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc978b7-4811-4bba-8919-dc7a174df380 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:16.563084 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc978b7-4811-4bba-8919-dc7a174df380 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:16.563367 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc978b7-4811-4bba-8919-dc7a174df380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:16.581545 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-edc978b7-4811-4bba-8919-dc7a174df380 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:16.582796 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-edc978b7-4811-4bba-8919-dc7a174df380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:16.641559 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1265/2501] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:16.650592 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb29b5-c351-4965-8e42-4afd0b328356 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:16.650882 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb29b5-c351-4965-8e42-4afd0b328356 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:16.651158 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb29b5-c351-4965-8e42-4afd0b328356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:16.669906 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-1ecb29b5-c351-4965-8e42-4afd0b328356 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:16.671109 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-1ecb29b5-c351-4965-8e42-4afd0b328356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:16.679217 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1237/2502] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:00:16.683612 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc978b7-4811-4bba-8919-dc7a174df380 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:16.693678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc978b7-4811-4bba-8919-dc7a174df380 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:16.699537 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6d2bb-ce86-499e-b827-7c4f953809f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:16.700674 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6d2bb-ce86-499e-b827-7c4f953809f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:16.701193 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6d2bb-ce86-499e-b827-7c4f953809f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:16.701700 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6d2bb-ce86-499e-b827-7c4f953809f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:16.702647 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6d2bb-ce86-499e-b827-7c4f953809f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:00:16.702964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6d2bb-ce86-499e-b827-7c4f953809f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:16.704991 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6d2bb-ce86-499e-b827-7c4f953809f7 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:16.718762 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1266/2503] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 16:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:00:16.724063 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb29b5-c351-4965-8e42-4afd0b328356 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:16.733420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb29b5-c351-4965-8e42-4afd0b328356 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:16.738250 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa8919-2d6f-420e-ae14-d2007d4fc0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:16.738895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa8919-2d6f-420e-ae14-d2007d4fc0aa admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:16.739181 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa8919-2d6f-420e-ae14-d2007d4fc0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:16.739457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa8919-2d6f-420e-ae14-d2007d4fc0aa admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:16.740143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa8919-2d6f-420e-ae14-d2007d4fc0aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:16.742114 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efa8919-2d6f-420e-ae14-d2007d4fc0aa admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:16.773354 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1238/2504] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:00:16 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:16.779954 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6d2bb-ce86-499e-b827-7c4f953809f7 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:16.791546 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6d2bb-ce86-499e-b827-7c4f953809f7 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:16.850200 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adeb01-d573-482c-a2de-3720a961c88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:16.850872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adeb01-d573-482c-a2de-3720a961c88c admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:16.851159 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adeb01-d573-482c-a2de-3720a961c88c admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:16.851440 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7adeb01-d573-482c-a2de-3720a961c88c admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:16.852138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adeb01-d573-482c-a2de-3720a961c88c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:16.854076 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7adeb01-d573-482c-a2de-3720a961c88c admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:16.878215 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1267/2505] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:00:16 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:16.879424 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa8919-2d6f-420e-ae14-d2007d4fc0aa admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:16.890279 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efa8919-2d6f-420e-ae14-d2007d4fc0aa admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:16.896909 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0664a6d-7e0e-47ba-9786-f5d5df85dabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:16.897645 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0664a6d-7e0e-47ba-9786-f5d5df85dabc admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:16.898201 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0664a6d-7e0e-47ba-9786-f5d5df85dabc admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:16.898201 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0664a6d-7e0e-47ba-9786-f5d5df85dabc admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:16.899126 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0664a6d-7e0e-47ba-9786-f5d5df85dabc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:16.900775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0664a6d-7e0e-47ba-9786-f5d5df85dabc admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:16.912863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1239/2506] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 16:00:16.916990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adeb01-d573-482c-a2de-3720a961c88c admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:16.927681 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7adeb01-d573-482c-a2de-3720a961c88c admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:16.932662 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7079a05-454b-448b-87c8-1f18a5b08529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:16.933334 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7079a05-454b-448b-87c8-1f18a5b08529 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:16.933646 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7079a05-454b-448b-87c8-1f18a5b08529 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:16.933957 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7079a05-454b-448b-87c8-1f18a5b08529 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:16.934744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7079a05-454b-448b-87c8-1f18a5b08529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:16.936380 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7079a05-454b-448b-87c8-1f18a5b08529 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:16.938732 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:16.950904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1268/2507] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 16:00:16.953413 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0664a6d-7e0e-47ba-9786-f5d5df85dabc admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:16.963965 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0664a6d-7e0e-47ba-9786-f5d5df85dabc admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:16.968710 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72179ec-a341-4b5f-a2fb-82fba785c7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:16.969622 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72179ec-a341-4b5f-a2fb-82fba785c7c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:16.969933 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72179ec-a341-4b5f-a2fb-82fba785c7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:16.970211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72179ec-a341-4b5f-a2fb-82fba785c7c1 admin admin] PATH_INFO: `/v3/projects/ba66f4f2a076410894eb59a9ee63f49a/users/12e90779d69848ddbe5b535092944736/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:16.986335 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72179ec-a341-4b5f-a2fb-82fba785c7c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba66f4f2a076410894eb59a9ee63f49a, user_id=12e90779d69848ddbe5b535092944736, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:16.989113 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72179ec-a341-4b5f-a2fb-82fba785c7c1 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:17.004130 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1240/2508] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:00:16 2022] PUT /identity/v3/projects/ba66f4f2a076410894eb59a9ee63f49a/users/12e90779d69848ddbe5b535092944736/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:17.015726 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a72c21-d7a3-470a-a0d2-da1709d320e7 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:17.016022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a72c21-d7a3-470a-a0d2-da1709d320e7 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:17.016326 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a72c21-d7a3-470a-a0d2-da1709d320e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:17.045487 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-21a72c21-d7a3-470a-a0d2-da1709d320e7 None None] MFA Rules not processed for user `12e90779d69848ddbe5b535092944736`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:17.046687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-21a72c21-d7a3-470a-a0d2-da1709d320e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:17.121357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1269/2509] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:17.122592 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72179ec-a341-4b5f-a2fb-82fba785c7c1 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:17.192175 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72179ec-a341-4b5f-a2fb-82fba785c7c1 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:17.196943 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32819f1-4d3f-48a2-9895-d47a7aeb54fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:17.197605 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32819f1-4d3f-48a2-9895-d47a7aeb54fd admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:17.197915 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32819f1-4d3f-48a2-9895-d47a7aeb54fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:17.198196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32819f1-4d3f-48a2-9895-d47a7aeb54fd admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:17.199218 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32819f1-4d3f-48a2-9895-d47a7aeb54fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:17.200836 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32819f1-4d3f-48a2-9895-d47a7aeb54fd admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:17.235955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1241/2510] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:00:17 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:17.237818 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a72c21-d7a3-470a-a0d2-da1709d320e7 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:17.249132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a72c21-d7a3-470a-a0d2-da1709d320e7 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:17.309265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850db9b2-c559-4666-95b8-99b330a01145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:17.310056 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850db9b2-c559-4666-95b8-99b330a01145 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:17.310345 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850db9b2-c559-4666-95b8-99b330a01145 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:17.310651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850db9b2-c559-4666-95b8-99b330a01145 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:17.311486 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850db9b2-c559-4666-95b8-99b330a01145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:17.313558 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850db9b2-c559-4666-95b8-99b330a01145 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:17.336384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1270/2511] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:00:17 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:17.340845 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32819f1-4d3f-48a2-9895-d47a7aeb54fd admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:17.351792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32819f1-4d3f-48a2-9895-d47a7aeb54fd admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:17.356600 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf310479-d8ff-46b7-ba36-960a0ca33433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:17.357259 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf310479-d8ff-46b7-ba36-960a0ca33433 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:17.357543 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf310479-d8ff-46b7-ba36-960a0ca33433 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:17.357919 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf310479-d8ff-46b7-ba36-960a0ca33433 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:17.358564 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf310479-d8ff-46b7-ba36-960a0ca33433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:17.360145 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf310479-d8ff-46b7-ba36-960a0ca33433 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:17.371565 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1242/2512] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 16:00:17.375912 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850db9b2-c559-4666-95b8-99b330a01145 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:17.386664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850db9b2-c559-4666-95b8-99b330a01145 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:17.391328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cea42-a0b7-4678-9189-6b0e568a2894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:17.392207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cea42-a0b7-4678-9189-6b0e568a2894 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:17.392494 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cea42-a0b7-4678-9189-6b0e568a2894 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:17.392804 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593cea42-a0b7-4678-9189-6b0e568a2894 admin admin] PATH_INFO: `/v3/projects/7c7c46156fda45e99a3cc41e4741bd59/users/b42084c66ade492cb60f6641c4a766b2/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:17.408867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593cea42-a0b7-4678-9189-6b0e568a2894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7c46156fda45e99a3cc41e4741bd59, user_id=b42084c66ade492cb60f6641c4a766b2, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:17.411687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593cea42-a0b7-4678-9189-6b0e568a2894 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:17.433566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1271/2513] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:00:17 2022] PUT /identity/v3/projects/7c7c46156fda45e99a3cc41e4741bd59/users/b42084c66ade492cb60f6641c4a766b2/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:17.437514 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf310479-d8ff-46b7-ba36-960a0ca33433 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:17.450977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf310479-d8ff-46b7-ba36-960a0ca33433 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:17.460481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:17.516085 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12a540-b629-43fc-bea1-47d7f89a359c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:17.516760 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12a540-b629-43fc-bea1-47d7f89a359c admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:17.517042 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12a540-b629-43fc-bea1-47d7f89a359c admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:17.517319 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12a540-b629-43fc-bea1-47d7f89a359c admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:17.518120 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12a540-b629-43fc-bea1-47d7f89a359c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:17.519703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12a540-b629-43fc-bea1-47d7f89a359c admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:17.529846 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1243/2514] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 16:00:17.534376 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cea42-a0b7-4678-9189-6b0e568a2894 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:17.545189 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593cea42-a0b7-4678-9189-6b0e568a2894 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:17.550371 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6952190-3aaa-4060-bad0-b245a71ad9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:17.551252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6952190-3aaa-4060-bad0-b245a71ad9e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:17.551532 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6952190-3aaa-4060-bad0-b245a71ad9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:17.551809 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6952190-3aaa-4060-bad0-b245a71ad9e9 admin admin] PATH_INFO: `/v3/projects/7c7c46156fda45e99a3cc41e4741bd59/users/b42084c66ade492cb60f6641c4a766b2/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:17.553838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6952190-3aaa-4060-bad0-b245a71ad9e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7c46156fda45e99a3cc41e4741bd59, user_id=b42084c66ade492cb60f6641c4a766b2, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:17.556505 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6952190-3aaa-4060-bad0-b245a71ad9e9 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:17.568001 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1272/2515] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:00:17 2022] PUT /identity/v3/projects/7c7c46156fda45e99a3cc41e4741bd59/users/b42084c66ade492cb60f6641c4a766b2/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:17.581203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd006a8-a75f-4aaa-9531-57d44b87ea5c None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:17.581203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd006a8-a75f-4aaa-9531-57d44b87ea5c None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:17.581203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd006a8-a75f-4aaa-9531-57d44b87ea5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:17.606045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-3fd006a8-a75f-4aaa-9531-57d44b87ea5c None None] MFA Rules not processed for user `b42084c66ade492cb60f6641c4a766b2`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:17.607244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-3fd006a8-a75f-4aaa-9531-57d44b87ea5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:17.675337 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1244/2516] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:17.686224 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6952190-3aaa-4060-bad0-b245a71ad9e9 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:17.687941 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-f6952190-3aaa-4060-bad0-b245a71ad9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:17.730585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:17.746146 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6952190-3aaa-4060-bad0-b245a71ad9e9 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:17.749730 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecaa2a1-72b9-45bf-a7ea-72e4f6abe5a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:17.750401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaa2a1-72b9-45bf-a7ea-72e4f6abe5a1 service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:17.750685 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaa2a1-72b9-45bf-a7ea-72e4f6abe5a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:17.750994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaa2a1-72b9-45bf-a7ea-72e4f6abe5a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:17.763567 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecaa2a1-72b9-45bf-a7ea-72e4f6abe5a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:17.765191 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecaa2a1-72b9-45bf-a7ea-72e4f6abe5a1 service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:17.775447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1273/2517] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:00:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:00:18.178037 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd006a8-a75f-4aaa-9531-57d44b87ea5c None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:18.239198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd006a8-a75f-4aaa-9531-57d44b87ea5c None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:18.243735 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fb6a5-1658-4872-a049-4409e19d7df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:18.244605 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fb6a5-1658-4872-a049-4409e19d7df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:18.244890 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fb6a5-1658-4872-a049-4409e19d7df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:18.245174 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fb6a5-1658-4872-a049-4409e19d7df8 admin admin] PATH_INFO: `/v3/users/12e90779d69848ddbe5b535092944736` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:18.246451 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fb6a5-1658-4872-a049-4409e19d7df8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12e90779d69848ddbe5b535092944736)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:18.249110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fb6a5-1658-4872-a049-4409e19d7df8 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:18.287998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:18.297302 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-273fb6a5-1658-4872-a049-4409e19d7df8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12e90779d69848ddbe5b535092944736'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:18.304193 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-273fb6a5-1658-4872-a049-4409e19d7df8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12e90779d69848ddbe5b535092944736'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:18.304864 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-273fb6a5-1658-4872-a049-4409e19d7df8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12e90779d69848ddbe5b535092944736'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:18.305469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-273fb6a5-1658-4872-a049-4409e19d7df8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12e90779d69848ddbe5b535092944736'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:18.317550 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-273fb6a5-1658-4872-a049-4409e19d7df8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12e90779d69848ddbe5b535092944736'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:18.331894 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1245/2518] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:00:18 2022] DELETE /identity/v3/users/12e90779d69848ddbe5b535092944736 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:18.336364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb9716-8892-487f-9374-f7bb028edd61 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:18.336826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb9716-8892-487f-9374-f7bb028edd61 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:18.336961 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb9716-8892-487f-9374-f7bb028edd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:18.355685 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-c4eb9716-8892-487f-9374-f7bb028edd61 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:18.356879 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-c4eb9716-8892-487f-9374-f7bb028edd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:18.419897 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1274/2519] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:18.429493 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fb6a5-1658-4872-a049-4409e19d7df8 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:18.430891 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-273fb6a5-1658-4872-a049-4409e19d7df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:18.487786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fb6a5-1658-4872-a049-4409e19d7df8 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:18.491533 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993a1c8-d05d-44a8-87fe-8f0615a906b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:18.492290 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993a1c8-d05d-44a8-87fe-8f0615a906b1 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:18.492478 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993a1c8-d05d-44a8-87fe-8f0615a906b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:18.492755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993a1c8-d05d-44a8-87fe-8f0615a906b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:18.504492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993a1c8-d05d-44a8-87fe-8f0615a906b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:18.505995 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993a1c8-d05d-44a8-87fe-8f0615a906b1 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:18.517110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1246/2520] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:00:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:00:18.883420 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb9716-8892-487f-9374-f7bb028edd61 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:18.885043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-c4eb9716-8892-487f-9374-f7bb028edd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:18.901203 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb9716-8892-487f-9374-f7bb028edd61 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:18.907314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e78ac-0b1b-4d8f-9f70-f63270207554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:18.908702 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e78ac-0b1b-4d8f-9f70-f63270207554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:18.908910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e78ac-0b1b-4d8f-9f70-f63270207554 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:18.909218 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e78ac-0b1b-4d8f-9f70-f63270207554 admin admin] PATH_INFO: `/v3/projects/ba66f4f2a076410894eb59a9ee63f49a` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:18.910741 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e78ac-0b1b-4d8f-9f70-f63270207554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba66f4f2a076410894eb59a9ee63f49a)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:18.912723 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e78ac-0b1b-4d8f-9f70-f63270207554 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:18.960742 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-582e78ac-0b1b-4d8f-9f70-f63270207554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba66f4f2a076410894eb59a9ee63f49a', 'request_id': 'req-582e78ac-0b1b-4d8f-9f70-f63270207554'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:18.967015 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-582e78ac-0b1b-4d8f-9f70-f63270207554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba66f4f2a076410894eb59a9ee63f49a', 'request_id': 'req-582e78ac-0b1b-4d8f-9f70-f63270207554'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:18.974529 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-582e78ac-0b1b-4d8f-9f70-f63270207554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba66f4f2a076410894eb59a9ee63f49a', 'request_id': 'req-582e78ac-0b1b-4d8f-9f70-f63270207554'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:18.985487 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-582e78ac-0b1b-4d8f-9f70-f63270207554 admin admin] The token cache is being invalidate because project ba66f4f2a076410894eb59a9ee63f49a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:00:18.985748 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-582e78ac-0b1b-4d8f-9f70-f63270207554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:18.986961 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-582e78ac-0b1b-4d8f-9f70-f63270207554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:18.988505 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1275/2521] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:00:18 2022] DELETE /identity/v3/projects/ba66f4f2a076410894eb59a9ee63f49a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:00:18.992537 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993a1c8-d05d-44a8-87fe-8f0615a906b1 service neutron] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:19.003034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993a1c8-d05d-44a8-87fe-8f0615a906b1 service neutron] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:19.062095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1c7cb-5f78-49ff-8514-99cb90441916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:19.063560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1c7cb-5f78-49ff-8514-99cb90441916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:19.063845 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1c7cb-5f78-49ff-8514-99cb90441916 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:19.064132 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1c7cb-5f78-49ff-8514-99cb90441916 admin admin] PATH_INFO: `/v3/users/b42084c66ade492cb60f6641c4a766b2` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:19.066105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1c7cb-5f78-49ff-8514-99cb90441916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b42084c66ade492cb60f6641c4a766b2)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:19.068061 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1c7cb-5f78-49ff-8514-99cb90441916 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:19.114080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-cec1c7cb-5f78-49ff-8514-99cb90441916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b42084c66ade492cb60f6641c4a766b2'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:19.120800 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-cec1c7cb-5f78-49ff-8514-99cb90441916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b42084c66ade492cb60f6641c4a766b2'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:19.121478 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-cec1c7cb-5f78-49ff-8514-99cb90441916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b42084c66ade492cb60f6641c4a766b2'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:19.122120 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-cec1c7cb-5f78-49ff-8514-99cb90441916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b42084c66ade492cb60f6641c4a766b2'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:19.123985 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:19.137927 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-cec1c7cb-5f78-49ff-8514-99cb90441916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b42084c66ade492cb60f6641c4a766b2'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:19.151945 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1247/2522] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:00:18 2022] DELETE /identity/v3/users/b42084c66ade492cb60f6641c4a766b2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:19.459737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e78ac-0b1b-4d8f-9f70-f63270207554 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:19.461263 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-582e78ac-0b1b-4d8f-9f70-f63270207554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:19.475250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e78ac-0b1b-4d8f-9f70-f63270207554 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:19.541036 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971ba51-171d-4d2e-8cde-09c302f7941a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:19.541950 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971ba51-171d-4d2e-8cde-09c302f7941a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:19.542238 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971ba51-171d-4d2e-8cde-09c302f7941a admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:19.542527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971ba51-171d-4d2e-8cde-09c302f7941a admin admin] PATH_INFO: `/v3/projects/7c7c46156fda45e99a3cc41e4741bd59` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:19.543994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971ba51-171d-4d2e-8cde-09c302f7941a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c7c46156fda45e99a3cc41e4741bd59)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:19.546057 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971ba51-171d-4d2e-8cde-09c302f7941a admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:19.554744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:19.600613 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b971ba51-171d-4d2e-8cde-09c302f7941a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c7c46156fda45e99a3cc41e4741bd59', 'request_id': 'req-b971ba51-171d-4d2e-8cde-09c302f7941a'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:19.606834 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b971ba51-171d-4d2e-8cde-09c302f7941a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c7c46156fda45e99a3cc41e4741bd59', 'request_id': 'req-b971ba51-171d-4d2e-8cde-09c302f7941a'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:19.614792 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b971ba51-171d-4d2e-8cde-09c302f7941a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c7c46156fda45e99a3cc41e4741bd59', 'request_id': 'req-b971ba51-171d-4d2e-8cde-09c302f7941a'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:19.625513 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b971ba51-171d-4d2e-8cde-09c302f7941a admin admin] The token cache is being invalidate because project 7c7c46156fda45e99a3cc41e4741bd59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:00:19.626370 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b971ba51-171d-4d2e-8cde-09c302f7941a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:19.626521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-b971ba51-171d-4d2e-8cde-09c302f7941a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:19.631405 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1276/2523] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:00:19 2022] DELETE /identity/v3/projects/7c7c46156fda45e99a3cc41e4741bd59 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:19.633111 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a7dcd-d0f7-4b16-b67e-4f747fa99aa4 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:19.633615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a7dcd-d0f7-4b16-b67e-4f747fa99aa4 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:19.633701 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a7dcd-d0f7-4b16-b67e-4f747fa99aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:19.654813 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-281a7dcd-d0f7-4b16-b67e-4f747fa99aa4 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:19.656033 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-281a7dcd-d0f7-4b16-b67e-4f747fa99aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:19.725244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1248/2524] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:00:19.733597 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986a0ca-a2b2-4dd9-87b6-6a3ab87960db None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:19.733914 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986a0ca-a2b2-4dd9-87b6-6a3ab87960db None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:19.734204 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986a0ca-a2b2-4dd9-87b6-6a3ab87960db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:19.756766 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-0986a0ca-a2b2-4dd9-87b6-6a3ab87960db None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:19.758078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-0986a0ca-a2b2-4dd9-87b6-6a3ab87960db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:19.771092 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1277/2525] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:19.772304 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a7dcd-d0f7-4b16-b67e-4f747fa99aa4 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:19.782958 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a7dcd-d0f7-4b16-b67e-4f747fa99aa4 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:19.789754 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e7f6e-3459-4a73-aa99-2be13fe46f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:19.790737 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e7f6e-3459-4a73-aa99-2be13fe46f68 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:19.791096 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e7f6e-3459-4a73-aa99-2be13fe46f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:19.791444 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e7f6e-3459-4a73-aa99-2be13fe46f68 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:19.792258 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e7f6e-3459-4a73-aa99-2be13fe46f68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:00:19.792636 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e7f6e-3459-4a73-aa99-2be13fe46f68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:19.794350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e7f6e-3459-4a73-aa99-2be13fe46f68 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:19.806685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1249/2526] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 16:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:00:19.811318 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986a0ca-a2b2-4dd9-87b6-6a3ab87960db None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:19.821460 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986a0ca-a2b2-4dd9-87b6-6a3ab87960db None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:19.832876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc8fbc-3a4b-49b3-a02c-1e72d48dff7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:19.832876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc8fbc-3a4b-49b3-a02c-1e72d48dff7f admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:19.832876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc8fbc-3a4b-49b3-a02c-1e72d48dff7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:19.832876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc8fbc-3a4b-49b3-a02c-1e72d48dff7f admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:19.833438 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc8fbc-3a4b-49b3-a02c-1e72d48dff7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:19.835100 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc8fbc-3a4b-49b3-a02c-1e72d48dff7f admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:19.862882 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1278/2527] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:00:19 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:19.866908 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e7f6e-3459-4a73-aa99-2be13fe46f68 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:19.877979 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e7f6e-3459-4a73-aa99-2be13fe46f68 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:19.940452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807c24d-1284-441c-8895-488117743fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:19.941160 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807c24d-1284-441c-8895-488117743fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:19.941441 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807c24d-1284-441c-8895-488117743fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:19.942044 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807c24d-1284-441c-8895-488117743fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:19.942745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807c24d-1284-441c-8895-488117743fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:19.944676 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807c24d-1284-441c-8895-488117743fb0 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:19.966384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1250/2528] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:00:19 2022] POST /identity/v3/users => generated 285 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:19.970833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc8fbc-3a4b-49b3-a02c-1e72d48dff7f admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:19.981322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc8fbc-3a4b-49b3-a02c-1e72d48dff7f admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:19.986376 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278ee66-af03-4359-b5d1-0ee22b44c6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:19.987050 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278ee66-af03-4359-b5d1-0ee22b44c6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:19.987333 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278ee66-af03-4359-b5d1-0ee22b44c6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:19.987605 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278ee66-af03-4359-b5d1-0ee22b44c6c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:19.988338 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0278ee66-af03-4359-b5d1-0ee22b44c6c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:19.989943 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0278ee66-af03-4359-b5d1-0ee22b44c6c5 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:20.011647 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1279/2529] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:00:20.015711 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807c24d-1284-441c-8895-488117743fb0 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:20.027754 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807c24d-1284-441c-8895-488117743fb0 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:20.033415 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8940d-235a-4b98-9c9e-adc21b2e5c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:20.034654 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8940d-235a-4b98-9c9e-adc21b2e5c8f admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:20.034951 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8940d-235a-4b98-9c9e-adc21b2e5c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:20.035237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8940d-235a-4b98-9c9e-adc21b2e5c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:20.035974 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8940d-235a-4b98-9c9e-adc21b2e5c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:20.037583 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8940d-235a-4b98-9c9e-adc21b2e5c8f admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:20.048448 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1251/2530] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:00:20.052908 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278ee66-af03-4359-b5d1-0ee22b44c6c5 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:20.063524 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278ee66-af03-4359-b5d1-0ee22b44c6c5 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:20.068714 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff3914-90c0-4185-ad45-27c4046e2584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:20.069602 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff3914-90c0-4185-ad45-27c4046e2584 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:20.069909 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff3914-90c0-4185-ad45-27c4046e2584 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:20.070190 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff3914-90c0-4185-ad45-27c4046e2584 admin admin] PATH_INFO: `/v3/projects/a6f2551c582d4224a6c6ce8e42651a1a/users/4c6b3eeb9e564526816f707769fca5c0/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:20.085837 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff3914-90c0-4185-ad45-27c4046e2584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6f2551c582d4224a6c6ce8e42651a1a, user_id=4c6b3eeb9e564526816f707769fca5c0, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:20.088533 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff3914-90c0-4185-ad45-27c4046e2584 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:20.107837 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1280/2531] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:00:20 2022] PUT /identity/v3/projects/a6f2551c582d4224a6c6ce8e42651a1a/users/4c6b3eeb9e564526816f707769fca5c0/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:20.112958 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6f4d3-664f-4041-843a-8969e3e11e67 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:20.113259 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6f4d3-664f-4041-843a-8969e3e11e67 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:20.113548 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6f4d3-664f-4041-843a-8969e3e11e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:20.133084 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-f1e6f4d3-664f-4041-843a-8969e3e11e67 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:20.134375 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-f1e6f4d3-664f-4041-843a-8969e3e11e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:20.176680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:20.201967 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1252/2532] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:20.212194 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff3914-90c0-4185-ad45-27c4046e2584 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:20.214127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-daff3914-90c0-4185-ad45-27c4046e2584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:20.279038 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff3914-90c0-4185-ad45-27c4046e2584 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:20.284354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a8656-02c2-419a-8725-40d33ac91313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:20.285499 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a8656-02c2-419a-8725-40d33ac91313 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:20.285901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a8656-02c2-419a-8725-40d33ac91313 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:20.286406 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a8656-02c2-419a-8725-40d33ac91313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:20.297214 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a8656-02c2-419a-8725-40d33ac91313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:20.298711 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a8656-02c2-419a-8725-40d33ac91313 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:20.310229 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1281/2533] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:00:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:00:21.064206 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e893e-8dc7-4f49-bfd7-d466aee6f056 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:21.065047 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e893e-8dc7-4f49-bfd7-d466aee6f056 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:21.065924 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e893e-8dc7-4f49-bfd7-d466aee6f056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:21.099405 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-5c2e893e-8dc7-4f49-bfd7-d466aee6f056 None None] MFA Rules not processed for user `4c6b3eeb9e564526816f707769fca5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:21.100644 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-5c2e893e-8dc7-4f49-bfd7-d466aee6f056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:21.207352 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1253/2534] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:21.210173 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a8656-02c2-419a-8725-40d33ac91313 service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:21.223566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a8656-02c2-419a-8725-40d33ac91313 service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:21.228397 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e78ce1-f6ca-483c-8803-9b0340bfe423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:21.229060 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e78ce1-f6ca-483c-8803-9b0340bfe423 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:21.229348 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e78ce1-f6ca-483c-8803-9b0340bfe423 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:21.229625 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e78ce1-f6ca-483c-8803-9b0340bfe423 admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:21.230350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e78ce1-f6ca-483c-8803-9b0340bfe423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:21.232286 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e78ce1-f6ca-483c-8803-9b0340bfe423 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:21.286115 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1282/2535] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:00:21 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:21.287491 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e893e-8dc7-4f49-bfd7-d466aee6f056 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:21.307099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e893e-8dc7-4f49-bfd7-d466aee6f056 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:21.381844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f3e05-ff94-41df-86b5-abcbd911294d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:21.382559 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f3e05-ff94-41df-86b5-abcbd911294d admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:21.382849 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f3e05-ff94-41df-86b5-abcbd911294d admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:21.383129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f3e05-ff94-41df-86b5-abcbd911294d admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:21.383849 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f3e05-ff94-41df-86b5-abcbd911294d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:21.385763 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f3e05-ff94-41df-86b5-abcbd911294d admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:21.410069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1254/2536] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:00:21 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:21.413708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e78ce1-f6ca-483c-8803-9b0340bfe423 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:21.425343 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e78ce1-f6ca-483c-8803-9b0340bfe423 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:21.430576 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb657ec-0543-47da-b45b-3c4ab77f2c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:21.431071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb657ec-0543-47da-b45b-3c4ab77f2c42 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:21.431376 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb657ec-0543-47da-b45b-3c4ab77f2c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:21.431616 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb657ec-0543-47da-b45b-3c4ab77f2c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:21.432413 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb657ec-0543-47da-b45b-3c4ab77f2c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:21.434265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb657ec-0543-47da-b45b-3c4ab77f2c42 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:21.447624 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1283/2537] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:00:21.451807 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f3e05-ff94-41df-86b5-abcbd911294d admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:21.462995 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f3e05-ff94-41df-86b5-abcbd911294d admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:21.467770 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb419fd-baf9-459b-ad97-575a31930c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:21.468647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb419fd-baf9-459b-ad97-575a31930c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:21.468931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb419fd-baf9-459b-ad97-575a31930c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:21.469211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb419fd-baf9-459b-ad97-575a31930c1f admin admin] PATH_INFO: `/v3/projects/537f8fed9b38466bb73657d9387edec2/users/9a222573bcf943f7beaf9df85198682a/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:21.484980 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb419fd-baf9-459b-ad97-575a31930c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=537f8fed9b38466bb73657d9387edec2, user_id=9a222573bcf943f7beaf9df85198682a, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:21.487829 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb419fd-baf9-459b-ad97-575a31930c1f admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:21.503497 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1255/2538] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:00:21 2022] PUT /identity/v3/projects/537f8fed9b38466bb73657d9387edec2/users/9a222573bcf943f7beaf9df85198682a/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:21.507550 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb657ec-0543-47da-b45b-3c4ab77f2c42 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:21.512780 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:21.519761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb657ec-0543-47da-b45b-3c4ab77f2c42 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:21.595244 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ada54-a8cd-4c6b-8301-d204aab95739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:21.595955 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ada54-a8cd-4c6b-8301-d204aab95739 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:21.596240 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ada54-a8cd-4c6b-8301-d204aab95739 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:21.596519 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ada54-a8cd-4c6b-8301-d204aab95739 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:21.597253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ada54-a8cd-4c6b-8301-d204aab95739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:21.598895 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ada54-a8cd-4c6b-8301-d204aab95739 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:21.609246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1284/2539] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:21 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 16:00:21.613220 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb419fd-baf9-459b-ad97-575a31930c1f admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:21.623850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb419fd-baf9-459b-ad97-575a31930c1f admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:21.629201 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee2c8b-adea-457f-b537-7ba182b00227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:21.630115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee2c8b-adea-457f-b537-7ba182b00227 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:21.630402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee2c8b-adea-457f-b537-7ba182b00227 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:21.630680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee2c8b-adea-457f-b537-7ba182b00227 admin admin] PATH_INFO: `/v3/projects/537f8fed9b38466bb73657d9387edec2/users/9a222573bcf943f7beaf9df85198682a/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:21.632872 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee2c8b-adea-457f-b537-7ba182b00227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=537f8fed9b38466bb73657d9387edec2, user_id=9a222573bcf943f7beaf9df85198682a, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:21.635543 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee2c8b-adea-457f-b537-7ba182b00227 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:21.646823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1256/2540] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:00:21 2022] PUT /identity/v3/projects/537f8fed9b38466bb73657d9387edec2/users/9a222573bcf943f7beaf9df85198682a/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:22.275099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d7ced-559a-4bf7-b77b-cff37c20f914 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:22.275668 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d7ced-559a-4bf7-b77b-cff37c20f914 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:22.276491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d7ced-559a-4bf7-b77b-cff37c20f914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:22.310165 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-5c8d7ced-559a-4bf7-b77b-cff37c20f914 None None] MFA Rules not processed for user `9a222573bcf943f7beaf9df85198682a`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:22.311892 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5c8d7ced-559a-4bf7-b77b-cff37c20f914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:22.410593 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1285/2541] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:22 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:22.421895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49128f4f-ffaf-4d2a-a610-0698cfbfd477 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:22.422456 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49128f4f-ffaf-4d2a-a610-0698cfbfd477 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:22.422648 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49128f4f-ffaf-4d2a-a610-0698cfbfd477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:22.449396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-49128f4f-ffaf-4d2a-a610-0698cfbfd477 None None] MFA Rules not processed for user `4c6b3eeb9e564526816f707769fca5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:22.450737 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-49128f4f-ffaf-4d2a-a610-0698cfbfd477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:22.473627 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:22.516412 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1257/2542] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:22.527983 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d7ced-559a-4bf7-b77b-cff37c20f914 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:22.529971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5c8d7ced-559a-4bf7-b77b-cff37c20f914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:22.621498 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d7ced-559a-4bf7-b77b-cff37c20f914 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:22.627325 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb2ece-88c3-4aa8-8b5a-fbe6bfbedd54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:22.627978 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb2ece-88c3-4aa8-8b5a-fbe6bfbedd54 service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:22.628264 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb2ece-88c3-4aa8-8b5a-fbe6bfbedd54 service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:22.628537 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb2ece-88c3-4aa8-8b5a-fbe6bfbedd54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:22.636734 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb2ece-88c3-4aa8-8b5a-fbe6bfbedd54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:22.638365 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb2ece-88c3-4aa8-8b5a-fbe6bfbedd54 service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:22.655257 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1286/2543] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:00:22 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:00:26.821683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49128f4f-ffaf-4d2a-a610-0698cfbfd477 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:26.883191 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49128f4f-ffaf-4d2a-a610-0698cfbfd477 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:26.887139 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b969802-e627-4630-8de7-f296526c1c1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:26.887813 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b969802-e627-4630-8de7-f296526c1c1a service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:26.888098 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b969802-e627-4630-8de7-f296526c1c1a service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:26.888377 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b969802-e627-4630-8de7-f296526c1c1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:26.890329 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-8b969802-e627-4630-8de7-f296526c1c1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:26.979978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b969802-e627-4630-8de7-f296526c1c1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:26.981453 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b969802-e627-4630-8de7-f296526c1c1a service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:26.992666 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1258/2544] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:00:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:00:30.624343 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb2ece-88c3-4aa8-8b5a-fbe6bfbedd54 service nova] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:30.625665 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-83fb2ece-88c3-4aa8-8b5a-fbe6bfbedd54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:30.644768 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb2ece-88c3-4aa8-8b5a-fbe6bfbedd54 service nova] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:30.654053 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb6d89-2eda-477e-aad7-6063732f500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:30.657297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb6d89-2eda-477e-aad7-6063732f500f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:30.657751 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb6d89-2eda-477e-aad7-6063732f500f admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:30.658178 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb6d89-2eda-477e-aad7-6063732f500f admin admin] PATH_INFO: `/v3/users/baaf74865f9849e49a7ccf2fe7ecb898` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:30.660097 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb6d89-2eda-477e-aad7-6063732f500f admin admin] RBAC: Authorizing `identity:delete_user(user_id=baaf74865f9849e49a7ccf2fe7ecb898)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:30.662940 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb6d89-2eda-477e-aad7-6063732f500f admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:30.668273 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:30.743195 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-43fb6d89-2eda-477e-aad7-6063732f500f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baaf74865f9849e49a7ccf2fe7ecb898'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:30.752221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-43fb6d89-2eda-477e-aad7-6063732f500f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baaf74865f9849e49a7ccf2fe7ecb898'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:30.753372 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-43fb6d89-2eda-477e-aad7-6063732f500f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baaf74865f9849e49a7ccf2fe7ecb898'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:30.754137 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-43fb6d89-2eda-477e-aad7-6063732f500f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baaf74865f9849e49a7ccf2fe7ecb898'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:30.766965 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-43fb6d89-2eda-477e-aad7-6063732f500f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baaf74865f9849e49a7ccf2fe7ecb898'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:30.780967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1287/2545] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:00:30 2022] DELETE /identity/v3/users/baaf74865f9849e49a7ccf2fe7ecb898 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:31.401628 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b969802-e627-4630-8de7-f296526c1c1a service neutron] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:31.412616 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b969802-e627-4630-8de7-f296526c1c1a service neutron] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:31.481470 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc841d3-05f3-4776-82ed-d3f87a873679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:31.482441 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc841d3-05f3-4776-82ed-d3f87a873679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:31.482733 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc841d3-05f3-4776-82ed-d3f87a873679 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:31.483017 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc841d3-05f3-4776-82ed-d3f87a873679 admin admin] PATH_INFO: `/v3/projects/e106b6118e4047b29bc6793eba400a27` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:31.484274 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc841d3-05f3-4776-82ed-d3f87a873679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e106b6118e4047b29bc6793eba400a27)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:31.486273 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc841d3-05f3-4776-82ed-d3f87a873679 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:31.512019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:31.539252 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-4fc841d3-05f3-4776-82ed-d3f87a873679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e106b6118e4047b29bc6793eba400a27', 'request_id': 'req-4fc841d3-05f3-4776-82ed-d3f87a873679'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:31.550704 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-4fc841d3-05f3-4776-82ed-d3f87a873679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e106b6118e4047b29bc6793eba400a27', 'request_id': 'req-4fc841d3-05f3-4776-82ed-d3f87a873679'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:31.558352 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-4fc841d3-05f3-4776-82ed-d3f87a873679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e106b6118e4047b29bc6793eba400a27', 'request_id': 'req-4fc841d3-05f3-4776-82ed-d3f87a873679'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:31.575536 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-4fc841d3-05f3-4776-82ed-d3f87a873679 admin admin] The token cache is being invalidate because project e106b6118e4047b29bc6793eba400a27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:00:31.575996 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-4fc841d3-05f3-4776-82ed-d3f87a873679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:31.576837 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-4fc841d3-05f3-4776-82ed-d3f87a873679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:31.582660 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1259/2546] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:00:31 2022] DELETE /identity/v3/projects/e106b6118e4047b29bc6793eba400a27 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:31.584428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7ea56-ad04-4db6-bec5-f0a154476208 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:31.584724 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7ea56-ad04-4db6-bec5-f0a154476208 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:31.585042 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7ea56-ad04-4db6-bec5-f0a154476208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:31.605872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-b0f7ea56-ad04-4db6-bec5-f0a154476208 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:31.607134 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-b0f7ea56-ad04-4db6-bec5-f0a154476208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:31.673228 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1288/2547] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:31.681606 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab282e-e35b-4e20-9a87-56eec4cbe9b1 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:31.681920 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab282e-e35b-4e20-9a87-56eec4cbe9b1 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:31.682206 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab282e-e35b-4e20-9a87-56eec4cbe9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:31.700514 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-55ab282e-e35b-4e20-9a87-56eec4cbe9b1 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:31.701745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-55ab282e-e35b-4e20-9a87-56eec4cbe9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:31.711101 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1260/2548] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:00:31.715289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7ea56-ad04-4db6-bec5-f0a154476208 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:31.725890 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7ea56-ad04-4db6-bec5-f0a154476208 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:31.730618 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118e4ce-edb9-4dad-9a6c-f3895b3e9c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:31.731290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118e4ce-edb9-4dad-9a6c-f3895b3e9c59 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:31.731620 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118e4ce-edb9-4dad-9a6c-f3895b3e9c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:31.731850 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118e4ce-edb9-4dad-9a6c-f3895b3e9c59 admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:31.732591 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118e4ce-edb9-4dad-9a6c-f3895b3e9c59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:00:31.732986 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118e4ce-edb9-4dad-9a6c-f3895b3e9c59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:31.734556 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9118e4ce-edb9-4dad-9a6c-f3895b3e9c59 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:31.747776 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1289/2549] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 16:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:00:31.752001 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab282e-e35b-4e20-9a87-56eec4cbe9b1 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:31.761902 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab282e-e35b-4e20-9a87-56eec4cbe9b1 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:31.771426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b424e17-8ab2-4f35-978f-d11ceefdf0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:31.772844 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b424e17-8ab2-4f35-978f-d11ceefdf0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:31.773365 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b424e17-8ab2-4f35-978f-d11ceefdf0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:31.773908 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b424e17-8ab2-4f35-978f-d11ceefdf0d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:31.775622 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b424e17-8ab2-4f35-978f-d11ceefdf0d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:31.777495 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b424e17-8ab2-4f35-978f-d11ceefdf0d2 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:31.822958 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1261/2550] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:00:31 2022] POST /identity/v3/projects => generated 365 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:31.827337 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118e4ce-edb9-4dad-9a6c-f3895b3e9c59 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:31.853512 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118e4ce-edb9-4dad-9a6c-f3895b3e9c59 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:31.999046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92d7cb-b54f-40db-aa60-c777f1ba3111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:31.999903 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92d7cb-b54f-40db-aa60-c777f1ba3111 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:32.000312 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92d7cb-b54f-40db-aa60-c777f1ba3111 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:32.000855 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92d7cb-b54f-40db-aa60-c777f1ba3111 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:32.002447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92d7cb-b54f-40db-aa60-c777f1ba3111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:32.005247 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92d7cb-b54f-40db-aa60-c777f1ba3111 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:32.024777 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:32.042802 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1290/2551] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:00:31 2022] POST /identity/v3/users => generated 283 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:32.044099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b424e17-8ab2-4f35-978f-d11ceefdf0d2 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:32.056644 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b424e17-8ab2-4f35-978f-d11ceefdf0d2 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:32.063579 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa03b1d-a342-4496-9de8-68bed0324aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:32.064794 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa03b1d-a342-4496-9de8-68bed0324aaf admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:32.065079 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa03b1d-a342-4496-9de8-68bed0324aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:32.065357 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa03b1d-a342-4496-9de8-68bed0324aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:32.066547 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa03b1d-a342-4496-9de8-68bed0324aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:32.074298 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa03b1d-a342-4496-9de8-68bed0324aaf admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:32.104269 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1262/2552] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:00:32.109288 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92d7cb-b54f-40db-aa60-c777f1ba3111 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:32.121340 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92d7cb-b54f-40db-aa60-c777f1ba3111 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:32.127384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a4d37-f7eb-4089-bfd6-4ff15bc32760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:32.128097 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a4d37-f7eb-4089-bfd6-4ff15bc32760 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:32.128573 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a4d37-f7eb-4089-bfd6-4ff15bc32760 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:32.128670 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a4d37-f7eb-4089-bfd6-4ff15bc32760 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:32.129542 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a4d37-f7eb-4089-bfd6-4ff15bc32760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:32.131403 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496a4d37-f7eb-4089-bfd6-4ff15bc32760 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:32.146206 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1291/2553] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:00:32.150637 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa03b1d-a342-4496-9de8-68bed0324aaf admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:32.163263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa03b1d-a342-4496-9de8-68bed0324aaf admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:32.168355 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af711cc-0831-4c51-9338-fb74a7517938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:32.169447 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af711cc-0831-4c51-9338-fb74a7517938 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:32.170615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af711cc-0831-4c51-9338-fb74a7517938 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:32.170615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af711cc-0831-4c51-9338-fb74a7517938 admin admin] PATH_INFO: `/v3/projects/60d905712b7d46a3801f6760a0a21eb6/users/d519b3880f5f4d6eb875e2bd24692249/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:32.188992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af711cc-0831-4c51-9338-fb74a7517938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d905712b7d46a3801f6760a0a21eb6, user_id=d519b3880f5f4d6eb875e2bd24692249, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:32.192435 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af711cc-0831-4c51-9338-fb74a7517938 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:32.210245 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1263/2554] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:00:32 2022] PUT /identity/v3/projects/60d905712b7d46a3801f6760a0a21eb6/users/d519b3880f5f4d6eb875e2bd24692249/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:32.220756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6c057-6e9c-4403-b30e-5643ee319ee9 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:32.221047 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6c057-6e9c-4403-b30e-5643ee319ee9 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:32.221331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6c057-6e9c-4403-b30e-5643ee319ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:32.250583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-0fd6c057-6e9c-4403-b30e-5643ee319ee9 None None] MFA Rules not processed for user `d519b3880f5f4d6eb875e2bd24692249`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:32.252456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-0fd6c057-6e9c-4403-b30e-5643ee319ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:32.326723 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1292/2555] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:32.335681 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af711cc-0831-4c51-9338-fb74a7517938 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:32.337952 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-1af711cc-0831-4c51-9338-fb74a7517938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:32.414350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af711cc-0831-4c51-9338-fb74a7517938 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:32.420257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616209d-25c9-457a-9c46-09fda2d3e0cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:32.421603 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616209d-25c9-457a-9c46-09fda2d3e0cf service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:32.421907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616209d-25c9-457a-9c46-09fda2d3e0cf service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:32.422374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616209d-25c9-457a-9c46-09fda2d3e0cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:32.433691 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616209d-25c9-457a-9c46-09fda2d3e0cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:32.435175 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616209d-25c9-457a-9c46-09fda2d3e0cf service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:32.445587 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1264/2556] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:00:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:00:36.066078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6c057-6e9c-4403-b30e-5643ee319ee9 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:36.067579 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-0fd6c057-6e9c-4403-b30e-5643ee319ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:36.104932 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616209d-25c9-457a-9c46-09fda2d3e0cf service cinder] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:36.106469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-c616209d-25c9-457a-9c46-09fda2d3e0cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:36.117671 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616209d-25c9-457a-9c46-09fda2d3e0cf service cinder] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:36.121388 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc059d-4a92-4dd6-9ab9-7101dc2b1fc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:36.122079 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc059d-4a92-4dd6-9ab9-7101dc2b1fc5 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:36.122370 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc059d-4a92-4dd6-9ab9-7101dc2b1fc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:36.122673 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc059d-4a92-4dd6-9ab9-7101dc2b1fc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:36.124423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-01cc059d-4a92-4dd6-9ab9-7101dc2b1fc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:36.129689 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6c057-6e9c-4403-b30e-5643ee319ee9 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:36.133627 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf6d1f-3495-4659-8477-85d134584e92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:36.134313 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf6d1f-3495-4659-8477-85d134584e92 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:36.134600 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf6d1f-3495-4659-8477-85d134584e92 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:36.134877 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf6d1f-3495-4659-8477-85d134584e92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:36.136679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-decf6d1f-3495-4659-8477-85d134584e92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:36.174827 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:36.195715 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc059d-4a92-4dd6-9ab9-7101dc2b1fc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:36.197244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc059d-4a92-4dd6-9ab9-7101dc2b1fc5 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:36.204423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf6d1f-3495-4659-8477-85d134584e92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:36.206651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf6d1f-3495-4659-8477-85d134584e92 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:36.208549 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1265/2557] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:00:36 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:00:36.217913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1293/2558] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:00:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:00:40.750071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc059d-4a92-4dd6-9ab9-7101dc2b1fc5 service cinder] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:40.751618 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-01cc059d-4a92-4dd6-9ab9-7101dc2b1fc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:40.768695 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc059d-4a92-4dd6-9ab9-7101dc2b1fc5 service cinder] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:40.773840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb39cc-a6ed-4794-8e98-ecc1d1775ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:40.774780 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb39cc-a6ed-4794-8e98-ecc1d1775ad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:40.775071 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb39cc-a6ed-4794-8e98-ecc1d1775ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:40.775342 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb39cc-a6ed-4794-8e98-ecc1d1775ad2 admin admin] PATH_INFO: `/v3/users/7e678b395d334be399ecb6af37f9987b` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:40.777045 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb39cc-a6ed-4794-8e98-ecc1d1775ad2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e678b395d334be399ecb6af37f9987b)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:40.779186 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb39cc-a6ed-4794-8e98-ecc1d1775ad2 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:40.850149 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-7ccb39cc-a6ed-4794-8e98-ecc1d1775ad2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e678b395d334be399ecb6af37f9987b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:40.862559 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-7ccb39cc-a6ed-4794-8e98-ecc1d1775ad2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e678b395d334be399ecb6af37f9987b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:40.863438 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-7ccb39cc-a6ed-4794-8e98-ecc1d1775ad2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e678b395d334be399ecb6af37f9987b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:40.864264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-7ccb39cc-a6ed-4794-8e98-ecc1d1775ad2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e678b395d334be399ecb6af37f9987b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:40.879418 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-7ccb39cc-a6ed-4794-8e98-ecc1d1775ad2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e678b395d334be399ecb6af37f9987b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:40.898960 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1266/2559] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:00:40 2022] DELETE /identity/v3/users/7e678b395d334be399ecb6af37f9987b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:41.128942 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf6d1f-3495-4659-8477-85d134584e92 service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:41.146515 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf6d1f-3495-4659-8477-85d134584e92 service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:41.185392 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:41.221749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceeff9d-ea3f-4582-b580-46e7220d322e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:41.222591 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceeff9d-ea3f-4582-b580-46e7220d322e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:41.222922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceeff9d-ea3f-4582-b580-46e7220d322e admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:41.223178 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceeff9d-ea3f-4582-b580-46e7220d322e admin admin] PATH_INFO: `/v3/projects/e05c3ae4e3d246b88fe785ca0b7fa3a4` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:41.224537 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceeff9d-ea3f-4582-b580-46e7220d322e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e05c3ae4e3d246b88fe785ca0b7fa3a4)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:41.226540 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceeff9d-ea3f-4582-b580-46e7220d322e admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:41.287782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-4ceeff9d-ea3f-4582-b580-46e7220d322e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e05c3ae4e3d246b88fe785ca0b7fa3a4', 'request_id': 'req-4ceeff9d-ea3f-4582-b580-46e7220d322e'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:41.296487 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-4ceeff9d-ea3f-4582-b580-46e7220d322e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e05c3ae4e3d246b88fe785ca0b7fa3a4', 'request_id': 'req-4ceeff9d-ea3f-4582-b580-46e7220d322e'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:41.307715 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-4ceeff9d-ea3f-4582-b580-46e7220d322e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e05c3ae4e3d246b88fe785ca0b7fa3a4', 'request_id': 'req-4ceeff9d-ea3f-4582-b580-46e7220d322e'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:41.323104 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-4ceeff9d-ea3f-4582-b580-46e7220d322e admin admin] The token cache is being invalidate because project e05c3ae4e3d246b88fe785ca0b7fa3a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:00:41.323399 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-4ceeff9d-ea3f-4582-b580-46e7220d322e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:41.324207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-4ceeff9d-ea3f-4582-b580-46e7220d322e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:41.327929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1294/2560] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:00:41 2022] DELETE /identity/v3/projects/e05c3ae4e3d246b88fe785ca0b7fa3a4 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:41.330978 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab603115-2b04-47a9-85e8-4be5f2181ebb None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:41.331818 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab603115-2b04-47a9-85e8-4be5f2181ebb None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:41.331818 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab603115-2b04-47a9-85e8-4be5f2181ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:41.353165 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-ab603115-2b04-47a9-85e8-4be5f2181ebb None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:41.354490 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-ab603115-2b04-47a9-85e8-4be5f2181ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:41.373330 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceeff9d-ea3f-4582-b580-46e7220d322e admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:41.379907 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-4ceeff9d-ea3f-4582-b580-46e7220d322e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:41.429220 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1267/2561] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:41.441536 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fac834-6b60-4a88-91f1-5fb6b46ef1db None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:41.442041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fac834-6b60-4a88-91f1-5fb6b46ef1db None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:41.442372 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fac834-6b60-4a88-91f1-5fb6b46ef1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:41.464392 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-97fac834-6b60-4a88-91f1-5fb6b46ef1db None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:41.464669 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceeff9d-ea3f-4582-b580-46e7220d322e admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:41.465735 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-97fac834-6b60-4a88-91f1-5fb6b46ef1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:41.469337 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb421a5-600b-42a2-9f6a-aeffff443175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:41.470328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb421a5-600b-42a2-9f6a-aeffff443175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:41.470612 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb421a5-600b-42a2-9f6a-aeffff443175 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:41.470883 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb421a5-600b-42a2-9f6a-aeffff443175 admin admin] PATH_INFO: `/v3/users/d519b3880f5f4d6eb875e2bd24692249` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:41.472526 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb421a5-600b-42a2-9f6a-aeffff443175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d519b3880f5f4d6eb875e2bd24692249)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:41.474287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1268/2562] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:00:41.474997 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb421a5-600b-42a2-9f6a-aeffff443175 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:41.478601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fac834-6b60-4a88-91f1-5fb6b46ef1db None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:41.489663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fac834-6b60-4a88-91f1-5fb6b46ef1db None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:41.495708 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f08c2e-f921-4f47-8235-eb9e2ae6a74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:41.496384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f08c2e-f921-4f47-8235-eb9e2ae6a74d admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:41.496669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f08c2e-f921-4f47-8235-eb9e2ae6a74d admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:41.496944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f08c2e-f921-4f47-8235-eb9e2ae6a74d admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:41.497684 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f08c2e-f921-4f47-8235-eb9e2ae6a74d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:00:41.498027 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f08c2e-f921-4f47-8235-eb9e2ae6a74d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:41.500021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f08c2e-f921-4f47-8235-eb9e2ae6a74d admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:41.513772 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1269/2563] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 16:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:00:41.519867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f08c2e-f921-4f47-8235-eb9e2ae6a74d admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:41.532245 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f08c2e-f921-4f47-8235-eb9e2ae6a74d admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:41.536362 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-4eb421a5-600b-42a2-9f6a-aeffff443175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd519b3880f5f4d6eb875e2bd24692249'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:41.537091 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057afa7-5439-448c-97b0-8e8dec06f676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:41.537763 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057afa7-5439-448c-97b0-8e8dec06f676 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:41.538083 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057afa7-5439-448c-97b0-8e8dec06f676 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:41.538361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057afa7-5439-448c-97b0-8e8dec06f676 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:41.544613 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057afa7-5439-448c-97b0-8e8dec06f676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:41.544613 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057afa7-5439-448c-97b0-8e8dec06f676 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:41.545119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-4eb421a5-600b-42a2-9f6a-aeffff443175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd519b3880f5f4d6eb875e2bd24692249'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:41.545750 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-4eb421a5-600b-42a2-9f6a-aeffff443175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd519b3880f5f4d6eb875e2bd24692249'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:41.546522 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-4eb421a5-600b-42a2-9f6a-aeffff443175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd519b3880f5f4d6eb875e2bd24692249'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:41.552482 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:41.567743 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-4eb421a5-600b-42a2-9f6a-aeffff443175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd519b3880f5f4d6eb875e2bd24692249'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:41.573734 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1270/2564] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:00:41 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 16:00:41.578251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057afa7-5439-448c-97b0-8e8dec06f676 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:41.580620 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-c057afa7-5439-448c-97b0-8e8dec06f676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:41.585364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1295/2565] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:00:41 2022] DELETE /identity/v3/users/d519b3880f5f4d6eb875e2bd24692249 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:41.591441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a78630-f1b4-4278-b43f-1be4db1861d1 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:41.591723 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a78630-f1b4-4278-b43f-1be4db1861d1 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:41.592000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a78630-f1b4-4278-b43f-1be4db1861d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:41.598439 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:41.615284 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-92a78630-f1b4-4278-b43f-1be4db1861d1 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:41.617229 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-92a78630-f1b4-4278-b43f-1be4db1861d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:41.674280 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057afa7-5439-448c-97b0-8e8dec06f676 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:41.696007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1296/2566] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:00:41.706476 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a78630-f1b4-4278-b43f-1be4db1861d1 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:41.707965 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-92a78630-f1b4-4278-b43f-1be4db1861d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:41.745040 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85026165-3ff4-4e19-90df-040474418ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:41.745619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85026165-3ff4-4e19-90df-040474418ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:41.745936 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85026165-3ff4-4e19-90df-040474418ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:41.746219 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85026165-3ff4-4e19-90df-040474418ca8 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:41.746921 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85026165-3ff4-4e19-90df-040474418ca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:41.748859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85026165-3ff4-4e19-90df-040474418ca8 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:41.771377 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a78630-f1b4-4278-b43f-1be4db1861d1 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:41.772495 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1271/2567] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:00:41 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:41.777300 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245bffe-cfc6-43ff-b011-f060ce22e8d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:41.777479 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85026165-3ff4-4e19-90df-040474418ca8 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:41.778179 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245bffe-cfc6-43ff-b011-f060ce22e8d5 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:41.778466 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245bffe-cfc6-43ff-b011-f060ce22e8d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:41.778753 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f245bffe-cfc6-43ff-b011-f060ce22e8d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:41.789387 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85026165-3ff4-4e19-90df-040474418ca8 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:41.789587 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245bffe-cfc6-43ff-b011-f060ce22e8d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:41.790984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f245bffe-cfc6-43ff-b011-f060ce22e8d5 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:41.794241 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa53017-4809-4ccf-855a-18b24dc85fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:41.794919 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa53017-4809-4ccf-855a-18b24dc85fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:41.795211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa53017-4809-4ccf-855a-18b24dc85fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:41.795491 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa53017-4809-4ccf-855a-18b24dc85fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:41.796225 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa53017-4809-4ccf-855a-18b24dc85fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:41.798010 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa53017-4809-4ccf-855a-18b24dc85fa7 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:41.802452 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1297/2568] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:00:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 16:00:41.810073 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1272/2569] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 16:00:41.813945 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245bffe-cfc6-43ff-b011-f060ce22e8d5 service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:41.824489 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f245bffe-cfc6-43ff-b011-f060ce22e8d5 service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:41.829672 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77517d-8334-48dd-a5e8-dd23f3d44ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:41.830394 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77517d-8334-48dd-a5e8-dd23f3d44ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:41.830679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77517d-8334-48dd-a5e8-dd23f3d44ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:41.830954 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77517d-8334-48dd-a5e8-dd23f3d44ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:41.831862 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77517d-8334-48dd-a5e8-dd23f3d44ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:41.833551 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77517d-8334-48dd-a5e8-dd23f3d44ae2 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:41.846535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1298/2570] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:00:41.850724 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa53017-4809-4ccf-855a-18b24dc85fa7 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:41.862363 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa53017-4809-4ccf-855a-18b24dc85fa7 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:41.868559 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118f91c-6a36-4526-8fa4-a0b649e6cb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:41.869744 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118f91c-6a36-4526-8fa4-a0b649e6cb56 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:41.870060 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118f91c-6a36-4526-8fa4-a0b649e6cb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:41.870586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118f91c-6a36-4526-8fa4-a0b649e6cb56 admin admin] PATH_INFO: `/v3/projects/103b44238bf842c798e8117cfe1bb3c0/users/daceb53070d9420fbbb826478b853923/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:41.894253 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118f91c-6a36-4526-8fa4-a0b649e6cb56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=103b44238bf842c798e8117cfe1bb3c0, user_id=daceb53070d9420fbbb826478b853923, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:41.899852 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118f91c-6a36-4526-8fa4-a0b649e6cb56 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:41.920613 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1273/2571] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:00:41 2022] PUT /identity/v3/projects/103b44238bf842c798e8117cfe1bb3c0/users/daceb53070d9420fbbb826478b853923/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:41.934392 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475bb5f-f378-4492-89f5-dbb052afec95 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:41.934689 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475bb5f-f378-4492-89f5-dbb052afec95 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:41.934932 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475bb5f-f378-4492-89f5-dbb052afec95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:41.972610 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-6475bb5f-f378-4492-89f5-dbb052afec95 None None] MFA Rules not processed for user `daceb53070d9420fbbb826478b853923`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:41.973880 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-6475bb5f-f378-4492-89f5-dbb052afec95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:42.054606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:42.061619 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1299/2572] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:00:42.066680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118f91c-6a36-4526-8fa4-a0b649e6cb56 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:42.153265 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118f91c-6a36-4526-8fa4-a0b649e6cb56 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:42.160680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475bb5f-f378-4492-89f5-dbb052afec95 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:42.161879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1f3c5-3428-4cec-b117-9e5344b986a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:42.162588 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1f3c5-3428-4cec-b117-9e5344b986a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:42.162870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1f3c5-3428-4cec-b117-9e5344b986a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:42.163297 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a1f3c5-3428-4cec-b117-9e5344b986a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:42.163921 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-6475bb5f-f378-4492-89f5-dbb052afec95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:42.164329 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1f3c5-3428-4cec-b117-9e5344b986a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:42.165996 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a1f3c5-3428-4cec-b117-9e5344b986a2 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:42.200150 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:42.210210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475bb5f-f378-4492-89f5-dbb052afec95 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:42.220895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1274/2573] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:00:42 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:42.221114 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584b29f-67c5-4348-9243-a0b9b16cc55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:42.222155 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584b29f-67c5-4348-9243-a0b9b16cc55e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:42.222613 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584b29f-67c5-4348-9243-a0b9b16cc55e admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:42.223133 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584b29f-67c5-4348-9243-a0b9b16cc55e admin admin] PATH_INFO: `/v3/projects/60d905712b7d46a3801f6760a0a21eb6` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:42.224539 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584b29f-67c5-4348-9243-a0b9b16cc55e admin admin] RBAC: Authorizing `identity:delete_project(project_id=60d905712b7d46a3801f6760a0a21eb6)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:42.225953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1f3c5-3428-4cec-b117-9e5344b986a2 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:42.226549 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584b29f-67c5-4348-9243-a0b9b16cc55e admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:42.309607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a1f3c5-3428-4cec-b117-9e5344b986a2 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:42.328725 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-9584b29f-67c5-4348-9243-a0b9b16cc55e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d905712b7d46a3801f6760a0a21eb6', 'request_id': 'req-9584b29f-67c5-4348-9243-a0b9b16cc55e'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:42.334115 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-9584b29f-67c5-4348-9243-a0b9b16cc55e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d905712b7d46a3801f6760a0a21eb6', 'request_id': 'req-9584b29f-67c5-4348-9243-a0b9b16cc55e'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:42.344463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-9584b29f-67c5-4348-9243-a0b9b16cc55e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d905712b7d46a3801f6760a0a21eb6', 'request_id': 'req-9584b29f-67c5-4348-9243-a0b9b16cc55e'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:42.359637 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-9584b29f-67c5-4348-9243-a0b9b16cc55e admin admin] The token cache is being invalidate because project 60d905712b7d46a3801f6760a0a21eb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:00:42.360221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-9584b29f-67c5-4348-9243-a0b9b16cc55e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:42.361346 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-9584b29f-67c5-4348-9243-a0b9b16cc55e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:42.363546 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1300/2574] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:00:42 2022] DELETE /identity/v3/projects/60d905712b7d46a3801f6760a0a21eb6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:42.368213 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c324aec-a86a-4207-8d5b-1d3ee8b9d2a8 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:42.368678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c324aec-a86a-4207-8d5b-1d3ee8b9d2a8 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:42.368794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c324aec-a86a-4207-8d5b-1d3ee8b9d2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:42.381298 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b413a-4cfe-405a-8925-62425c267eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:42.382149 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b413a-4cfe-405a-8925-62425c267eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:42.382502 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b413a-4cfe-405a-8925-62425c267eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:42.382853 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b413a-4cfe-405a-8925-62425c267eb3 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:42.384292 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b413a-4cfe-405a-8925-62425c267eb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:42.386411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b413a-4cfe-405a-8925-62425c267eb3 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:42.389092 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-8c324aec-a86a-4207-8d5b-1d3ee8b9d2a8 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:42.390288 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-8c324aec-a86a-4207-8d5b-1d3ee8b9d2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:42.400707 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1301/2575] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:00:42.410654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37176016-c6a2-486b-bde2-00e542bc5e30 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:42.410906 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37176016-c6a2-486b-bde2-00e542bc5e30 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:42.411415 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37176016-c6a2-486b-bde2-00e542bc5e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:42.423767 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1275/2576] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:00:42 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:42.427575 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b413a-4cfe-405a-8925-62425c267eb3 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:42.430258 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-a79b413a-4cfe-405a-8925-62425c267eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:42.441433 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-37176016-c6a2-486b-bde2-00e542bc5e30 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:42.442792 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-37176016-c6a2-486b-bde2-00e542bc5e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:42.453911 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1302/2577] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:42.454211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b413a-4cfe-405a-8925-62425c267eb3 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:42.457562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37176016-c6a2-486b-bde2-00e542bc5e30 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:42.461428 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b7f0d-c1e5-4875-b40b-8a4a8adbc0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:42.462276 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b7f0d-c1e5-4875-b40b-8a4a8adbc0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:42.462980 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b7f0d-c1e5-4875-b40b-8a4a8adbc0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:42.463551 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b7f0d-c1e5-4875-b40b-8a4a8adbc0d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:42.464390 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b7f0d-c1e5-4875-b40b-8a4a8adbc0d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:42.466361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b7f0d-c1e5-4875-b40b-8a4a8adbc0d4 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:42.474993 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37176016-c6a2-486b-bde2-00e542bc5e30 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:42.481606 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69de2c3-cace-4632-86cc-a8e94475b86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:42.482523 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69de2c3-cace-4632-86cc-a8e94475b86b admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:42.482861 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69de2c3-cace-4632-86cc-a8e94475b86b admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:42.483219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69de2c3-cace-4632-86cc-a8e94475b86b admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:42.483824 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1276/2578] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:00:42.484067 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69de2c3-cace-4632-86cc-a8e94475b86b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:00:42.484425 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69de2c3-cace-4632-86cc-a8e94475b86b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:42.486224 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69de2c3-cace-4632-86cc-a8e94475b86b admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:42.488719 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b7f0d-c1e5-4875-b40b-8a4a8adbc0d4 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:42.505130 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1303/2579] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 16:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:00:42.505243 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b7f0d-c1e5-4875-b40b-8a4a8adbc0d4 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:42.505363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69de2c3-cace-4632-86cc-a8e94475b86b admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:42.511046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57600904-084c-46a9-a8c9-dff43713b58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:42.512835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57600904-084c-46a9-a8c9-dff43713b58f admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:42.513392 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57600904-084c-46a9-a8c9-dff43713b58f admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:42.513930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57600904-084c-46a9-a8c9-dff43713b58f admin admin] PATH_INFO: `/v3/projects/58c232f225eb4ae09cbe18fc31a707d9/users/ffdeeb6e05af4db0aaa135e41bd21123/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:42.515642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69de2c3-cace-4632-86cc-a8e94475b86b admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:42.526131 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e847ec-3aef-4414-8c02-1329af5a99bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:42.526968 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e847ec-3aef-4414-8c02-1329af5a99bf admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:42.527265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e847ec-3aef-4414-8c02-1329af5a99bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:42.527547 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e847ec-3aef-4414-8c02-1329af5a99bf admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:42.528264 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e847ec-3aef-4414-8c02-1329af5a99bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:42.532955 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e847ec-3aef-4414-8c02-1329af5a99bf admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:42.536668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57600904-084c-46a9-a8c9-dff43713b58f admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c232f225eb4ae09cbe18fc31a707d9, user_id=ffdeeb6e05af4db0aaa135e41bd21123, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:42.542075 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57600904-084c-46a9-a8c9-dff43713b58f admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:42.558728 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1277/2580] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:00:42 2022] PUT /identity/v3/projects/58c232f225eb4ae09cbe18fc31a707d9/users/ffdeeb6e05af4db0aaa135e41bd21123/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:00:42.565263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57600904-084c-46a9-a8c9-dff43713b58f admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:42.575632 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1304/2581] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:00:42 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 16:00:42.580510 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e847ec-3aef-4414-8c02-1329af5a99bf admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:42.648780 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57600904-084c-46a9-a8c9-dff43713b58f admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:42.654403 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:42.666868 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e847ec-3aef-4414-8c02-1329af5a99bf admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:42.674636 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cebe8-0740-4161-8f6c-bdec9843197e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:42.675746 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cebe8-0740-4161-8f6c-bdec9843197e admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:42.676394 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cebe8-0740-4161-8f6c-bdec9843197e admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:42.678294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cebe8-0740-4161-8f6c-bdec9843197e admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:42.681419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860cebe8-0740-4161-8f6c-bdec9843197e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:42.685010 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860cebe8-0740-4161-8f6c-bdec9843197e admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:42.716221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1305/2582] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:00:42 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:42.720713 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cebe8-0740-4161-8f6c-bdec9843197e admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:42.721573 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460a80d-eab1-4c09-91d5-f138f5203047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:42.722784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460a80d-eab1-4c09-91d5-f138f5203047 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:42.723304 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460a80d-eab1-4c09-91d5-f138f5203047 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:42.723713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460a80d-eab1-4c09-91d5-f138f5203047 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:42.725141 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460a80d-eab1-4c09-91d5-f138f5203047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:42.728247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460a80d-eab1-4c09-91d5-f138f5203047 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:42.731621 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cebe8-0740-4161-8f6c-bdec9843197e admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:42.737365 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4886309-a9a6-4ed3-af83-22292c011a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:42.738045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4886309-a9a6-4ed3-af83-22292c011a69 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:42.738337 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4886309-a9a6-4ed3-af83-22292c011a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:42.738615 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4886309-a9a6-4ed3-af83-22292c011a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:42.739381 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4886309-a9a6-4ed3-af83-22292c011a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:42.740981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4886309-a9a6-4ed3-af83-22292c011a69 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:42.748515 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1278/2583] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 16:00:42.754502 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460a80d-eab1-4c09-91d5-f138f5203047 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:42.758540 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1306/2584] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 16:00:42.760303 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4886309-a9a6-4ed3-af83-22292c011a69 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:42.765430 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460a80d-eab1-4c09-91d5-f138f5203047 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:42.770663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9de429-20e0-490c-b3d1-d42098ba5965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:42.771627 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9de429-20e0-490c-b3d1-d42098ba5965 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:42.771916 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9de429-20e0-490c-b3d1-d42098ba5965 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:42.772211 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9de429-20e0-490c-b3d1-d42098ba5965 admin admin] PATH_INFO: `/v3/projects/58c232f225eb4ae09cbe18fc31a707d9/users/ffdeeb6e05af4db0aaa135e41bd21123/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:42.774268 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9de429-20e0-490c-b3d1-d42098ba5965 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c232f225eb4ae09cbe18fc31a707d9, user_id=ffdeeb6e05af4db0aaa135e41bd21123, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:42.776937 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9de429-20e0-490c-b3d1-d42098ba5965 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:42.778651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4886309-a9a6-4ed3-af83-22292c011a69 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:42.786558 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc5a99-b482-4ecb-a6fa-1c9f3e642a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:42.787705 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc5a99-b482-4ecb-a6fa-1c9f3e642a42 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:42.788165 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc5a99-b482-4ecb-a6fa-1c9f3e642a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:42.788601 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1279/2585] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:00:42 2022] PUT /identity/v3/projects/58c232f225eb4ae09cbe18fc31a707d9/users/ffdeeb6e05af4db0aaa135e41bd21123/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:42.797360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fc5a99-b482-4ecb-a6fa-1c9f3e642a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:42.797360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc5a99-b482-4ecb-a6fa-1c9f3e642a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:42.797360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fc5a99-b482-4ecb-a6fa-1c9f3e642a42 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:42.800950 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:42.802025 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe7603-55a6-47d1-b466-d422ef569872 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:42.802476 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe7603-55a6-47d1-b466-d422ef569872 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:42.802797 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe7603-55a6-47d1-b466-d422ef569872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:42.810502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1307/2586] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 16:00:42.817881 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc5a99-b482-4ecb-a6fa-1c9f3e642a42 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:42.832374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fc5a99-b482-4ecb-a6fa-1c9f3e642a42 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:42.836890 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-3afe7603-55a6-47d1-b466-d422ef569872 None None] MFA Rules not processed for user `ffdeeb6e05af4db0aaa135e41bd21123`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:42.838166 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-3afe7603-55a6-47d1-b466-d422ef569872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:42.914529 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2613e-1d42-4411-8308-4027e13626c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:42.915554 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2613e-1d42-4411-8308-4027e13626c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:42.915841 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2613e-1d42-4411-8308-4027e13626c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:42.916126 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2613e-1d42-4411-8308-4027e13626c1 admin admin] PATH_INFO: `/v3/projects/1df24a8b44fe44c88ad643bf0302abd8/users/7b447d2d85fa4024b1fe1104059cc12e/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:42.918018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1280/2587] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:42.931028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe7603-55a6-47d1-b466-d422ef569872 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:42.933141 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-3afe7603-55a6-47d1-b466-d422ef569872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:42.934933 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2613e-1d42-4411-8308-4027e13626c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df24a8b44fe44c88ad643bf0302abd8, user_id=7b447d2d85fa4024b1fe1104059cc12e, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:42.937614 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2613e-1d42-4411-8308-4027e13626c1 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:42.954933 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1308/2588] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:00:42 2022] PUT /identity/v3/projects/1df24a8b44fe44c88ad643bf0302abd8/users/7b447d2d85fa4024b1fe1104059cc12e/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:00:42.965276 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ea18c-4d3b-49e3-abc1-a5471d10b850 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:42.965579 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ea18c-4d3b-49e3-abc1-a5471d10b850 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:42.965828 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ea18c-4d3b-49e3-abc1-a5471d10b850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:42.994628 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-806ea18c-4d3b-49e3-abc1-a5471d10b850 None None] MFA Rules not processed for user `7b447d2d85fa4024b1fe1104059cc12e`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:42.995896 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-806ea18c-4d3b-49e3-abc1-a5471d10b850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:43.023887 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe7603-55a6-47d1-b466-d422ef569872 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:43.066985 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:43.094620 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1309/2589] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:00:43.095730 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c24f3f-077f-4af8-837e-cc8f5d7bb878 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:43.096478 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c24f3f-077f-4af8-837e-cc8f5d7bb878 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:43.096772 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c24f3f-077f-4af8-837e-cc8f5d7bb878 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:43.097059 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c24f3f-077f-4af8-837e-cc8f5d7bb878 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:43.102394 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ea18c-4d3b-49e3-abc1-a5471d10b850 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:43.182472 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c24f3f-077f-4af8-837e-cc8f5d7bb878 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:43.185226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c24f3f-077f-4af8-837e-cc8f5d7bb878 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:43.199551 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ea18c-4d3b-49e3-abc1-a5471d10b850 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:43.202864 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1281/2590] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:00:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 16:00:43.208802 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a622a-0489-49d9-9d6e-9f81a2f24098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:43.210118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a622a-0489-49d9-9d6e-9f81a2f24098 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:43.210640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a622a-0489-49d9-9d6e-9f81a2f24098 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:43.211151 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a622a-0489-49d9-9d6e-9f81a2f24098 admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:43.212492 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a622a-0489-49d9-9d6e-9f81a2f24098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:43.215734 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a622a-0489-49d9-9d6e-9f81a2f24098 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:43.250634 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:43.274411 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1310/2591] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:00:43 2022] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:43.276240 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c24f3f-077f-4af8-837e-cc8f5d7bb878 service cinder] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:43.296697 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c24f3f-077f-4af8-837e-cc8f5d7bb878 service cinder] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:43.338116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a622a-0489-49d9-9d6e-9f81a2f24098 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:43.405530 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf7dd4-1332-44b1-8013-b5e9b26f0d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:43.406633 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf7dd4-1332-44b1-8013-b5e9b26f0d92 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:43.407389 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf7dd4-1332-44b1-8013-b5e9b26f0d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:43.408610 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf7dd4-1332-44b1-8013-b5e9b26f0d92 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:43.410077 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf7dd4-1332-44b1-8013-b5e9b26f0d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:43.413255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a622a-0489-49d9-9d6e-9f81a2f24098 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:43.413432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf7dd4-1332-44b1-8013-b5e9b26f0d92 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:43.418006 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ee291-3559-4935-a439-1af9e17e8d35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:43.418952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ee291-3559-4935-a439-1af9e17e8d35 service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:43.419419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ee291-3559-4935-a439-1af9e17e8d35 service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:43.419890 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ee291-3559-4935-a439-1af9e17e8d35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:43.421962 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-0f1ee291-3559-4935-a439-1af9e17e8d35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:43.448651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1282/2592] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:00:43 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 16:00:43.454007 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf7dd4-1332-44b1-8013-b5e9b26f0d92 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:43.467264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf7dd4-1332-44b1-8013-b5e9b26f0d92 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:43.474873 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c70ddc-86ca-4125-a3d6-1e66d84bd51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:43.475565 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c70ddc-86ca-4125-a3d6-1e66d84bd51b admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:43.475852 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c70ddc-86ca-4125-a3d6-1e66d84bd51b admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:43.476129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c70ddc-86ca-4125-a3d6-1e66d84bd51b admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:43.476870 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c70ddc-86ca-4125-a3d6-1e66d84bd51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:43.479224 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c70ddc-86ca-4125-a3d6-1e66d84bd51b admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:43.497488 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1283/2593] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:00:43.498988 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c70ddc-86ca-4125-a3d6-1e66d84bd51b admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:43.512976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c70ddc-86ca-4125-a3d6-1e66d84bd51b admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:43.517998 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ee291-3559-4935-a439-1af9e17e8d35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:43.520963 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ee291-3559-4935-a439-1af9e17e8d35 service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:43.521243 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a945cb-1143-4599-a052-80389e8d0876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:43.523708 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a945cb-1143-4599-a052-80389e8d0876 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:43.524281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a945cb-1143-4599-a052-80389e8d0876 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:43.524676 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a945cb-1143-4599-a052-80389e8d0876 admin admin] PATH_INFO: `/v3/projects/ef53041d1cd44827995401238da3d5bd/users/55e202e13d3b4f558e9161d408d0fbfa/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:43.542543 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1311/2594] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:00:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 16:00:43.563411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a945cb-1143-4599-a052-80389e8d0876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef53041d1cd44827995401238da3d5bd, user_id=55e202e13d3b4f558e9161d408d0fbfa, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:43.572226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a945cb-1143-4599-a052-80389e8d0876 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:43.594293 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1284/2595] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:00:43 2022] PUT /identity/v3/projects/ef53041d1cd44827995401238da3d5bd/users/55e202e13d3b4f558e9161d408d0fbfa/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:43.596463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ee291-3559-4935-a439-1af9e17e8d35 service cinder] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:43.610607 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ee291-3559-4935-a439-1af9e17e8d35 service cinder] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:43.718142 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e9eff-b9be-445e-883c-101c2fef9184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:43.720932 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e9eff-b9be-445e-883c-101c2fef9184 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:43.721843 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e9eff-b9be-445e-883c-101c2fef9184 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:43.722956 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e9eff-b9be-445e-883c-101c2fef9184 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:43.724595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e9eff-b9be-445e-883c-101c2fef9184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:43.727749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e9eff-b9be-445e-883c-101c2fef9184 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:43.747188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1312/2596] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:43 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:00:43.753575 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a945cb-1143-4599-a052-80389e8d0876 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:43.786182 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a945cb-1143-4599-a052-80389e8d0876 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:43.795395 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eec3b1-e7c5-4cf0-af04-e8b76fbd0bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:43.796957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eec3b1-e7c5-4cf0-af04-e8b76fbd0bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:43.797445 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eec3b1-e7c5-4cf0-af04-e8b76fbd0bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:43.798001 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eec3b1-e7c5-4cf0-af04-e8b76fbd0bfe admin admin] PATH_INFO: `/v3/projects/ef53041d1cd44827995401238da3d5bd/users/55e202e13d3b4f558e9161d408d0fbfa/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:43.802592 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eec3b1-e7c5-4cf0-af04-e8b76fbd0bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef53041d1cd44827995401238da3d5bd, user_id=55e202e13d3b4f558e9161d408d0fbfa, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:43.810422 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eec3b1-e7c5-4cf0-af04-e8b76fbd0bfe admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:43.835862 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1285/2597] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:00:43 2022] PUT /identity/v3/projects/ef53041d1cd44827995401238da3d5bd/users/55e202e13d3b4f558e9161d408d0fbfa/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:43.849646 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee3ee7-2325-484d-bac2-3f97093a5c0f None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:43.850256 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee3ee7-2325-484d-bac2-3f97093a5c0f None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:43.850798 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee3ee7-2325-484d-bac2-3f97093a5c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:43.884227 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-69ee3ee7-2325-484d-bac2-3f97093a5c0f None None] MFA Rules not processed for user `55e202e13d3b4f558e9161d408d0fbfa`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:43.885738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-69ee3ee7-2325-484d-bac2-3f97093a5c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:43.946642 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:43.997525 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1313/2598] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:43 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:00:44.011365 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eec3b1-e7c5-4cf0-af04-e8b76fbd0bfe admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:44.013022 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-03eec3b1-e7c5-4cf0-af04-e8b76fbd0bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:44.058392 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:44.117264 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eec3b1-e7c5-4cf0-af04-e8b76fbd0bfe admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:44.122755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b27760-4537-42e5-bf9f-213a728a571f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:44.123432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b27760-4537-42e5-bf9f-213a728a571f service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:44.123715 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b27760-4537-42e5-bf9f-213a728a571f service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:44.123991 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b27760-4537-42e5-bf9f-213a728a571f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:44.135659 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b27760-4537-42e5-bf9f-213a728a571f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:44.137180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b27760-4537-42e5-bf9f-213a728a571f service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:44.149640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1286/2599] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:00:44 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:00:44.631963 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee3ee7-2325-484d-bac2-3f97093a5c0f None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:44.728554 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee3ee7-2325-484d-bac2-3f97093a5c0f None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:44.737404 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b951d-0a0e-4915-93b5-92f09b90069f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:44.739108 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b951d-0a0e-4915-93b5-92f09b90069f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:44.739609 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b951d-0a0e-4915-93b5-92f09b90069f admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:44.740107 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b951d-0a0e-4915-93b5-92f09b90069f admin admin] PATH_INFO: `/v3/users/7b447d2d85fa4024b1fe1104059cc12e` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:44.742276 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b951d-0a0e-4915-93b5-92f09b90069f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b447d2d85fa4024b1fe1104059cc12e)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:44.745930 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b951d-0a0e-4915-93b5-92f09b90069f admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:44.811795 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8d5b951d-0a0e-4915-93b5-92f09b90069f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b447d2d85fa4024b1fe1104059cc12e'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:44.819081 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8d5b951d-0a0e-4915-93b5-92f09b90069f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b447d2d85fa4024b1fe1104059cc12e'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:44.819964 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8d5b951d-0a0e-4915-93b5-92f09b90069f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b447d2d85fa4024b1fe1104059cc12e'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:44.820685 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8d5b951d-0a0e-4915-93b5-92f09b90069f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b447d2d85fa4024b1fe1104059cc12e'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:44.834765 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8d5b951d-0a0e-4915-93b5-92f09b90069f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b447d2d85fa4024b1fe1104059cc12e'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:44.850457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1314/2600] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:00:44 2022] DELETE /identity/v3/users/7b447d2d85fa4024b1fe1104059cc12e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:00:44.855921 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0ee93-3899-43d4-aa5a-38d2a5fd60c7 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:44.856686 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0ee93-3899-43d4-aa5a-38d2a5fd60c7 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:44.856843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0ee93-3899-43d4-aa5a-38d2a5fd60c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:44.882160 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-cdf0ee93-3899-43d4-aa5a-38d2a5fd60c7 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:44.884202 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-cdf0ee93-3899-43d4-aa5a-38d2a5fd60c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:44.979744 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1287/2601] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:44.995288 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b951d-0a0e-4915-93b5-92f09b90069f admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:44.997043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-8d5b951d-0a0e-4915-93b5-92f09b90069f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:45.076627 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b951d-0a0e-4915-93b5-92f09b90069f admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:45.082532 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2e483-08db-4475-bdeb-18a051797760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:45.083345 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2e483-08db-4475-bdeb-18a051797760 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:45.083647 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2e483-08db-4475-bdeb-18a051797760 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:45.083817 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2e483-08db-4475-bdeb-18a051797760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:45.094872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:45.100531 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2e483-08db-4475-bdeb-18a051797760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:45.102508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2e483-08db-4475-bdeb-18a051797760 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:45.129969 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1315/2602] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:00:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:00:45.616345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0ee93-3899-43d4-aa5a-38d2a5fd60c7 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:45.618293 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-cdf0ee93-3899-43d4-aa5a-38d2a5fd60c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:45.637711 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0ee93-3899-43d4-aa5a-38d2a5fd60c7 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:45.643568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3b60f-e018-4456-8d43-7ad0ac18a408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:45.644474 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3b60f-e018-4456-8d43-7ad0ac18a408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:45.644764 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3b60f-e018-4456-8d43-7ad0ac18a408 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:45.645055 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3b60f-e018-4456-8d43-7ad0ac18a408 admin admin] PATH_INFO: `/v3/projects/1df24a8b44fe44c88ad643bf0302abd8` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:45.646559 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3b60f-e018-4456-8d43-7ad0ac18a408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1df24a8b44fe44c88ad643bf0302abd8)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:45.648669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3b60f-e018-4456-8d43-7ad0ac18a408 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:45.712941 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-16e3b60f-e018-4456-8d43-7ad0ac18a408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1df24a8b44fe44c88ad643bf0302abd8', 'request_id': 'req-16e3b60f-e018-4456-8d43-7ad0ac18a408'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:45.721903 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-16e3b60f-e018-4456-8d43-7ad0ac18a408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1df24a8b44fe44c88ad643bf0302abd8', 'request_id': 'req-16e3b60f-e018-4456-8d43-7ad0ac18a408'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:45.730573 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-16e3b60f-e018-4456-8d43-7ad0ac18a408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1df24a8b44fe44c88ad643bf0302abd8', 'request_id': 'req-16e3b60f-e018-4456-8d43-7ad0ac18a408'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:45.743004 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-16e3b60f-e018-4456-8d43-7ad0ac18a408 admin admin] The token cache is being invalidate because project 1df24a8b44fe44c88ad643bf0302abd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:00:45.743299 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-16e3b60f-e018-4456-8d43-7ad0ac18a408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:45.743973 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-16e3b60f-e018-4456-8d43-7ad0ac18a408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:45.745812 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1288/2603] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:00:45 2022] DELETE /identity/v3/projects/1df24a8b44fe44c88ad643bf0302abd8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:00:45.750188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2e483-08db-4475-bdeb-18a051797760 service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:45.762544 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2e483-08db-4475-bdeb-18a051797760 service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:45.829366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889fc1f-9440-41bb-82f4-51a62ff13ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:45.830294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889fc1f-9440-41bb-82f4-51a62ff13ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:45.830576 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889fc1f-9440-41bb-82f4-51a62ff13ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:45.830856 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889fc1f-9440-41bb-82f4-51a62ff13ee9 admin admin] PATH_INFO: `/v3/users/55e202e13d3b4f558e9161d408d0fbfa` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:45.832213 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889fc1f-9440-41bb-82f4-51a62ff13ee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55e202e13d3b4f558e9161d408d0fbfa)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:45.834110 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889fc1f-9440-41bb-82f4-51a62ff13ee9 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:45.889169 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1889fc1f-9440-41bb-82f4-51a62ff13ee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55e202e13d3b4f558e9161d408d0fbfa'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:45.898971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1889fc1f-9440-41bb-82f4-51a62ff13ee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55e202e13d3b4f558e9161d408d0fbfa'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:45.899921 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1889fc1f-9440-41bb-82f4-51a62ff13ee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55e202e13d3b4f558e9161d408d0fbfa'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:45.901038 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1889fc1f-9440-41bb-82f4-51a62ff13ee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55e202e13d3b4f558e9161d408d0fbfa'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:45.916920 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1889fc1f-9440-41bb-82f4-51a62ff13ee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55e202e13d3b4f558e9161d408d0fbfa'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:45.932333 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1316/2604] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:00:45 2022] DELETE /identity/v3/users/55e202e13d3b4f558e9161d408d0fbfa => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:46.274310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3b60f-e018-4456-8d43-7ad0ac18a408 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:46.276401 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-16e3b60f-e018-4456-8d43-7ad0ac18a408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:46.298888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3b60f-e018-4456-8d43-7ad0ac18a408 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:46.362225 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:46.375387 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37e48e-88ed-4c4d-b327-0064efaae913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:46.376998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37e48e-88ed-4c4d-b327-0064efaae913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:46.377659 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37e48e-88ed-4c4d-b327-0064efaae913 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:46.378098 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37e48e-88ed-4c4d-b327-0064efaae913 admin admin] PATH_INFO: `/v3/projects/ef53041d1cd44827995401238da3d5bd` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:46.379924 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37e48e-88ed-4c4d-b327-0064efaae913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef53041d1cd44827995401238da3d5bd)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:46.382343 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37e48e-88ed-4c4d-b327-0064efaae913 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:46.452701 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ee37e48e-88ed-4c4d-b327-0064efaae913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef53041d1cd44827995401238da3d5bd', 'request_id': 'req-ee37e48e-88ed-4c4d-b327-0064efaae913'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:46.464155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ee37e48e-88ed-4c4d-b327-0064efaae913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef53041d1cd44827995401238da3d5bd', 'request_id': 'req-ee37e48e-88ed-4c4d-b327-0064efaae913'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:46.471938 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ee37e48e-88ed-4c4d-b327-0064efaae913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef53041d1cd44827995401238da3d5bd', 'request_id': 'req-ee37e48e-88ed-4c4d-b327-0064efaae913'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:46.488950 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ee37e48e-88ed-4c4d-b327-0064efaae913 admin admin] The token cache is being invalidate because project ef53041d1cd44827995401238da3d5bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:00:46.489476 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ee37e48e-88ed-4c4d-b327-0064efaae913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:46.490477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ee37e48e-88ed-4c4d-b327-0064efaae913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:46.493066 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1289/2605] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:00:46 2022] DELETE /identity/v3/projects/ef53041d1cd44827995401238da3d5bd => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:00:46.500301 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fa391-d956-44ba-b91b-69663474e701 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:46.500857 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fa391-d956-44ba-b91b-69663474e701 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:46.501885 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fa391-d956-44ba-b91b-69663474e701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:46.533615 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-067fa391-d956-44ba-b91b-69663474e701 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:46.535332 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-067fa391-d956-44ba-b91b-69663474e701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:46.657940 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1317/2606] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:46.670241 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d3ab0-1d39-4641-8d83-aab2e4a41697 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:46.670710 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d3ab0-1d39-4641-8d83-aab2e4a41697 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:46.671132 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d3ab0-1d39-4641-8d83-aab2e4a41697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:46.701528 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-ff5d3ab0-1d39-4641-8d83-aab2e4a41697 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:46.704119 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-ff5d3ab0-1d39-4641-8d83-aab2e4a41697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:46.717779 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1290/2607] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:00:46.722714 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fa391-d956-44ba-b91b-69663474e701 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:46.738110 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fa391-d956-44ba-b91b-69663474e701 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:46.746339 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6ffd9-b477-41c7-b7d5-ade6a536ba2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:46.747744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6ffd9-b477-41c7-b7d5-ade6a536ba2f admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:46.748314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6ffd9-b477-41c7-b7d5-ade6a536ba2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:46.748807 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6ffd9-b477-41c7-b7d5-ade6a536ba2f admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:46.750035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6ffd9-b477-41c7-b7d5-ade6a536ba2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:00:46.750473 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6ffd9-b477-41c7-b7d5-ade6a536ba2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:46.754462 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6ffd9-b477-41c7-b7d5-ade6a536ba2f admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:46.775586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1318/2608] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 16:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:00:46.780196 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d3ab0-1d39-4641-8d83-aab2e4a41697 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:46.796877 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d3ab0-1d39-4641-8d83-aab2e4a41697 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:46.807427 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6c7a3-5499-42a2-85f5-60687843367f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:46.808970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6c7a3-5499-42a2-85f5-60687843367f admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:46.809719 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6c7a3-5499-42a2-85f5-60687843367f admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:46.810549 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6c7a3-5499-42a2-85f5-60687843367f admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:46.812200 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6c7a3-5499-42a2-85f5-60687843367f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:46.816636 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6c7a3-5499-42a2-85f5-60687843367f admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:46.885948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1291/2609] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:00:46 2022] POST /identity/v3/projects => generated 365 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:46.888565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6ffd9-b477-41c7-b7d5-ade6a536ba2f admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:46.897304 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:46.905625 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6ffd9-b477-41c7-b7d5-ade6a536ba2f admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:47.018754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39891722-53d7-4100-a42c-a8c218efd72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:47.019779 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39891722-53d7-4100-a42c-a8c218efd72a admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:47.020068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39891722-53d7-4100-a42c-a8c218efd72a admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:47.020358 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39891722-53d7-4100-a42c-a8c218efd72a admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:47.021072 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39891722-53d7-4100-a42c-a8c218efd72a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:47.023118 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39891722-53d7-4100-a42c-a8c218efd72a admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:47.059844 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1319/2610] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:00:46 2022] POST /identity/v3/users => generated 283 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:47.061330 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6c7a3-5499-42a2-85f5-60687843367f admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:47.074213 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6c7a3-5499-42a2-85f5-60687843367f admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:47.080370 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbd275-a678-49a6-b3ab-05606e647273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:47.081136 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbd275-a678-49a6-b3ab-05606e647273 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:47.081426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbd275-a678-49a6-b3ab-05606e647273 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:47.081717 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbd275-a678-49a6-b3ab-05606e647273 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:47.082521 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbbd275-a678-49a6-b3ab-05606e647273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:47.084348 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbbd275-a678-49a6-b3ab-05606e647273 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:47.097642 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1292/2611] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:00:47.102321 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39891722-53d7-4100-a42c-a8c218efd72a admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:47.114396 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39891722-53d7-4100-a42c-a8c218efd72a admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:47.119685 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf843af-7996-4bbd-9efd-6073bfa66470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:47.120384 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf843af-7996-4bbd-9efd-6073bfa66470 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:47.120677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf843af-7996-4bbd-9efd-6073bfa66470 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:47.120956 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf843af-7996-4bbd-9efd-6073bfa66470 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:47.121711 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf843af-7996-4bbd-9efd-6073bfa66470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:47.123425 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf843af-7996-4bbd-9efd-6073bfa66470 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:47.135554 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1320/2612] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:00:47.141674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbd275-a678-49a6-b3ab-05606e647273 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:47.153060 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbd275-a678-49a6-b3ab-05606e647273 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:47.159416 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a1c0c-e613-4de0-9cef-dce44c47544d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:47.160358 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a1c0c-e613-4de0-9cef-dce44c47544d admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:47.160648 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a1c0c-e613-4de0-9cef-dce44c47544d admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:47.160931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a1c0c-e613-4de0-9cef-dce44c47544d admin admin] PATH_INFO: `/v3/projects/b41acc8af35147839279ce66bb9f7a46/users/7568b5bfbc784ea8a174ecd1d424a340/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:47.179320 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a1c0c-e613-4de0-9cef-dce44c47544d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b41acc8af35147839279ce66bb9f7a46, user_id=7568b5bfbc784ea8a174ecd1d424a340, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:47.182131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a1c0c-e613-4de0-9cef-dce44c47544d admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:47.198974 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1293/2613] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:00:47 2022] PUT /identity/v3/projects/b41acc8af35147839279ce66bb9f7a46/users/7568b5bfbc784ea8a174ecd1d424a340/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:00:47.211887 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f32e6-07e9-422e-97e8-6db7a4be0b04 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:47.212402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f32e6-07e9-422e-97e8-6db7a4be0b04 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:47.212887 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f32e6-07e9-422e-97e8-6db7a4be0b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:47.259107 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-164f32e6-07e9-422e-97e8-6db7a4be0b04 None None] MFA Rules not processed for user `7568b5bfbc784ea8a174ecd1d424a340`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:47.260551 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-164f32e6-07e9-422e-97e8-6db7a4be0b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:47.355928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1321/2614] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:47.361998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a1c0c-e613-4de0-9cef-dce44c47544d admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:47.442288 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a1c0c-e613-4de0-9cef-dce44c47544d admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:47.448859 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117e2d9-4b95-443f-b254-12976352969d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:47.449812 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117e2d9-4b95-443f-b254-12976352969d admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:47.450254 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117e2d9-4b95-443f-b254-12976352969d admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:47.450632 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117e2d9-4b95-443f-b254-12976352969d admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:47.451571 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117e2d9-4b95-443f-b254-12976352969d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:47.454079 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117e2d9-4b95-443f-b254-12976352969d admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:47.485526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1294/2615] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:00:47 2022] POST /identity/v3/projects => generated 363 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:47.491453 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f32e6-07e9-422e-97e8-6db7a4be0b04 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:47.503533 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f32e6-07e9-422e-97e8-6db7a4be0b04 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:47.577740 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60768b-c0f3-4a70-b392-ab6a99c7dd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:47.578479 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60768b-c0f3-4a70-b392-ab6a99c7dd7f admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:47.578776 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60768b-c0f3-4a70-b392-ab6a99c7dd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:47.579059 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60768b-c0f3-4a70-b392-ab6a99c7dd7f admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:47.580342 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60768b-c0f3-4a70-b392-ab6a99c7dd7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:47.583237 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60768b-c0f3-4a70-b392-ab6a99c7dd7f admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:47.602172 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:47.610627 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1322/2616] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:00:47 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:00:47.616376 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117e2d9-4b95-443f-b254-12976352969d admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:47.622614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:47.631822 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117e2d9-4b95-443f-b254-12976352969d admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:47.639786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f84671-bcbd-435e-82d6-82f3cda44b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:47.640698 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f84671-bcbd-435e-82d6-82f3cda44b30 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:47.641131 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f84671-bcbd-435e-82d6-82f3cda44b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:47.641496 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f84671-bcbd-435e-82d6-82f3cda44b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:47.642988 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f84671-bcbd-435e-82d6-82f3cda44b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:47.644731 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f84671-bcbd-435e-82d6-82f3cda44b30 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:47.657535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1295/2617] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:00:47.663502 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60768b-c0f3-4a70-b392-ab6a99c7dd7f admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:47.674900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60768b-c0f3-4a70-b392-ab6a99c7dd7f admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:47.682273 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee611617-668d-4da9-9c97-dc3a661072b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:47.683249 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee611617-668d-4da9-9c97-dc3a661072b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:47.683572 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee611617-668d-4da9-9c97-dc3a661072b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:47.683895 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee611617-668d-4da9-9c97-dc3a661072b1 admin admin] PATH_INFO: `/v3/projects/c6f7f55790164613af6f9dc9033cd091/users/1c543adaaff54a0a86a6422591e1a260/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:47.703792 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee611617-668d-4da9-9c97-dc3a661072b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f7f55790164613af6f9dc9033cd091, user_id=1c543adaaff54a0a86a6422591e1a260, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:47.707662 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee611617-668d-4da9-9c97-dc3a661072b1 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:47.723377 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1323/2618] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:00:47 2022] PUT /identity/v3/projects/c6f7f55790164613af6f9dc9033cd091/users/1c543adaaff54a0a86a6422591e1a260/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:47.727960 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f84671-bcbd-435e-82d6-82f3cda44b30 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:47.739642 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f84671-bcbd-435e-82d6-82f3cda44b30 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:47.810776 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da98ddb-662b-402a-9986-096407338992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:47.811468 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da98ddb-662b-402a-9986-096407338992 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:47.811756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da98ddb-662b-402a-9986-096407338992 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:47.812042 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da98ddb-662b-402a-9986-096407338992 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:47.812820 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da98ddb-662b-402a-9986-096407338992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:47.815051 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da98ddb-662b-402a-9986-096407338992 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:47.826758 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1296/2619] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:00:47.832140 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee611617-668d-4da9-9c97-dc3a661072b1 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:47.843376 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee611617-668d-4da9-9c97-dc3a661072b1 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:47.848357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29eb17-e9dd-4f89-ae8f-e0f675e069ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:47.849273 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29eb17-e9dd-4f89-ae8f-e0f675e069ef admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:47.849558 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29eb17-e9dd-4f89-ae8f-e0f675e069ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:47.849838 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29eb17-e9dd-4f89-ae8f-e0f675e069ef admin admin] PATH_INFO: `/v3/projects/c6f7f55790164613af6f9dc9033cd091/users/1c543adaaff54a0a86a6422591e1a260/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:47.851967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29eb17-e9dd-4f89-ae8f-e0f675e069ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f7f55790164613af6f9dc9033cd091, user_id=1c543adaaff54a0a86a6422591e1a260, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:47.854707 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29eb17-e9dd-4f89-ae8f-e0f675e069ef admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:47.867040 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1324/2620] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:00:47 2022] PUT /identity/v3/projects/c6f7f55790164613af6f9dc9033cd091/users/1c543adaaff54a0a86a6422591e1a260/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:47.878845 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bdd82-250c-457b-8113-a0621cc94bc6 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:47.879272 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bdd82-250c-457b-8113-a0621cc94bc6 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:47.879671 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bdd82-250c-457b-8113-a0621cc94bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:47.919508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-982bdd82-250c-457b-8113-a0621cc94bc6 None None] MFA Rules not processed for user `1c543adaaff54a0a86a6422591e1a260`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:47.920769 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-982bdd82-250c-457b-8113-a0621cc94bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:48.028439 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1297/2621] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:47 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:48.054925 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29eb17-e9dd-4f89-ae8f-e0f675e069ef admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:48.057362 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-7d29eb17-e9dd-4f89-ae8f-e0f675e069ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:48.162833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29eb17-e9dd-4f89-ae8f-e0f675e069ef admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:48.174562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff25dfa-7802-4a6b-adf3-7615b858f583 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:48.175722 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff25dfa-7802-4a6b-adf3-7615b858f583 service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:48.176244 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff25dfa-7802-4a6b-adf3-7615b858f583 service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:48.176757 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff25dfa-7802-4a6b-adf3-7615b858f583 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:48.194851 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff25dfa-7802-4a6b-adf3-7615b858f583 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:48.197681 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff25dfa-7802-4a6b-adf3-7615b858f583 service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:48.215176 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1325/2622] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:00:48 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:00:48.440530 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bdd82-250c-457b-8113-a0621cc94bc6 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:48.456148 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bdd82-250c-457b-8113-a0621cc94bc6 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:48.461887 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15f2ab-6d64-4786-ae99-858779eee3be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:48.462755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15f2ab-6d64-4786-ae99-858779eee3be service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:48.463245 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15f2ab-6d64-4786-ae99-858779eee3be service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:48.463701 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15f2ab-6d64-4786-ae99-858779eee3be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:48.558310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15f2ab-6d64-4786-ae99-858779eee3be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:48.560001 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15f2ab-6d64-4786-ae99-858779eee3be service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:48.573178 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1298/2623] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:00:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:00:55.321063 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff25dfa-7802-4a6b-adf3-7615b858f583 service cinder] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:55.323941 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-2ff25dfa-7802-4a6b-adf3-7615b858f583 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:55.483959 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff25dfa-7802-4a6b-adf3-7615b858f583 service cinder] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:55.493124 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3734a4-e78f-479c-8849-e6b96aad5729 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:55.493741 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3734a4-e78f-479c-8849-e6b96aad5729 service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:55.494324 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3734a4-e78f-479c-8849-e6b96aad5729 service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:55.494856 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3734a4-e78f-479c-8849-e6b96aad5729 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:55.498624 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-4c3734a4-e78f-479c-8849-e6b96aad5729 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:55.671786 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3734a4-e78f-479c-8849-e6b96aad5729 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:55.675985 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3734a4-e78f-479c-8849-e6b96aad5729 service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:55.696649 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1326/2624] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:00:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:00:56.959238 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15f2ab-6d64-4786-ae99-858779eee3be service cinder] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:56.994069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:57.131828 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15f2ab-6d64-4786-ae99-858779eee3be service cinder] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:57.172315 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e795f-14e4-47d2-a63a-2bb7b18b678f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:57.173595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e795f-14e4-47d2-a63a-2bb7b18b678f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:57.179645 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e795f-14e4-47d2-a63a-2bb7b18b678f admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:57.182394 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e795f-14e4-47d2-a63a-2bb7b18b678f admin admin] PATH_INFO: `/v3/users/7568b5bfbc784ea8a174ecd1d424a340` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:57.185953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e795f-14e4-47d2-a63a-2bb7b18b678f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7568b5bfbc784ea8a174ecd1d424a340)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:57.188064 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e795f-14e4-47d2-a63a-2bb7b18b678f admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:57.340298 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-1d9e795f-14e4-47d2-a63a-2bb7b18b678f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7568b5bfbc784ea8a174ecd1d424a340'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:57.378999 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-1d9e795f-14e4-47d2-a63a-2bb7b18b678f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7568b5bfbc784ea8a174ecd1d424a340'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:57.380260 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-1d9e795f-14e4-47d2-a63a-2bb7b18b678f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7568b5bfbc784ea8a174ecd1d424a340'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:57.381272 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-1d9e795f-14e4-47d2-a63a-2bb7b18b678f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7568b5bfbc784ea8a174ecd1d424a340'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:57.426615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-1d9e795f-14e4-47d2-a63a-2bb7b18b678f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7568b5bfbc784ea8a174ecd1d424a340'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:57.475373 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1299/2625] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:00:56 2022] DELETE /identity/v3/users/7568b5bfbc784ea8a174ecd1d424a340 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:00:57.483146 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57561c98-f811-43f7-afd6-d2ac7c324b14 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:57.484565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57561c98-f811-43f7-afd6-d2ac7c324b14 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:57.485466 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57561c98-f811-43f7-afd6-d2ac7c324b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:57.500003 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:57.540995 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-57561c98-f811-43f7-afd6-d2ac7c324b14 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:00:57.544845 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-57561c98-f811-43f7-afd6-d2ac7c324b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:57.677561 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1327/2626] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:00:57.694153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e795f-14e4-47d2-a63a-2bb7b18b678f admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:57.697177 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-1d9e795f-14e4-47d2-a63a-2bb7b18b678f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:57.861449 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e795f-14e4-47d2-a63a-2bb7b18b678f admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:57.869754 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efc0ac-79fb-4a32-bc77-5b37d4c475a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:57.870485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efc0ac-79fb-4a32-bc77-5b37d4c475a5 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:57.870777 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efc0ac-79fb-4a32-bc77-5b37d4c475a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:57.871078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efc0ac-79fb-4a32-bc77-5b37d4c475a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:57.904154 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efc0ac-79fb-4a32-bc77-5b37d4c475a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:57.905646 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efc0ac-79fb-4a32-bc77-5b37d4c475a5 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:57.933915 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1300/2627] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:00:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:00:59.017390 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57561c98-f811-43f7-afd6-d2ac7c324b14 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:59.024940 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-57561c98-f811-43f7-afd6-d2ac7c324b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:59.063766 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57561c98-f811-43f7-afd6-d2ac7c324b14 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:59.071712 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9df11-96bd-4f6b-9284-280a3811e5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:59.073030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9df11-96bd-4f6b-9284-280a3811e5ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:59.073521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9df11-96bd-4f6b-9284-280a3811e5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:59.074080 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9df11-96bd-4f6b-9284-280a3811e5ae admin admin] PATH_INFO: `/v3/projects/b41acc8af35147839279ce66bb9f7a46` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:59.075882 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9df11-96bd-4f6b-9284-280a3811e5ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=b41acc8af35147839279ce66bb9f7a46)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:59.078385 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9df11-96bd-4f6b-9284-280a3811e5ae admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:59.230651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-91b9df11-96bd-4f6b-9284-280a3811e5ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b41acc8af35147839279ce66bb9f7a46', 'request_id': 'req-91b9df11-96bd-4f6b-9284-280a3811e5ae'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:59.254944 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-91b9df11-96bd-4f6b-9284-280a3811e5ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b41acc8af35147839279ce66bb9f7a46', 'request_id': 'req-91b9df11-96bd-4f6b-9284-280a3811e5ae'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:59.270892 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-91b9df11-96bd-4f6b-9284-280a3811e5ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b41acc8af35147839279ce66bb9f7a46', 'request_id': 'req-91b9df11-96bd-4f6b-9284-280a3811e5ae'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:59.288923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efc0ac-79fb-4a32-bc77-5b37d4c475a5 service neutron] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:59.291429 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-40efc0ac-79fb-4a32-bc77-5b37d4c475a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:59.312941 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-91b9df11-96bd-4f6b-9284-280a3811e5ae admin admin] The token cache is being invalidate because project b41acc8af35147839279ce66bb9f7a46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:00:59.315817 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-91b9df11-96bd-4f6b-9284-280a3811e5ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:59.317703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-91b9df11-96bd-4f6b-9284-280a3811e5ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:59.320428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1328/2628] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:00:59 2022] DELETE /identity/v3/projects/b41acc8af35147839279ce66bb9f7a46 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:00:59.326125 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9df11-96bd-4f6b-9284-280a3811e5ae admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:00:59.328065 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-91b9df11-96bd-4f6b-9284-280a3811e5ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:00:59.344401 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efc0ac-79fb-4a32-bc77-5b37d4c475a5 service neutron] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:59.439134 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:59.457817 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9df11-96bd-4f6b-9284-280a3811e5ae admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:00:59.477491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1e2d8-17f3-4854-bf1a-1317e206194a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:59.479276 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1e2d8-17f3-4854-bf1a-1317e206194a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:59.479791 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1e2d8-17f3-4854-bf1a-1317e206194a admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:59.480287 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1e2d8-17f3-4854-bf1a-1317e206194a admin admin] PATH_INFO: `/v3/users/1c543adaaff54a0a86a6422591e1a260` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:59.483088 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1e2d8-17f3-4854-bf1a-1317e206194a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c543adaaff54a0a86a6422591e1a260)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:59.490692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1e2d8-17f3-4854-bf1a-1317e206194a admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:59.513239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ed6ca-37ee-4c96-b812-5c8dde86ea50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:00:59.514577 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ed6ca-37ee-4c96-b812-5c8dde86ea50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:00:59.515029 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ed6ca-37ee-4c96-b812-5c8dde86ea50 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:00:59.515492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ed6ca-37ee-4c96-b812-5c8dde86ea50 admin admin] PATH_INFO: `/v3/users/4c6b3eeb9e564526816f707769fca5c0` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:00:59.518228 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ed6ca-37ee-4c96-b812-5c8dde86ea50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c6b3eeb9e564526816f707769fca5c0)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:00:59.520699 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ed6ca-37ee-4c96-b812-5c8dde86ea50 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:00:59.573633 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:59.599821 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-3db1e2d8-17f3-4854-bf1a-1317e206194a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c543adaaff54a0a86a6422591e1a260'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:59.612829 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-3db1e2d8-17f3-4854-bf1a-1317e206194a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c543adaaff54a0a86a6422591e1a260'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:59.615407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-3db1e2d8-17f3-4854-bf1a-1317e206194a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c543adaaff54a0a86a6422591e1a260'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:59.617736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-3db1e2d8-17f3-4854-bf1a-1317e206194a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c543adaaff54a0a86a6422591e1a260'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:59.646002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-3db1e2d8-17f3-4854-bf1a-1317e206194a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c543adaaff54a0a86a6422591e1a260'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:59.650266 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-478ed6ca-37ee-4c96-b812-5c8dde86ea50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c6b3eeb9e564526816f707769fca5c0'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:59.663580 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-478ed6ca-37ee-4c96-b812-5c8dde86ea50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c6b3eeb9e564526816f707769fca5c0'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:59.664442 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-478ed6ca-37ee-4c96-b812-5c8dde86ea50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c6b3eeb9e564526816f707769fca5c0'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:59.665118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-478ed6ca-37ee-4c96-b812-5c8dde86ea50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c6b3eeb9e564526816f707769fca5c0'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:59.681073 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1329/2629] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:00:59 2022] DELETE /identity/v3/users/1c543adaaff54a0a86a6422591e1a260 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:00:59.696989 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-478ed6ca-37ee-4c96-b812-5c8dde86ea50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c6b3eeb9e564526816f707769fca5c0'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:00:59.726271 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1301/2630] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:00:59 2022] DELETE /identity/v3/users/4c6b3eeb9e564526816f707769fca5c0 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:01:00.007711 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1e2d8-17f3-4854-bf1a-1317e206194a admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:00.010186 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-3db1e2d8-17f3-4854-bf1a-1317e206194a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:00.181566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1e2d8-17f3-4854-bf1a-1317e206194a admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:00.339290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb1470-8190-41ed-9994-22a18cffbede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:00.342664 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb1470-8190-41ed-9994-22a18cffbede admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:00.343794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb1470-8190-41ed-9994-22a18cffbede admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:00.344245 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcb1470-8190-41ed-9994-22a18cffbede admin admin] PATH_INFO: `/v3/projects/a6f2551c582d4224a6c6ce8e42651a1a` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:00.346564 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb1470-8190-41ed-9994-22a18cffbede admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6f2551c582d4224a6c6ce8e42651a1a)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:00.349440 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcb1470-8190-41ed-9994-22a18cffbede admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:00.392224 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ed6ca-37ee-4c96-b812-5c8dde86ea50 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:00.395673 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-478ed6ca-37ee-4c96-b812-5c8dde86ea50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:00.432134 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ed6ca-37ee-4c96-b812-5c8dde86ea50 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:00.446848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1fcb1470-8190-41ed-9994-22a18cffbede admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6f2551c582d4224a6c6ce8e42651a1a', 'request_id': 'req-1fcb1470-8190-41ed-9994-22a18cffbede'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:00.455933 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1fcb1470-8190-41ed-9994-22a18cffbede admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6f2551c582d4224a6c6ce8e42651a1a', 'request_id': 'req-1fcb1470-8190-41ed-9994-22a18cffbede'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:00.459847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:00.481714 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1fcb1470-8190-41ed-9994-22a18cffbede admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6f2551c582d4224a6c6ce8e42651a1a', 'request_id': 'req-1fcb1470-8190-41ed-9994-22a18cffbede'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:00.511971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1fcb1470-8190-41ed-9994-22a18cffbede admin admin] The token cache is being invalidate because project a6f2551c582d4224a6c6ce8e42651a1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:01:00.513026 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1fcb1470-8190-41ed-9994-22a18cffbede admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:00.514624 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-1fcb1470-8190-41ed-9994-22a18cffbede admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:00.517679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1330/2631] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:01:00 2022] DELETE /identity/v3/projects/a6f2551c582d4224a6c6ce8e42651a1a => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:00.522562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb1470-8190-41ed-9994-22a18cffbede admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:00.528365 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-1fcb1470-8190-41ed-9994-22a18cffbede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:00.567268 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c06f8a-d141-49c5-9692-aa8ab879cfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:00.568961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c06f8a-d141-49c5-9692-aa8ab879cfcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:00.569577 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c06f8a-d141-49c5-9692-aa8ab879cfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:00.570117 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c06f8a-d141-49c5-9692-aa8ab879cfcd admin admin] PATH_INFO: `/v3/projects/c6f7f55790164613af6f9dc9033cd091` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:00.572397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c06f8a-d141-49c5-9692-aa8ab879cfcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6f7f55790164613af6f9dc9033cd091)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:00.579004 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c06f8a-d141-49c5-9692-aa8ab879cfcd admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:00.675070 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcb1470-8190-41ed-9994-22a18cffbede admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:00.679567 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-63c06f8a-d141-49c5-9692-aa8ab879cfcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6f7f55790164613af6f9dc9033cd091', 'request_id': 'req-63c06f8a-d141-49c5-9692-aa8ab879cfcd'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:00.689147 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:00.694561 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-63c06f8a-d141-49c5-9692-aa8ab879cfcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6f7f55790164613af6f9dc9033cd091', 'request_id': 'req-63c06f8a-d141-49c5-9692-aa8ab879cfcd'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:00.720792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-63c06f8a-d141-49c5-9692-aa8ab879cfcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6f7f55790164613af6f9dc9033cd091', 'request_id': 'req-63c06f8a-d141-49c5-9692-aa8ab879cfcd'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:00.738251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-63c06f8a-d141-49c5-9692-aa8ab879cfcd admin admin] The token cache is being invalidate because project c6f7f55790164613af6f9dc9033cd091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:01:00.738547 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-63c06f8a-d141-49c5-9692-aa8ab879cfcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:00.739412 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-63c06f8a-d141-49c5-9692-aa8ab879cfcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:00.741902 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1302/2632] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:01:00 2022] DELETE /identity/v3/projects/c6f7f55790164613af6f9dc9033cd091 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:00.749153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c0c46-7ba2-4e8f-816c-38cf7ae11b84 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:00.749808 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c0c46-7ba2-4e8f-816c-38cf7ae11b84 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:00.750694 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c0c46-7ba2-4e8f-816c-38cf7ae11b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:00.757343 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d09ca1-cefc-4aa0-97bb-086b9d38922f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:00.758419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d09ca1-cefc-4aa0-97bb-086b9d38922f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:00.758775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d09ca1-cefc-4aa0-97bb-086b9d38922f admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:00.759127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d09ca1-cefc-4aa0-97bb-086b9d38922f admin admin] PATH_INFO: `/v3/users/9a222573bcf943f7beaf9df85198682a` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:00.760677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d09ca1-cefc-4aa0-97bb-086b9d38922f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a222573bcf943f7beaf9df85198682a)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:00.762831 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d09ca1-cefc-4aa0-97bb-086b9d38922f admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:00.773278 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-5a6c0c46-7ba2-4e8f-816c-38cf7ae11b84 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:00.775202 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-5a6c0c46-7ba2-4e8f-816c-38cf7ae11b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:00.789101 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1303/2633] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:00.797578 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fc2c4-babc-4444-b4db-42a85550beaa None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:00.798750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fc2c4-babc-4444-b4db-42a85550beaa None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:00.799570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fc2c4-babc-4444-b4db-42a85550beaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:00.845529 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-b87fc2c4-babc-4444-b4db-42a85550beaa None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:00.847808 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-b87fc2c4-babc-4444-b4db-42a85550beaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:00.864390 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1304/2634] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:01:00.870272 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fc2c4-babc-4444-b4db-42a85550beaa None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:00.875145 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-66d09ca1-cefc-4aa0-97bb-086b9d38922f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a222573bcf943f7beaf9df85198682a'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:00.886745 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fc2c4-babc-4444-b4db-42a85550beaa None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:00.888364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-66d09ca1-cefc-4aa0-97bb-086b9d38922f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a222573bcf943f7beaf9df85198682a'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:00.889209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-66d09ca1-cefc-4aa0-97bb-086b9d38922f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a222573bcf943f7beaf9df85198682a'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:00.890019 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-66d09ca1-cefc-4aa0-97bb-086b9d38922f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a222573bcf943f7beaf9df85198682a'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:00.895159 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177583b8-3e5e-4cb4-a0e3-847d3cebc9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:00.896199 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177583b8-3e5e-4cb4-a0e3-847d3cebc9b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:00.896697 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177583b8-3e5e-4cb4-a0e3-847d3cebc9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:00.897250 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177583b8-3e5e-4cb4-a0e3-847d3cebc9b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:00.898504 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177583b8-3e5e-4cb4-a0e3-847d3cebc9b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:01:00.899047 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177583b8-3e5e-4cb4-a0e3-847d3cebc9b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:00.901529 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177583b8-3e5e-4cb4-a0e3-847d3cebc9b9 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:00.915587 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-66d09ca1-cefc-4aa0-97bb-086b9d38922f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a222573bcf943f7beaf9df85198682a'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:00.919598 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1305/2635] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 16:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:01:00.925705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177583b8-3e5e-4cb4-a0e3-847d3cebc9b9 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:00.928086 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-177583b8-3e5e-4cb4-a0e3-847d3cebc9b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:00.939402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1331/2636] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:01:00 2022] DELETE /identity/v3/users/9a222573bcf943f7beaf9df85198682a => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:00.950062 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177583b8-3e5e-4cb4-a0e3-847d3cebc9b9 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:01.035846 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c7658-5808-42ba-bb1d-840c04323152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:01.036857 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c7658-5808-42ba-bb1d-840c04323152 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:01.037363 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c7658-5808-42ba-bb1d-840c04323152 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:01.038530 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c7658-5808-42ba-bb1d-840c04323152 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:01.039509 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c7658-5808-42ba-bb1d-840c04323152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:01.041657 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c7658-5808-42ba-bb1d-840c04323152 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:01.087650 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1306/2637] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:01:00 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 16:01:01.099447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d09ca1-cefc-4aa0-97bb-086b9d38922f admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:01.120767 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d09ca1-cefc-4aa0-97bb-086b9d38922f admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:01.127613 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:01.208710 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd8af0-a784-4a66-9099-3bdf48049ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:01.209466 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd8af0-a784-4a66-9099-3bdf48049ecf admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:01.209830 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd8af0-a784-4a66-9099-3bdf48049ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:01.210457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd8af0-a784-4a66-9099-3bdf48049ecf admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:01.211079 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd8af0-a784-4a66-9099-3bdf48049ecf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:01.219079 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd8af0-a784-4a66-9099-3bdf48049ecf admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:01.232820 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c7658-5808-42ba-bb1d-840c04323152 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:01.236469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-db8c7658-5808-42ba-bb1d-840c04323152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:01.252685 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1332/2638] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:01:01 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:01:01.259120 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd8af0-a784-4a66-9099-3bdf48049ecf admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:01.289201 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c7658-5808-42ba-bb1d-840c04323152 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:01.305096 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd8af0-a784-4a66-9099-3bdf48049ecf admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:01.316158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7e52f-8259-44b2-aa20-07ba3e5fb050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:01.317469 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7e52f-8259-44b2-aa20-07ba3e5fb050 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:01.318138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7e52f-8259-44b2-aa20-07ba3e5fb050 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:01.318414 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca770ffd-b74d-4cb2-9501-5e57575f2789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:01.318749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7e52f-8259-44b2-aa20-07ba3e5fb050 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:01.319814 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca770ffd-b74d-4cb2-9501-5e57575f2789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:01.320319 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7e52f-8259-44b2-aa20-07ba3e5fb050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:01.320499 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca770ffd-b74d-4cb2-9501-5e57575f2789 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:01.320984 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca770ffd-b74d-4cb2-9501-5e57575f2789 admin admin] PATH_INFO: `/v3/projects/537f8fed9b38466bb73657d9387edec2` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:01.323138 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca770ffd-b74d-4cb2-9501-5e57575f2789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=537f8fed9b38466bb73657d9387edec2)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:01.323903 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7e52f-8259-44b2-aa20-07ba3e5fb050 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:01.334161 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca770ffd-b74d-4cb2-9501-5e57575f2789 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:01.345713 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1333/2639] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 16:01:01.352960 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7e52f-8259-44b2-aa20-07ba3e5fb050 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:01.372123 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7e52f-8259-44b2-aa20-07ba3e5fb050 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:01.381116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53511af8-6f36-4fbd-9d82-1c1321d89719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:01.382377 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53511af8-6f36-4fbd-9d82-1c1321d89719 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:01.383131 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53511af8-6f36-4fbd-9d82-1c1321d89719 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:01.383624 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53511af8-6f36-4fbd-9d82-1c1321d89719 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:01.384811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53511af8-6f36-4fbd-9d82-1c1321d89719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:01.387697 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53511af8-6f36-4fbd-9d82-1c1321d89719 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:01.413910 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1334/2640] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:01:01.417672 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53511af8-6f36-4fbd-9d82-1c1321d89719 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:01.419514 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ca770ffd-b74d-4cb2-9501-5e57575f2789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '537f8fed9b38466bb73657d9387edec2', 'request_id': 'req-ca770ffd-b74d-4cb2-9501-5e57575f2789'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:01.430251 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ca770ffd-b74d-4cb2-9501-5e57575f2789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '537f8fed9b38466bb73657d9387edec2', 'request_id': 'req-ca770ffd-b74d-4cb2-9501-5e57575f2789'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:01.439342 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ca770ffd-b74d-4cb2-9501-5e57575f2789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '537f8fed9b38466bb73657d9387edec2', 'request_id': 'req-ca770ffd-b74d-4cb2-9501-5e57575f2789'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:01.439676 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53511af8-6f36-4fbd-9d82-1c1321d89719 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:01.456145 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ca770ffd-b74d-4cb2-9501-5e57575f2789 admin admin] The token cache is being invalidate because project 537f8fed9b38466bb73657d9387edec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:01:01.456613 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ca770ffd-b74d-4cb2-9501-5e57575f2789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:01.457703 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ca770ffd-b74d-4cb2-9501-5e57575f2789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:01.459686 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1307/2641] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:01:01 2022] DELETE /identity/v3/projects/537f8fed9b38466bb73657d9387edec2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:01.468280 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35cdcd-e35a-476b-bf1b-c11a5812c15a None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:01.468715 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35cdcd-e35a-476b-bf1b-c11a5812c15a None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:01.470243 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35cdcd-e35a-476b-bf1b-c11a5812c15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:01.501582 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-4e35cdcd-e35a-476b-bf1b-c11a5812c15a None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:01.503786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-4e35cdcd-e35a-476b-bf1b-c11a5812c15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:01.514802 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7364d552-7039-4cc5-92b6-4f6d36c582a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:01.515731 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364d552-7039-4cc5-92b6-4f6d36c582a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:01.516022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364d552-7039-4cc5-92b6-4f6d36c582a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:01.516300 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7364d552-7039-4cc5-92b6-4f6d36c582a8 admin admin] PATH_INFO: `/v3/projects/410477ca3de0492b879bb662bd80a036/users/0638f906893a4458b59c11fe10da669b/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:01.536584 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364d552-7039-4cc5-92b6-4f6d36c582a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=410477ca3de0492b879bb662bd80a036, user_id=0638f906893a4458b59c11fe10da669b, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:01.539348 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7364d552-7039-4cc5-92b6-4f6d36c582a8 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:01.541595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:01.565980 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1335/2642] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:01:01 2022] PUT /identity/v3/projects/410477ca3de0492b879bb662bd80a036/users/0638f906893a4458b59c11fe10da669b/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:01:01.577639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936ecc7-53ba-41dd-aed8-e0e9f2ebdc01 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:01.578009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936ecc7-53ba-41dd-aed8-e0e9f2ebdc01 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:01.578779 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936ecc7-53ba-41dd-aed8-e0e9f2ebdc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:01.618178 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1308/2643] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:01:01.618396 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-5936ecc7-53ba-41dd-aed8-e0e9f2ebdc01 None None] MFA Rules not processed for user `0638f906893a4458b59c11fe10da669b`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:01.618396 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5936ecc7-53ba-41dd-aed8-e0e9f2ebdc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:01.679791 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a5276-b1bd-4a51-b0f8-afbb6c4f185e None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:01.680310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a5276-b1bd-4a51-b0f8-afbb6c4f185e None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:01.680788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a5276-b1bd-4a51-b0f8-afbb6c4f185e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:01.698337 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:01.716287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-5f0a5276-b1bd-4a51-b0f8-afbb6c4f185e None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:01.718500 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-5f0a5276-b1bd-4a51-b0f8-afbb6c4f185e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:01.726140 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1336/2644] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:01.731033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936ecc7-53ba-41dd-aed8-e0e9f2ebdc01 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:01.732495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5936ecc7-53ba-41dd-aed8-e0e9f2ebdc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:01.852736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936ecc7-53ba-41dd-aed8-e0e9f2ebdc01 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:01.860558 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84abde9-4082-409d-94b4-a7369fa3ccdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:01.861466 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84abde9-4082-409d-94b4-a7369fa3ccdf admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:01.861885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1309/2645] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:01.862075 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84abde9-4082-409d-94b4-a7369fa3ccdf admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:01.862587 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84abde9-4082-409d-94b4-a7369fa3ccdf admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:01.864005 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84abde9-4082-409d-94b4-a7369fa3ccdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:01.868060 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84abde9-4082-409d-94b4-a7369fa3ccdf admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:01.868698 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a5276-b1bd-4a51-b0f8-afbb6c4f185e None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:01.884568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a5276-b1bd-4a51-b0f8-afbb6c4f185e None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:01.892738 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7f29f-f9db-4a03-86df-5712804cea55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:01.893767 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7f29f-f9db-4a03-86df-5712804cea55 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:01.894129 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7f29f-f9db-4a03-86df-5712804cea55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:01.894487 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7f29f-f9db-4a03-86df-5712804cea55 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:01.895773 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7f29f-f9db-4a03-86df-5712804cea55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:01:01.896197 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7f29f-f9db-4a03-86df-5712804cea55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:01.898422 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7f29f-f9db-4a03-86df-5712804cea55 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:01.914210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1337/2646] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:01:01 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 16:01:01.919457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84abde9-4082-409d-94b4-a7369fa3ccdf admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:01.926643 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1310/2647] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 16:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:01:01.928476 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7f29f-f9db-4a03-86df-5712804cea55 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:01.948768 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7f29f-f9db-4a03-86df-5712804cea55 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:02.003100 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84abde9-4082-409d-94b4-a7369fa3ccdf admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:02.008490 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ddeeb-4794-4324-9456-95a3c0b86de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:02.009133 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ddeeb-4794-4324-9456-95a3c0b86de7 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:02.009432 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ddeeb-4794-4324-9456-95a3c0b86de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:02.009720 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ddeeb-4794-4324-9456-95a3c0b86de7 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:02.010644 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ddeeb-4794-4324-9456-95a3c0b86de7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:02.012811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ddeeb-4794-4324-9456-95a3c0b86de7 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:02.039428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1338/2648] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:01:01 2022] POST /identity/v3/users => generated 299 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 16:01:02.041688 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ddeeb-4794-4324-9456-95a3c0b86de7 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:02.043949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84474006-8e0b-469b-857d-bf3f76f4ca12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:02.045056 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84474006-8e0b-469b-857d-bf3f76f4ca12 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:02.045535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84474006-8e0b-469b-857d-bf3f76f4ca12 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:02.046058 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84474006-8e0b-469b-857d-bf3f76f4ca12 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:02.047321 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84474006-8e0b-469b-857d-bf3f76f4ca12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:02.051320 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84474006-8e0b-469b-857d-bf3f76f4ca12 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:02.052437 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ddeeb-4794-4324-9456-95a3c0b86de7 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:02.057518 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22fae3-5198-4327-a88c-d09f8cf681e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:02.058102 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22fae3-5198-4327-a88c-d09f8cf681e8 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:02.058783 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22fae3-5198-4327-a88c-d09f8cf681e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:02.058783 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22fae3-5198-4327-a88c-d09f8cf681e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:02.059551 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22fae3-5198-4327-a88c-d09f8cf681e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:02.061087 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22fae3-5198-4327-a88c-d09f8cf681e8 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:02.077556 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1339/2649] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:01:02.081491 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22fae3-5198-4327-a88c-d09f8cf681e8 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:02.092408 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22fae3-5198-4327-a88c-d09f8cf681e8 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:02.098510 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1440c3-e9ae-4672-8671-11b2ddeb6f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:02.099419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1440c3-e9ae-4672-8671-11b2ddeb6f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:02.099732 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1440c3-e9ae-4672-8671-11b2ddeb6f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:02.100363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1440c3-e9ae-4672-8671-11b2ddeb6f74 admin admin] PATH_INFO: `/v3/projects/2a33ad6dd3274ea89d68fe2557328a34/users/3c410cfcd872408984dbb1979deea16c/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:02.114527 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1311/2650] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:01:01 2022] POST /identity/v3/projects => generated 371 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 16:01:02.119494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84474006-8e0b-469b-857d-bf3f76f4ca12 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:02.122540 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1440c3-e9ae-4672-8671-11b2ddeb6f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a33ad6dd3274ea89d68fe2557328a34, user_id=3c410cfcd872408984dbb1979deea16c, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:02.125538 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1440c3-e9ae-4672-8671-11b2ddeb6f74 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:02.144098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1340/2651] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:01:02 2022] PUT /identity/v3/projects/2a33ad6dd3274ea89d68fe2557328a34/users/3c410cfcd872408984dbb1979deea16c/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:02.149421 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1440c3-e9ae-4672-8671-11b2ddeb6f74 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:02.190009 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:02.191067 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:02.223816 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84474006-8e0b-469b-857d-bf3f76f4ca12 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:02.229439 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c20ec-6ce6-4c6a-9c5b-4e32397d21d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:02.231097 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c20ec-6ce6-4c6a-9c5b-4e32397d21d7 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:02.231690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c20ec-6ce6-4c6a-9c5b-4e32397d21d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:02.232160 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c20ec-6ce6-4c6a-9c5b-4e32397d21d7 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:02.233374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c20ec-6ce6-4c6a-9c5b-4e32397d21d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:02.234079 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1440c3-e9ae-4672-8671-11b2ddeb6f74 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:02.237053 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c20ec-6ce6-4c6a-9c5b-4e32397d21d7 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:02.242894 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c35755-52cd-4cc7-9631-944f4dc584f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:02.243942 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c35755-52cd-4cc7-9631-944f4dc584f4 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:02.244401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c35755-52cd-4cc7-9631-944f4dc584f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:02.244857 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c35755-52cd-4cc7-9631-944f4dc584f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:02.246185 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c35755-52cd-4cc7-9631-944f4dc584f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:02.248862 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c35755-52cd-4cc7-9631-944f4dc584f4 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:02.279031 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1341/2652] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 16:01:02.279512 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1312/2653] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:01:02 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 16:01:02.279695 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c35755-52cd-4cc7-9631-944f4dc584f4 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:02.282979 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c20ec-6ce6-4c6a-9c5b-4e32397d21d7 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:02.294300 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c35755-52cd-4cc7-9631-944f4dc584f4 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:02.302466 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd59f6-0802-4b2c-bc5e-595d326a1136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:02.303893 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd59f6-0802-4b2c-bc5e-595d326a1136 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:02.304176 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd59f6-0802-4b2c-bc5e-595d326a1136 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:02.304304 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c20ec-6ce6-4c6a-9c5b-4e32397d21d7 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:02.304462 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd59f6-0802-4b2c-bc5e-595d326a1136 admin admin] PATH_INFO: `/v3/projects/2a33ad6dd3274ea89d68fe2557328a34/users/3c410cfcd872408984dbb1979deea16c/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:02.307452 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd59f6-0802-4b2c-bc5e-595d326a1136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a33ad6dd3274ea89d68fe2557328a34, user_id=3c410cfcd872408984dbb1979deea16c, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:02.310251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd59f6-0802-4b2c-bc5e-595d326a1136 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:02.311074 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da179812-e49e-4626-b0de-2ff21e10502b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:02.311884 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da179812-e49e-4626-b0de-2ff21e10502b admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:02.312319 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da179812-e49e-4626-b0de-2ff21e10502b admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:02.312818 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da179812-e49e-4626-b0de-2ff21e10502b admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:02.313798 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da179812-e49e-4626-b0de-2ff21e10502b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:02.316970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da179812-e49e-4626-b0de-2ff21e10502b admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:02.324355 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1342/2654] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:01:02 2022] PUT /identity/v3/projects/2a33ad6dd3274ea89d68fe2557328a34/users/3c410cfcd872408984dbb1979deea16c/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:01:02.342274 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1313/2655] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 16:01:02.342565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d5ba1-7cb5-413f-beda-a0e8dc71cd97 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:02.342565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d5ba1-7cb5-413f-beda-a0e8dc71cd97 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:02.342565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d5ba1-7cb5-413f-beda-a0e8dc71cd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:02.343669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da179812-e49e-4626-b0de-2ff21e10502b admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:02.355279 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da179812-e49e-4626-b0de-2ff21e10502b admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:02.378342 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-e11d5ba1-7cb5-413f-beda-a0e8dc71cd97 None None] MFA Rules not processed for user `3c410cfcd872408984dbb1979deea16c`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:02.379531 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e11d5ba1-7cb5-413f-beda-a0e8dc71cd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:02.457362 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea4e91-59b5-4949-92be-7d05d8c2dcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:02.458231 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea4e91-59b5-4949-92be-7d05d8c2dcec admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:02.458687 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea4e91-59b5-4949-92be-7d05d8c2dcec admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:02.459057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ea4e91-59b5-4949-92be-7d05d8c2dcec admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:02.459985 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea4e91-59b5-4949-92be-7d05d8c2dcec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:02.462563 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ea4e91-59b5-4949-92be-7d05d8c2dcec admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:02.485011 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1314/2656] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:01:02.490380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea4e91-59b5-4949-92be-7d05d8c2dcec admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:02.505801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ea4e91-59b5-4949-92be-7d05d8c2dcec admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:02.508052 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1343/2657] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:02.515287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734620bb-509f-4b6a-a7e4-23f4862d3d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:02.517802 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734620bb-509f-4b6a-a7e4-23f4862d3d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:02.519412 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734620bb-509f-4b6a-a7e4-23f4862d3d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:02.519412 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734620bb-509f-4b6a-a7e4-23f4862d3d48 admin admin] PATH_INFO: `/v3/projects/178e54c0c0cb4a68ad0d7ed057bdab18/users/7019bd6ed83c4fe8bacd01b17b081ac9/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:02.519946 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d5ba1-7cb5-413f-beda-a0e8dc71cd97 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:02.521348 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e11d5ba1-7cb5-413f-beda-a0e8dc71cd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:02.561423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734620bb-509f-4b6a-a7e4-23f4862d3d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=178e54c0c0cb4a68ad0d7ed057bdab18, user_id=7019bd6ed83c4fe8bacd01b17b081ac9, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:02.572137 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734620bb-509f-4b6a-a7e4-23f4862d3d48 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:02.602988 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1315/2658] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:01:02 2022] PUT /identity/v3/projects/178e54c0c0cb4a68ad0d7ed057bdab18/users/7019bd6ed83c4fe8bacd01b17b081ac9/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:02.616097 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09e175-dbb8-4070-a793-42908d418442 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:02.616587 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09e175-dbb8-4070-a793-42908d418442 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:02.617108 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09e175-dbb8-4070-a793-42908d418442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:02.646199 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d5ba1-7cb5-413f-beda-a0e8dc71cd97 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:02.658381 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-2a09e175-dbb8-4070-a793-42908d418442 None None] MFA Rules not processed for user `7019bd6ed83c4fe8bacd01b17b081ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:02.660521 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-2a09e175-dbb8-4070-a793-42908d418442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:02.764596 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a4e24-cab1-49bd-9792-541458f203b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:02.765398 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a4e24-cab1-49bd-9792-541458f203b7 service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:02.765778 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a4e24-cab1-49bd-9792-541458f203b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:02.766171 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a4e24-cab1-49bd-9792-541458f203b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:02.772495 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:02.829418 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1316/2659] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:02.836124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09e175-dbb8-4070-a793-42908d418442 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:02.836124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-2a09e175-dbb8-4070-a793-42908d418442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:02.847160 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a4e24-cab1-49bd-9792-541458f203b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:02.849962 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a4e24-cab1-49bd-9792-541458f203b7 service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:02.857341 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:02.869478 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1344/2660] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 16:01:02.871032 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a4e24-cab1-49bd-9792-541458f203b7 service cinder] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:02.873913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-d49a4e24-cab1-49bd-9792-541458f203b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:02.905427 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09e175-dbb8-4070-a793-42908d418442 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:02.910476 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535d42b-3f89-4696-8e6d-23ccb465a067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:02.911289 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535d42b-3f89-4696-8e6d-23ccb465a067 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:02.911685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535d42b-3f89-4696-8e6d-23ccb465a067 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:02.912081 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535d42b-3f89-4696-8e6d-23ccb465a067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:02.914297 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-9535d42b-3f89-4696-8e6d-23ccb465a067 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:03.003174 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535d42b-3f89-4696-8e6d-23ccb465a067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:03.004669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535d42b-3f89-4696-8e6d-23ccb465a067 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:03.021070 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a4e24-cab1-49bd-9792-541458f203b7 service cinder] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:03.023803 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1317/2661] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:01:03.029876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c24704-c134-4c30-8d3b-106821abee94 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79239c95306c43f0a1a0b51715440009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:03.030971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c24704-c134-4c30-8d3b-106821abee94 service glance] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:03.031594 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c24704-c134-4c30-8d3b-106821abee94 service glance] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:03.032394 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c24704-c134-4c30-8d3b-106821abee94 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:03.049367 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c24704-c134-4c30-8d3b-106821abee94 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:03.052207 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c24704-c134-4c30-8d3b-106821abee94 service glance] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:03.071536 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1345/2662] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:01:08.446245 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535d42b-3f89-4696-8e6d-23ccb465a067 service neutron] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:08.459529 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535d42b-3f89-4696-8e6d-23ccb465a067 service neutron] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:08.466864 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811059b-de7e-4e17-b416-9e3c5d235aa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:08.467679 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811059b-de7e-4e17-b416-9e3c5d235aa8 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:08.468036 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811059b-de7e-4e17-b416-9e3c5d235aa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:08.468380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811059b-de7e-4e17-b416-9e3c5d235aa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:08.558015 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811059b-de7e-4e17-b416-9e3c5d235aa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:08.559912 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811059b-de7e-4e17-b416-9e3c5d235aa8 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:08.577739 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1318/2663] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:01:13.064153 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=50 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:13.137176 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c24704-c134-4c30-8d3b-106821abee94 service glance] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:13.139338 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-b6c24704-c134-4c30-8d3b-106821abee94 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:13.157736 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c24704-c134-4c30-8d3b-106821abee94 service glance] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:13.163393 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67bacb-a9bd-4c58-aa3e-da8d2a8eff03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:13.164213 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67bacb-a9bd-4c58-aa3e-da8d2a8eff03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:13.164500 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67bacb-a9bd-4c58-aa3e-da8d2a8eff03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:13.164930 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67bacb-a9bd-4c58-aa3e-da8d2a8eff03 admin admin] PATH_INFO: `/v3/users/53a77c323a8843709660a12833e99b18` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:13.166318 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67bacb-a9bd-4c58-aa3e-da8d2a8eff03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53a77c323a8843709660a12833e99b18)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:13.168332 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67bacb-a9bd-4c58-aa3e-da8d2a8eff03 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:13.223078 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6d67bacb-a9bd-4c58-aa3e-da8d2a8eff03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53a77c323a8843709660a12833e99b18'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:13.231320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6d67bacb-a9bd-4c58-aa3e-da8d2a8eff03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53a77c323a8843709660a12833e99b18'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:13.232068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6d67bacb-a9bd-4c58-aa3e-da8d2a8eff03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53a77c323a8843709660a12833e99b18'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:13.232697 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6d67bacb-a9bd-4c58-aa3e-da8d2a8eff03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53a77c323a8843709660a12833e99b18'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:13.251220 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-6d67bacb-a9bd-4c58-aa3e-da8d2a8eff03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53a77c323a8843709660a12833e99b18'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:13.266795 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1346/2664] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:01:13 2022] DELETE /identity/v3/users/53a77c323a8843709660a12833e99b18 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:01:13.528315 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811059b-de7e-4e17-b416-9e3c5d235aa8 service cinder] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:13.559382 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811059b-de7e-4e17-b416-9e3c5d235aa8 service cinder] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:13.643315 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69380fc6-c127-402e-bd3f-8663c69f82f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:13.644274 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69380fc6-c127-402e-bd3f-8663c69f82f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:13.644605 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69380fc6-c127-402e-bd3f-8663c69f82f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:13.644930 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69380fc6-c127-402e-bd3f-8663c69f82f4 admin admin] PATH_INFO: `/v3/projects/ba201456c04a46018339b0c806d809d1` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:13.646473 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69380fc6-c127-402e-bd3f-8663c69f82f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba201456c04a46018339b0c806d809d1)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:13.648604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69380fc6-c127-402e-bd3f-8663c69f82f4 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:13.651700 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:13.715627 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-69380fc6-c127-402e-bd3f-8663c69f82f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba201456c04a46018339b0c806d809d1', 'request_id': 'req-69380fc6-c127-402e-bd3f-8663c69f82f4'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:13.729573 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-69380fc6-c127-402e-bd3f-8663c69f82f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba201456c04a46018339b0c806d809d1', 'request_id': 'req-69380fc6-c127-402e-bd3f-8663c69f82f4'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:13.739963 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-69380fc6-c127-402e-bd3f-8663c69f82f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba201456c04a46018339b0c806d809d1', 'request_id': 'req-69380fc6-c127-402e-bd3f-8663c69f82f4'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:13.754769 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-69380fc6-c127-402e-bd3f-8663c69f82f4 admin admin] The token cache is being invalidate because project ba201456c04a46018339b0c806d809d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:01:13.755063 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-69380fc6-c127-402e-bd3f-8663c69f82f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:13.756101 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-69380fc6-c127-402e-bd3f-8663c69f82f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:13.757755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1319/2665] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:01:13 2022] DELETE /identity/v3/projects/ba201456c04a46018339b0c806d809d1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:13.764163 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67bacb-a9bd-4c58-aa3e-da8d2a8eff03 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:13.766071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-6d67bacb-a9bd-4c58-aa3e-da8d2a8eff03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:13.787884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67bacb-a9bd-4c58-aa3e-da8d2a8eff03 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:13.905668 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35756a1d-8a14-4d22-88c5-2291dc5649bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:13.906566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35756a1d-8a14-4d22-88c5-2291dc5649bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:13.906879 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35756a1d-8a14-4d22-88c5-2291dc5649bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:13.907637 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35756a1d-8a14-4d22-88c5-2291dc5649bc admin admin] PATH_INFO: `/v3/users/23d80799778a47efab41f86a879c4fba` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:13.909062 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35756a1d-8a14-4d22-88c5-2291dc5649bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=23d80799778a47efab41f86a879c4fba)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:13.911289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35756a1d-8a14-4d22-88c5-2291dc5649bc admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:13.989423 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-35756a1d-8a14-4d22-88c5-2291dc5649bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23d80799778a47efab41f86a879c4fba'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:14.003461 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-35756a1d-8a14-4d22-88c5-2291dc5649bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23d80799778a47efab41f86a879c4fba'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:14.004708 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-35756a1d-8a14-4d22-88c5-2291dc5649bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23d80799778a47efab41f86a879c4fba'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:14.005901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-35756a1d-8a14-4d22-88c5-2291dc5649bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23d80799778a47efab41f86a879c4fba'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:14.033360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-35756a1d-8a14-4d22-88c5-2291dc5649bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23d80799778a47efab41f86a879c4fba'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:14.036724 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:14.066875 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1347/2666] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:01:13 2022] DELETE /identity/v3/users/23d80799778a47efab41f86a879c4fba => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:14.172580 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69380fc6-c127-402e-bd3f-8663c69f82f4 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:14.179006 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-69380fc6-c127-402e-bd3f-8663c69f82f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:14.201996 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69380fc6-c127-402e-bd3f-8663c69f82f4 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:14.310530 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1732549-2d56-4611-9d75-644a20325906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:14.312049 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1732549-2d56-4611-9d75-644a20325906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:14.312550 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1732549-2d56-4611-9d75-644a20325906 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:14.313069 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1732549-2d56-4611-9d75-644a20325906 admin admin] PATH_INFO: `/v3/users/0638f906893a4458b59c11fe10da669b` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:14.316092 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1732549-2d56-4611-9d75-644a20325906 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0638f906893a4458b59c11fe10da669b)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:14.319992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1732549-2d56-4611-9d75-644a20325906 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:14.381749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35756a1d-8a14-4d22-88c5-2291dc5649bc admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:14.384396 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-35756a1d-8a14-4d22-88c5-2291dc5649bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:14.396977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-f1732549-2d56-4611-9d75-644a20325906 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0638f906893a4458b59c11fe10da669b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:14.409029 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35756a1d-8a14-4d22-88c5-2291dc5649bc admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:14.420235 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-f1732549-2d56-4611-9d75-644a20325906 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0638f906893a4458b59c11fe10da669b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:14.420542 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd5358-a768-4fda-bf28-18772a09b635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:14.421790 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd5358-a768-4fda-bf28-18772a09b635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:14.422324 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd5358-a768-4fda-bf28-18772a09b635 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:14.423366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd5358-a768-4fda-bf28-18772a09b635 admin admin] PATH_INFO: `/v3/projects/d1c88405e5424ab4833f88c93c201c12` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:14.424236 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-f1732549-2d56-4611-9d75-644a20325906 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0638f906893a4458b59c11fe10da669b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:14.426125 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd5358-a768-4fda-bf28-18772a09b635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1c88405e5424ab4833f88c93c201c12)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:14.426780 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-f1732549-2d56-4611-9d75-644a20325906 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0638f906893a4458b59c11fe10da669b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:14.430218 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd5358-a768-4fda-bf28-18772a09b635 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:14.450233 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-f1732549-2d56-4611-9d75-644a20325906 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0638f906893a4458b59c11fe10da669b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:14.482155 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1320/2667] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:01:14 2022] DELETE /identity/v3/users/0638f906893a4458b59c11fe10da669b => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:14.490052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22703b5-7bee-439e-8a8a-a659e2fc7ab6 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:14.490324 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22703b5-7bee-439e-8a8a-a659e2fc7ab6 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:14.490494 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22703b5-7bee-439e-8a8a-a659e2fc7ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:14.512032 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8cbd5358-a768-4fda-bf28-18772a09b635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1c88405e5424ab4833f88c93c201c12', 'request_id': 'req-8cbd5358-a768-4fda-bf28-18772a09b635'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:14.520249 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-f22703b5-7bee-439e-8a8a-a659e2fc7ab6 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:14.520885 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8cbd5358-a768-4fda-bf28-18772a09b635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1c88405e5424ab4833f88c93c201c12', 'request_id': 'req-8cbd5358-a768-4fda-bf28-18772a09b635'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:14.522030 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-f22703b5-7bee-439e-8a8a-a659e2fc7ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:14.529573 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:14.531814 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8cbd5358-a768-4fda-bf28-18772a09b635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1c88405e5424ab4833f88c93c201c12', 'request_id': 'req-8cbd5358-a768-4fda-bf28-18772a09b635'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:14.565150 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8cbd5358-a768-4fda-bf28-18772a09b635 admin admin] The token cache is being invalidate because project d1c88405e5424ab4833f88c93c201c12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:01:14.565150 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8cbd5358-a768-4fda-bf28-18772a09b635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:14.565150 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8cbd5358-a768-4fda-bf28-18772a09b635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:14.565150 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1348/2668] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:01:14 2022] DELETE /identity/v3/projects/d1c88405e5424ab4833f88c93c201c12 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:14.647968 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1321/2669] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:01:14.662613 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd5358-a768-4fda-bf28-18772a09b635 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:14.664810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-8cbd5358-a768-4fda-bf28-18772a09b635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:14.765126 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd5358-a768-4fda-bf28-18772a09b635 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:14.772175 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fe427-efc2-4319-9a43-a8e079ab63c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:14.773756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fe427-efc2-4319-9a43-a8e079ab63c3 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:14.777765 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fe427-efc2-4319-9a43-a8e079ab63c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:14.777765 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655fe427-efc2-4319-9a43-a8e079ab63c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:14.792816 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655fe427-efc2-4319-9a43-a8e079ab63c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:14.795868 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655fe427-efc2-4319-9a43-a8e079ab63c3 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:14.816654 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1349/2670] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:01:15.220695 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22703b5-7bee-439e-8a8a-a659e2fc7ab6 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:15.223109 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-f22703b5-7bee-439e-8a8a-a659e2fc7ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:15.262738 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22703b5-7bee-439e-8a8a-a659e2fc7ab6 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:15.274765 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294be8c7-ccb7-4767-8fcc-45213cd92e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:15.276519 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294be8c7-ccb7-4767-8fcc-45213cd92e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:15.276837 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294be8c7-ccb7-4767-8fcc-45213cd92e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:15.277351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294be8c7-ccb7-4767-8fcc-45213cd92e2c admin admin] PATH_INFO: `/v3/projects/410477ca3de0492b879bb662bd80a036` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:15.279902 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294be8c7-ccb7-4767-8fcc-45213cd92e2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=410477ca3de0492b879bb662bd80a036)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:15.284113 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294be8c7-ccb7-4767-8fcc-45213cd92e2c admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:15.378203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-294be8c7-ccb7-4767-8fcc-45213cd92e2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '410477ca3de0492b879bb662bd80a036', 'request_id': 'req-294be8c7-ccb7-4767-8fcc-45213cd92e2c'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:15.388425 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-294be8c7-ccb7-4767-8fcc-45213cd92e2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '410477ca3de0492b879bb662bd80a036', 'request_id': 'req-294be8c7-ccb7-4767-8fcc-45213cd92e2c'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:15.397228 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-294be8c7-ccb7-4767-8fcc-45213cd92e2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '410477ca3de0492b879bb662bd80a036', 'request_id': 'req-294be8c7-ccb7-4767-8fcc-45213cd92e2c'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:15.419225 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-294be8c7-ccb7-4767-8fcc-45213cd92e2c admin admin] The token cache is being invalidate because project 410477ca3de0492b879bb662bd80a036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:01:15.419705 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-294be8c7-ccb7-4767-8fcc-45213cd92e2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:15.420755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-294be8c7-ccb7-4767-8fcc-45213cd92e2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:15.423786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1322/2671] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:01:15 2022] DELETE /identity/v3/projects/410477ca3de0492b879bb662bd80a036 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:01:15.429705 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fe427-efc2-4319-9a43-a8e079ab63c3 service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:15.446569 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655fe427-efc2-4319-9a43-a8e079ab63c3 service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:15.528970 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5d4b8-fe06-4b0a-8f44-aa171098193a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:15.530392 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5d4b8-fe06-4b0a-8f44-aa171098193a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:15.530813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5d4b8-fe06-4b0a-8f44-aa171098193a admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:15.531293 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5d4b8-fe06-4b0a-8f44-aa171098193a admin admin] PATH_INFO: `/v3/users/3c410cfcd872408984dbb1979deea16c` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:15.534342 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5d4b8-fe06-4b0a-8f44-aa171098193a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c410cfcd872408984dbb1979deea16c)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:15.538224 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5d4b8-fe06-4b0a-8f44-aa171098193a admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:15.586318 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:15.633121 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-04a5d4b8-fe06-4b0a-8f44-aa171098193a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c410cfcd872408984dbb1979deea16c'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:15.644268 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-04a5d4b8-fe06-4b0a-8f44-aa171098193a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c410cfcd872408984dbb1979deea16c'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:15.645551 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-04a5d4b8-fe06-4b0a-8f44-aa171098193a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c410cfcd872408984dbb1979deea16c'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:15.646968 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-04a5d4b8-fe06-4b0a-8f44-aa171098193a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c410cfcd872408984dbb1979deea16c'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:15.665711 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-04a5d4b8-fe06-4b0a-8f44-aa171098193a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c410cfcd872408984dbb1979deea16c'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:15.689364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1350/2672] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:01:15 2022] DELETE /identity/v3/users/3c410cfcd872408984dbb1979deea16c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:16.093037 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294be8c7-ccb7-4767-8fcc-45213cd92e2c admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:16.094955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-294be8c7-ccb7-4767-8fcc-45213cd92e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:16.113607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294be8c7-ccb7-4767-8fcc-45213cd92e2c admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:16.198387 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1703c02-81e7-49d1-aaa8-bbd641487511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:16.199546 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1703c02-81e7-49d1-aaa8-bbd641487511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:16.199873 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1703c02-81e7-49d1-aaa8-bbd641487511 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:16.200203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1703c02-81e7-49d1-aaa8-bbd641487511 admin admin] PATH_INFO: `/v3/projects/2a33ad6dd3274ea89d68fe2557328a34` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:16.201609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1703c02-81e7-49d1-aaa8-bbd641487511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a33ad6dd3274ea89d68fe2557328a34)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:16.204354 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1703c02-81e7-49d1-aaa8-bbd641487511 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:16.251461 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:16.265265 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-f1703c02-81e7-49d1-aaa8-bbd641487511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a33ad6dd3274ea89d68fe2557328a34', 'request_id': 'req-f1703c02-81e7-49d1-aaa8-bbd641487511'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:16.275602 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-f1703c02-81e7-49d1-aaa8-bbd641487511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a33ad6dd3274ea89d68fe2557328a34', 'request_id': 'req-f1703c02-81e7-49d1-aaa8-bbd641487511'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:16.284971 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-f1703c02-81e7-49d1-aaa8-bbd641487511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a33ad6dd3274ea89d68fe2557328a34', 'request_id': 'req-f1703c02-81e7-49d1-aaa8-bbd641487511'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:16.299729 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-f1703c02-81e7-49d1-aaa8-bbd641487511 admin admin] The token cache is being invalidate because project 2a33ad6dd3274ea89d68fe2557328a34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:01:16.300112 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-f1703c02-81e7-49d1-aaa8-bbd641487511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:16.300885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-f1703c02-81e7-49d1-aaa8-bbd641487511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:16.302670 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1323/2673] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:01:16 2022] DELETE /identity/v3/projects/2a33ad6dd3274ea89d68fe2557328a34 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:01:16.309913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de511b-8f81-48f3-a277-24720442bc34 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:16.310291 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de511b-8f81-48f3-a277-24720442bc34 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:16.310685 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de511b-8f81-48f3-a277-24720442bc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:16.333320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-b1de511b-8f81-48f3-a277-24720442bc34 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:16.334758 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-b1de511b-8f81-48f3-a277-24720442bc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:16.412136 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1351/2674] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:16.422419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad5544-ba26-4f2b-b25c-b8ec37d67739 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:16.422899 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad5544-ba26-4f2b-b25c-b8ec37d67739 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:16.423329 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad5544-ba26-4f2b-b25c-b8ec37d67739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:16.446761 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-a4ad5544-ba26-4f2b-b25c-b8ec37d67739 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:16.448556 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-a4ad5544-ba26-4f2b-b25c-b8ec37d67739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:16.459818 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1324/2675] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:01:16.465108 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de511b-8f81-48f3-a277-24720442bc34 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:16.479359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de511b-8f81-48f3-a277-24720442bc34 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:16.487087 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d85dee-ebdf-4d00-a503-bc3f9887e285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:16.487867 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d85dee-ebdf-4d00-a503-bc3f9887e285 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:16.488164 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d85dee-ebdf-4d00-a503-bc3f9887e285 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:16.488432 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d85dee-ebdf-4d00-a503-bc3f9887e285 admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:16.489268 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d85dee-ebdf-4d00-a503-bc3f9887e285 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:01:16.489589 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d85dee-ebdf-4d00-a503-bc3f9887e285 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:16.491369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d85dee-ebdf-4d00-a503-bc3f9887e285 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:16.509176 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1352/2676] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 16:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:01:16.514868 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad5544-ba26-4f2b-b25c-b8ec37d67739 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:16.527057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad5544-ba26-4f2b-b25c-b8ec37d67739 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:16.537831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e8774-eaa3-45ce-ae26-e8352c765163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:16.538717 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e8774-eaa3-45ce-ae26-e8352c765163 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:16.539145 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e8774-eaa3-45ce-ae26-e8352c765163 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:16.539552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e8774-eaa3-45ce-ae26-e8352c765163 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:16.540406 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e8774-eaa3-45ce-ae26-e8352c765163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:16.543052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e8774-eaa3-45ce-ae26-e8352c765163 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:16.579680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1325/2677] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:01:16 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:01:16.584417 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d85dee-ebdf-4d00-a503-bc3f9887e285 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:16.595955 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d85dee-ebdf-4d00-a503-bc3f9887e285 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:16.667529 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ebc575-7021-445c-bc6f-f2792b681ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:16.668210 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebc575-7021-445c-bc6f-f2792b681ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:16.668536 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebc575-7021-445c-bc6f-f2792b681ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:16.668856 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebc575-7021-445c-bc6f-f2792b681ec9 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:16.669607 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ebc575-7021-445c-bc6f-f2792b681ec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:16.671846 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ebc575-7021-445c-bc6f-f2792b681ec9 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:16.695406 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1353/2678] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:01:16 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:01:16.699778 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e8774-eaa3-45ce-ae26-e8352c765163 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:16.711329 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e8774-eaa3-45ce-ae26-e8352c765163 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:16.716465 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafd235-6dc4-4cce-a369-7692c22834c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:16.717164 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafd235-6dc4-4cce-a369-7692c22834c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:16.717478 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafd235-6dc4-4cce-a369-7692c22834c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:16.717762 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafd235-6dc4-4cce-a369-7692c22834c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:16.718564 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bafd235-6dc4-4cce-a369-7692c22834c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:16.720382 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bafd235-6dc4-4cce-a369-7692c22834c2 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:16.733586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1326/2679] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:01:16.738420 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ebc575-7021-445c-bc6f-f2792b681ec9 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:16.753785 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ebc575-7021-445c-bc6f-f2792b681ec9 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:16.761793 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba7aa4-d134-4050-8fd9-cf3952f0ee2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:16.762945 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba7aa4-d134-4050-8fd9-cf3952f0ee2a admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:16.763407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba7aa4-d134-4050-8fd9-cf3952f0ee2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:16.763891 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba7aa4-d134-4050-8fd9-cf3952f0ee2a admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:16.767462 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba7aa4-d134-4050-8fd9-cf3952f0ee2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:16.769043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba7aa4-d134-4050-8fd9-cf3952f0ee2a admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:16.794018 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1354/2680] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:01:16.796109 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafd235-6dc4-4cce-a369-7692c22834c2 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:16.812568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafd235-6dc4-4cce-a369-7692c22834c2 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:16.819153 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263de41e-8be8-4630-8303-32ac1828e5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:16.820222 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263de41e-8be8-4630-8303-32ac1828e5ef admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:16.820644 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263de41e-8be8-4630-8303-32ac1828e5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:16.821109 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263de41e-8be8-4630-8303-32ac1828e5ef admin admin] PATH_INFO: `/v3/projects/7150b5a1917b410f8b5991da7826252b/users/c8d4a140f8e04331a7ff8c387833dddd/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:16.845024 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263de41e-8be8-4630-8303-32ac1828e5ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=7150b5a1917b410f8b5991da7826252b, user_id=c8d4a140f8e04331a7ff8c387833dddd, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:16.848465 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263de41e-8be8-4630-8303-32ac1828e5ef admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:16.873379 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1327/2681] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:01:16 2022] PUT /identity/v3/projects/7150b5a1917b410f8b5991da7826252b/users/c8d4a140f8e04331a7ff8c387833dddd/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:16.886724 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dd0fe-dc15-4746-aa3b-a56f2a9b9566 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:16.887108 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dd0fe-dc15-4746-aa3b-a56f2a9b9566 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:16.887554 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dd0fe-dc15-4746-aa3b-a56f2a9b9566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:16.895034 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:16.933893 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-025dd0fe-dc15-4746-aa3b-a56f2a9b9566 None None] MFA Rules not processed for user `c8d4a140f8e04331a7ff8c387833dddd`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:16.936000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-025dd0fe-dc15-4746-aa3b-a56f2a9b9566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:17.050544 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1355/2682] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:01:17.056194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263de41e-8be8-4630-8303-32ac1828e5ef admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:17.173019 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263de41e-8be8-4630-8303-32ac1828e5ef admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:17.179669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fa3bc-4626-4c4b-a470-fa1e5accad53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:17.180667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fa3bc-4626-4c4b-a470-fa1e5accad53 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:17.181061 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fa3bc-4626-4c4b-a470-fa1e5accad53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:17.181594 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2fa3bc-4626-4c4b-a470-fa1e5accad53 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:17.182736 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fa3bc-4626-4c4b-a470-fa1e5accad53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:17.185257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2fa3bc-4626-4c4b-a470-fa1e5accad53 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:17.223027 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1328/2683] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:01:17 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 16:01:17.229308 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025dd0fe-dc15-4746-aa3b-a56f2a9b9566 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:17.241966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025dd0fe-dc15-4746-aa3b-a56f2a9b9566 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:17.315963 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc92cb-0e1b-4daf-ab24-b3bce9ff2bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:17.316704 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc92cb-0e1b-4daf-ab24-b3bce9ff2bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:17.317038 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc92cb-0e1b-4daf-ab24-b3bce9ff2bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:17.317424 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcc92cb-0e1b-4daf-ab24-b3bce9ff2bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:17.318309 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc92cb-0e1b-4daf-ab24-b3bce9ff2bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:17.320389 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcc92cb-0e1b-4daf-ab24-b3bce9ff2bc1 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:17.342393 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1356/2684] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:01:17 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:01:17.348336 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fa3bc-4626-4c4b-a470-fa1e5accad53 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:17.361012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2fa3bc-4626-4c4b-a470-fa1e5accad53 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:17.367277 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257560d-6b0a-44dd-b021-0069bec7bee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:17.368004 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257560d-6b0a-44dd-b021-0069bec7bee8 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:17.368476 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257560d-6b0a-44dd-b021-0069bec7bee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:17.368821 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257560d-6b0a-44dd-b021-0069bec7bee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:17.369798 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257560d-6b0a-44dd-b021-0069bec7bee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:17.371832 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257560d-6b0a-44dd-b021-0069bec7bee8 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:17.386712 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1329/2685] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:01:17.394208 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc92cb-0e1b-4daf-ab24-b3bce9ff2bc1 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:17.407682 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcc92cb-0e1b-4daf-ab24-b3bce9ff2bc1 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:17.415979 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280695e-6dff-4b84-abeb-df90d6f1743d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:17.417253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280695e-6dff-4b84-abeb-df90d6f1743d admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:17.417789 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280695e-6dff-4b84-abeb-df90d6f1743d admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:17.418363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280695e-6dff-4b84-abeb-df90d6f1743d admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:17.419842 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280695e-6dff-4b84-abeb-df90d6f1743d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:17.423626 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280695e-6dff-4b84-abeb-df90d6f1743d admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:17.442743 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1357/2686] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:01:17.447247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257560d-6b0a-44dd-b021-0069bec7bee8 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:17.458913 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257560d-6b0a-44dd-b021-0069bec7bee8 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:17.465250 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf0aa1-09a9-4801-92c5-776aecaea766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:17.466532 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf0aa1-09a9-4801-92c5-776aecaea766 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:17.466927 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf0aa1-09a9-4801-92c5-776aecaea766 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:17.467345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf0aa1-09a9-4801-92c5-776aecaea766 admin admin] PATH_INFO: `/v3/projects/98befa552888475a8c70080ef56d98db/users/32da52ac60be4d85b3c7cab9019604b2/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:17.487776 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf0aa1-09a9-4801-92c5-776aecaea766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98befa552888475a8c70080ef56d98db, user_id=32da52ac60be4d85b3c7cab9019604b2, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:17.491037 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf0aa1-09a9-4801-92c5-776aecaea766 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:17.509062 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1330/2687] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:01:17 2022] PUT /identity/v3/projects/98befa552888475a8c70080ef56d98db/users/32da52ac60be4d85b3c7cab9019604b2/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:17.522086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48aa5f-4931-44ba-9452-f85bad86d12b None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:17.522791 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48aa5f-4931-44ba-9452-f85bad86d12b None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:17.523003 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48aa5f-4931-44ba-9452-f85bad86d12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:17.560075 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-2c48aa5f-4931-44ba-9452-f85bad86d12b None None] MFA Rules not processed for user `32da52ac60be4d85b3c7cab9019604b2`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:17.561347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-2c48aa5f-4931-44ba-9452-f85bad86d12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:17.638884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:17.645309 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1358/2688] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:01:17.651385 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf0aa1-09a9-4801-92c5-776aecaea766 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:17.667441 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:17.742948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf0aa1-09a9-4801-92c5-776aecaea766 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:17.747938 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65dd2f-e5a4-40e1-9cac-725f25705f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:17.748626 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65dd2f-e5a4-40e1-9cac-725f25705f08 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:17.749145 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65dd2f-e5a4-40e1-9cac-725f25705f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:17.749145 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65dd2f-e5a4-40e1-9cac-725f25705f08 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:17.749905 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65dd2f-e5a4-40e1-9cac-725f25705f08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:17.752084 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65dd2f-e5a4-40e1-9cac-725f25705f08 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:17.783804 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1331/2689] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:01:17 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:01:17.788677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48aa5f-4931-44ba-9452-f85bad86d12b None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:17.801878 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48aa5f-4931-44ba-9452-f85bad86d12b None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:17.873392 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe05917-fd97-406e-accf-83147f0b048a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:17.874256 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe05917-fd97-406e-accf-83147f0b048a admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:17.874636 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe05917-fd97-406e-accf-83147f0b048a admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:17.874977 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe05917-fd97-406e-accf-83147f0b048a admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:17.875775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe05917-fd97-406e-accf-83147f0b048a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:17.877892 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe05917-fd97-406e-accf-83147f0b048a admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:17.902119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1359/2690] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:01:17 2022] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:01:17.910775 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65dd2f-e5a4-40e1-9cac-725f25705f08 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:17.924570 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65dd2f-e5a4-40e1-9cac-725f25705f08 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:17.930474 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c5a5a-153c-4170-8977-8121b5dd088e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:17.931181 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c5a5a-153c-4170-8977-8121b5dd088e admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:17.931471 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c5a5a-153c-4170-8977-8121b5dd088e admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:17.931782 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c5a5a-153c-4170-8977-8121b5dd088e admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:17.932550 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c5a5a-153c-4170-8977-8121b5dd088e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:17.934281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c5a5a-153c-4170-8977-8121b5dd088e admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:17.948267 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1332/2691] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 16:01:17.955332 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe05917-fd97-406e-accf-83147f0b048a admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:17.966704 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe05917-fd97-406e-accf-83147f0b048a admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:17.972311 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b559f-da32-49da-a6e8-25337429819f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:17.973238 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b559f-da32-49da-a6e8-25337429819f admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:17.973582 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b559f-da32-49da-a6e8-25337429819f admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:17.973817 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b559f-da32-49da-a6e8-25337429819f admin admin] PATH_INFO: `/v3/projects/dbc8fa113cbb499e97f67fd69920b823/users/f83d9e47318d4d388c961196ff2c0283/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:17.994077 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b559f-da32-49da-a6e8-25337429819f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbc8fa113cbb499e97f67fd69920b823, user_id=f83d9e47318d4d388c961196ff2c0283, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:17.997073 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b559f-da32-49da-a6e8-25337429819f admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:18.012798 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1360/2692] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:01:17 2022] PUT /identity/v3/projects/dbc8fa113cbb499e97f67fd69920b823/users/f83d9e47318d4d388c961196ff2c0283/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:18.017607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c5a5a-153c-4170-8977-8121b5dd088e admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:18.029162 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c5a5a-153c-4170-8977-8121b5dd088e admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:18.100011 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415cdd31-c667-4172-ae53-44a534fab976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:18.100706 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cdd31-c667-4172-ae53-44a534fab976 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:18.100997 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cdd31-c667-4172-ae53-44a534fab976 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:18.101283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cdd31-c667-4172-ae53-44a534fab976 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:18.102073 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415cdd31-c667-4172-ae53-44a534fab976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:18.103760 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415cdd31-c667-4172-ae53-44a534fab976 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:18.118661 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1333/2693] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 16:01:18.122974 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b559f-da32-49da-a6e8-25337429819f admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:18.134416 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b559f-da32-49da-a6e8-25337429819f admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:18.139554 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ee49f-61be-4248-93c2-d52cb40c4366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:18.140483 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ee49f-61be-4248-93c2-d52cb40c4366 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:18.140773 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ee49f-61be-4248-93c2-d52cb40c4366 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:18.141589 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ee49f-61be-4248-93c2-d52cb40c4366 admin admin] PATH_INFO: `/v3/projects/dbc8fa113cbb499e97f67fd69920b823/users/f83d9e47318d4d388c961196ff2c0283/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:18.143863 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ee49f-61be-4248-93c2-d52cb40c4366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbc8fa113cbb499e97f67fd69920b823, user_id=f83d9e47318d4d388c961196ff2c0283, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:18.146677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9ee49f-61be-4248-93c2-d52cb40c4366 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:18.163996 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1361/2694] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:01:18 2022] PUT /identity/v3/projects/dbc8fa113cbb499e97f67fd69920b823/users/f83d9e47318d4d388c961196ff2c0283/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:01:18.176291 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4782f8-149b-461f-91fd-398114016f54 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:18.176855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4782f8-149b-461f-91fd-398114016f54 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:18.177281 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4782f8-149b-461f-91fd-398114016f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:18.220973 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-6a4782f8-149b-461f-91fd-398114016f54 None None] MFA Rules not processed for user `f83d9e47318d4d388c961196ff2c0283`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:18.222780 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-6a4782f8-149b-461f-91fd-398114016f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:18.325634 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1334/2695] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:01:18.342848 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ee49f-61be-4248-93c2-d52cb40c4366 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:18.345321 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-1c9ee49f-61be-4248-93c2-d52cb40c4366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:18.429335 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ee49f-61be-4248-93c2-d52cb40c4366 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:18.435107 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ecd2c-45fe-4eb1-93bb-ea09b66b1fd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:18.435920 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ecd2c-45fe-4eb1-93bb-ea09b66b1fd6 service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:18.436282 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ecd2c-45fe-4eb1-93bb-ea09b66b1fd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:18.436652 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ecd2c-45fe-4eb1-93bb-ea09b66b1fd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:18.548562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ecd2c-45fe-4eb1-93bb-ea09b66b1fd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:18.551464 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ecd2c-45fe-4eb1-93bb-ea09b66b1fd6 service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:18.573926 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1362/2696] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 16:01:18.754037 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4782f8-149b-461f-91fd-398114016f54 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:18.755759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-6a4782f8-149b-461f-91fd-398114016f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:18.770699 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:18.862199 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4782f8-149b-461f-91fd-398114016f54 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:18.867933 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65aa178-116a-4dd8-b087-dedde957fadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:18.869114 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65aa178-116a-4dd8-b087-dedde957fadc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:18.869686 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65aa178-116a-4dd8-b087-dedde957fadc admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:18.870058 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65aa178-116a-4dd8-b087-dedde957fadc admin admin] PATH_INFO: `/v3/users/daceb53070d9420fbbb826478b853923` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:18.871746 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65aa178-116a-4dd8-b087-dedde957fadc admin admin] RBAC: Authorizing `identity:delete_user(user_id=daceb53070d9420fbbb826478b853923)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:18.874274 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65aa178-116a-4dd8-b087-dedde957fadc admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:18.942433 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e65aa178-116a-4dd8-b087-dedde957fadc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daceb53070d9420fbbb826478b853923'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:18.957388 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e65aa178-116a-4dd8-b087-dedde957fadc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daceb53070d9420fbbb826478b853923'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:18.958449 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e65aa178-116a-4dd8-b087-dedde957fadc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daceb53070d9420fbbb826478b853923'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:18.959284 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e65aa178-116a-4dd8-b087-dedde957fadc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daceb53070d9420fbbb826478b853923'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:18.981689 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-e65aa178-116a-4dd8-b087-dedde957fadc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daceb53070d9420fbbb826478b853923'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:19.009475 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1335/2697] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:01:18 2022] DELETE /identity/v3/users/daceb53070d9420fbbb826478b853923 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:01:19.015895 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684067f-ad82-4085-92bb-cb11bf8b412d None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:19.016731 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684067f-ad82-4085-92bb-cb11bf8b412d None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:19.017013 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684067f-ad82-4085-92bb-cb11bf8b412d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:19.030808 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:19.043252 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-8684067f-ad82-4085-92bb-cb11bf8b412d None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:19.047887 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-8684067f-ad82-4085-92bb-cb11bf8b412d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:19.162197 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1363/2698] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:01:19.173200 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65aa178-116a-4dd8-b087-dedde957fadc admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:19.174714 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-e65aa178-116a-4dd8-b087-dedde957fadc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:19.239305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65aa178-116a-4dd8-b087-dedde957fadc admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:19.243510 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506f4fd-7fcf-472e-9a68-61ef30d3a872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:19.244179 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506f4fd-7fcf-472e-9a68-61ef30d3a872 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:19.244464 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506f4fd-7fcf-472e-9a68-61ef30d3a872 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:19.244748 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506f4fd-7fcf-472e-9a68-61ef30d3a872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:19.255880 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506f4fd-7fcf-472e-9a68-61ef30d3a872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:19.257350 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506f4fd-7fcf-472e-9a68-61ef30d3a872 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:19.268939 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1336/2699] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:01:19.596987 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684067f-ad82-4085-92bb-cb11bf8b412d None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:19.599216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-8684067f-ad82-4085-92bb-cb11bf8b412d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:19.617569 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684067f-ad82-4085-92bb-cb11bf8b412d None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:19.623658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c729a6-3083-4105-9d44-b4555068cbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:19.626251 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c729a6-3083-4105-9d44-b4555068cbe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:19.627028 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c729a6-3083-4105-9d44-b4555068cbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:19.627543 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c729a6-3083-4105-9d44-b4555068cbe3 admin admin] PATH_INFO: `/v3/projects/103b44238bf842c798e8117cfe1bb3c0` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:19.629957 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c729a6-3083-4105-9d44-b4555068cbe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=103b44238bf842c798e8117cfe1bb3c0)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:19.633934 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c729a6-3083-4105-9d44-b4555068cbe3 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:19.707135 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-52c729a6-3083-4105-9d44-b4555068cbe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '103b44238bf842c798e8117cfe1bb3c0', 'request_id': 'req-52c729a6-3083-4105-9d44-b4555068cbe3'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:19.719591 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-52c729a6-3083-4105-9d44-b4555068cbe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '103b44238bf842c798e8117cfe1bb3c0', 'request_id': 'req-52c729a6-3083-4105-9d44-b4555068cbe3'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:19.732913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-52c729a6-3083-4105-9d44-b4555068cbe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '103b44238bf842c798e8117cfe1bb3c0', 'request_id': 'req-52c729a6-3083-4105-9d44-b4555068cbe3'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:19.756353 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-52c729a6-3083-4105-9d44-b4555068cbe3 admin admin] The token cache is being invalidate because project 103b44238bf842c798e8117cfe1bb3c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:01:19.756800 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-52c729a6-3083-4105-9d44-b4555068cbe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:19.758024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-52c729a6-3083-4105-9d44-b4555068cbe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:19.761023 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1364/2700] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:01:19 2022] DELETE /identity/v3/projects/103b44238bf842c798e8117cfe1bb3c0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:19.767147 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506f4fd-7fcf-472e-9a68-61ef30d3a872 service neutron] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:19.783204 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506f4fd-7fcf-472e-9a68-61ef30d3a872 service neutron] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:19.819732 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:19.872994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d86df6-0808-4203-bae0-b7717d0581c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:19.874063 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d86df6-0808-4203-bae0-b7717d0581c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:19.874395 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d86df6-0808-4203-bae0-b7717d0581c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:19.874793 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d86df6-0808-4203-bae0-b7717d0581c1 admin admin] PATH_INFO: `/v3/users/ffdeeb6e05af4db0aaa135e41bd21123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:19.876372 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d86df6-0808-4203-bae0-b7717d0581c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffdeeb6e05af4db0aaa135e41bd21123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:19.878695 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d86df6-0808-4203-bae0-b7717d0581c1 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:19.946341 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-64d86df6-0808-4203-bae0-b7717d0581c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffdeeb6e05af4db0aaa135e41bd21123'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:19.956784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-64d86df6-0808-4203-bae0-b7717d0581c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffdeeb6e05af4db0aaa135e41bd21123'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:19.957559 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-64d86df6-0808-4203-bae0-b7717d0581c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffdeeb6e05af4db0aaa135e41bd21123'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:19.958202 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-64d86df6-0808-4203-bae0-b7717d0581c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffdeeb6e05af4db0aaa135e41bd21123'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:19.977378 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-64d86df6-0808-4203-bae0-b7717d0581c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffdeeb6e05af4db0aaa135e41bd21123'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:19.990976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1337/2701] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:01:19 2022] DELETE /identity/v3/users/ffdeeb6e05af4db0aaa135e41bd21123 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:20.408389 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c729a6-3083-4105-9d44-b4555068cbe3 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:20.410028 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-52c729a6-3083-4105-9d44-b4555068cbe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:20.419219 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d86df6-0808-4203-bae0-b7717d0581c1 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:20.422789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-64d86df6-0808-4203-bae0-b7717d0581c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:20.519093 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c729a6-3083-4105-9d44-b4555068cbe3 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:20.535338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d86df6-0808-4203-bae0-b7717d0581c1 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:20.549038 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a737d-1e5c-436b-ba73-371652000822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:20.551213 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a737d-1e5c-436b-ba73-371652000822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:20.551728 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a737d-1e5c-436b-ba73-371652000822 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:20.552184 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a737d-1e5c-436b-ba73-371652000822 admin admin] PATH_INFO: `/v3/projects/58c232f225eb4ae09cbe18fc31a707d9` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:20.554265 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a737d-1e5c-436b-ba73-371652000822 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58c232f225eb4ae09cbe18fc31a707d9)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:20.557500 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a737d-1e5c-436b-ba73-371652000822 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:20.600089 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:20.609021 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2861bbf-2956-46c1-867b-c1990db23449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:20.610846 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2861bbf-2956-46c1-867b-c1990db23449 service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:20.611424 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2861bbf-2956-46c1-867b-c1990db23449 service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:20.612002 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2861bbf-2956-46c1-867b-c1990db23449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:20.616699 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-a2861bbf-2956-46c1-867b-c1990db23449 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:20.644417 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-273a737d-1e5c-436b-ba73-371652000822 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c232f225eb4ae09cbe18fc31a707d9', 'request_id': 'req-273a737d-1e5c-436b-ba73-371652000822'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:20.645933 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:20.658435 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-273a737d-1e5c-436b-ba73-371652000822 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c232f225eb4ae09cbe18fc31a707d9', 'request_id': 'req-273a737d-1e5c-436b-ba73-371652000822'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:20.667174 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-273a737d-1e5c-436b-ba73-371652000822 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c232f225eb4ae09cbe18fc31a707d9', 'request_id': 'req-273a737d-1e5c-436b-ba73-371652000822'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:20.679881 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-273a737d-1e5c-436b-ba73-371652000822 admin admin] The token cache is being invalidate because project 58c232f225eb4ae09cbe18fc31a707d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:01:20.680310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-273a737d-1e5c-436b-ba73-371652000822 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:20.681120 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-273a737d-1e5c-436b-ba73-371652000822 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:20.682860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1338/2702] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:01:20 2022] DELETE /identity/v3/projects/58c232f225eb4ae09cbe18fc31a707d9 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:01:20.691223 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f3004-5949-4c69-b21b-cb4461702085 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:20.691668 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f3004-5949-4c69-b21b-cb4461702085 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:20.692052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f3004-5949-4c69-b21b-cb4461702085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:20.717034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-e03f3004-5949-4c69-b21b-cb4461702085 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:20.718660 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-e03f3004-5949-4c69-b21b-cb4461702085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:20.726725 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2861bbf-2956-46c1-867b-c1990db23449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:20.728594 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2861bbf-2956-46c1-867b-c1990db23449 service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:20.742525 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1365/2703] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:01:20.809791 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1339/2704] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:01:20.819457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22897f91-55d8-4332-9179-9ae108dc28ec None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:20.819826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22897f91-55d8-4332-9179-9ae108dc28ec None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:20.820294 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22897f91-55d8-4332-9179-9ae108dc28ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:20.850761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-22897f91-55d8-4332-9179-9ae108dc28ec None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:20.852322 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-22897f91-55d8-4332-9179-9ae108dc28ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:20.864791 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1366/2705] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:20.870085 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f3004-5949-4c69-b21b-cb4461702085 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:20.882855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f3004-5949-4c69-b21b-cb4461702085 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:20.889148 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c05645-834e-45bc-8733-019a0784c447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:20.890117 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c05645-834e-45bc-8733-019a0784c447 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:20.890615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c05645-834e-45bc-8733-019a0784c447 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:20.891074 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c05645-834e-45bc-8733-019a0784c447 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:20.892727 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c05645-834e-45bc-8733-019a0784c447 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:01:20.893202 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c05645-834e-45bc-8733-019a0784c447 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:20.895366 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c05645-834e-45bc-8733-019a0784c447 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:20.918563 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1340/2706] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 16:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:01:20.920285 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22897f91-55d8-4332-9179-9ae108dc28ec None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:20.933324 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22897f91-55d8-4332-9179-9ae108dc28ec None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:20.943163 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8f46e-7419-429f-85cc-49cda5d2eb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:20.946046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8f46e-7419-429f-85cc-49cda5d2eb18 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:20.946861 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8f46e-7419-429f-85cc-49cda5d2eb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:20.947764 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8f46e-7419-429f-85cc-49cda5d2eb18 admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:20.949954 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8f46e-7419-429f-85cc-49cda5d2eb18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:20.955312 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d8f46e-7419-429f-85cc-49cda5d2eb18 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:21.014446 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1367/2707] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:01:20 2022] POST /identity/v3/projects => generated 355 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:01:21.019721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c05645-834e-45bc-8733-019a0784c447 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:21.039286 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c05645-834e-45bc-8733-019a0784c447 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:21.157712 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96c78c-9d3e-4ad2-bde6-26f54dd667b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:21.158610 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96c78c-9d3e-4ad2-bde6-26f54dd667b2 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:21.159087 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96c78c-9d3e-4ad2-bde6-26f54dd667b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:21.159470 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96c78c-9d3e-4ad2-bde6-26f54dd667b2 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:21.160332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96c78c-9d3e-4ad2-bde6-26f54dd667b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:21.163666 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96c78c-9d3e-4ad2-bde6-26f54dd667b2 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:21.194832 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1341/2708] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:01:21 2022] POST /identity/v3/users => generated 278 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:01:21.200477 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8f46e-7419-429f-85cc-49cda5d2eb18 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:21.216615 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8f46e-7419-429f-85cc-49cda5d2eb18 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:21.223763 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67612588-69af-412e-a1e3-95c4588aed16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:21.224963 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67612588-69af-412e-a1e3-95c4588aed16 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:21.225469 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67612588-69af-412e-a1e3-95c4588aed16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:21.226188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67612588-69af-412e-a1e3-95c4588aed16 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:21.227533 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67612588-69af-412e-a1e3-95c4588aed16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:21.230376 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67612588-69af-412e-a1e3-95c4588aed16 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:21.253756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1368/2709] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:01:21.255957 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96c78c-9d3e-4ad2-bde6-26f54dd667b2 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:21.271311 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96c78c-9d3e-4ad2-bde6-26f54dd667b2 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:21.278063 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b0654-ec41-4434-a84f-369e210fab0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:21.278966 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b0654-ec41-4434-a84f-369e210fab0e admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:21.279469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b0654-ec41-4434-a84f-369e210fab0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:21.279955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b0654-ec41-4434-a84f-369e210fab0e admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:21.281358 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b0654-ec41-4434-a84f-369e210fab0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:21.284546 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b0654-ec41-4434-a84f-369e210fab0e admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:21.306227 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1342/2710] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:01:21.312340 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67612588-69af-412e-a1e3-95c4588aed16 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:21.330603 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67612588-69af-412e-a1e3-95c4588aed16 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:21.338375 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355f8fe-7e3b-4451-adda-478c2654a395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:21.339813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355f8fe-7e3b-4451-adda-478c2654a395 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:21.340272 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355f8fe-7e3b-4451-adda-478c2654a395 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:21.340727 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8355f8fe-7e3b-4451-adda-478c2654a395 admin admin] PATH_INFO: `/v3/projects/0e70fc37651d49fc90e66a5de0510e21/users/2ff77054d0e04dd88c94d6cb510a341d/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:21.367706 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355f8fe-7e3b-4451-adda-478c2654a395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e70fc37651d49fc90e66a5de0510e21, user_id=2ff77054d0e04dd88c94d6cb510a341d, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:21.371363 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8355f8fe-7e3b-4451-adda-478c2654a395 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:21.396941 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1369/2711] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:01:21 2022] PUT /identity/v3/projects/0e70fc37651d49fc90e66a5de0510e21/users/2ff77054d0e04dd88c94d6cb510a341d/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:01:21.415822 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8b2cd-800d-43a3-8cda-937613608706 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:21.417093 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8b2cd-800d-43a3-8cda-937613608706 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:21.417573 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8b2cd-800d-43a3-8cda-937613608706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:21.476261 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-d0e8b2cd-800d-43a3-8cda-937613608706 None None] MFA Rules not processed for user `2ff77054d0e04dd88c94d6cb510a341d`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:21.477738 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-d0e8b2cd-800d-43a3-8cda-937613608706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:21.525150 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:21.527487 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355f8fe-7e3b-4451-adda-478c2654a395 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:21.530181 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-8355f8fe-7e3b-4451-adda-478c2654a395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:21.582881 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1343/2712] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:21 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:01:21.588426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8b2cd-800d-43a3-8cda-937613608706 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:21.625407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8355f8fe-7e3b-4451-adda-478c2654a395 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:21.631124 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940d10d-d8c2-41fd-b205-56efbda834a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:21.632058 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940d10d-d8c2-41fd-b205-56efbda834a1 service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:21.632475 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940d10d-d8c2-41fd-b205-56efbda834a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:21.632896 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940d10d-d8c2-41fd-b205-56efbda834a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:21.635556 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-1940d10d-d8c2-41fd-b205-56efbda834a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:21.678190 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8b2cd-800d-43a3-8cda-937613608706 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:21.683061 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a11f14-3195-4dc7-9a3f-04ec12d3e40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:21.683742 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a11f14-3195-4dc7-9a3f-04ec12d3e40e admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:21.684026 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a11f14-3195-4dc7-9a3f-04ec12d3e40e admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:21.684301 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a11f14-3195-4dc7-9a3f-04ec12d3e40e admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:21.685027 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a11f14-3195-4dc7-9a3f-04ec12d3e40e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:21.687059 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a11f14-3195-4dc7-9a3f-04ec12d3e40e admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:21.719240 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:21.730482 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1344/2713] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:01:21 2022] POST /identity/v3/projects => generated 357 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 16:01:21.732531 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a11f14-3195-4dc7-9a3f-04ec12d3e40e admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:21.744941 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940d10d-d8c2-41fd-b205-56efbda834a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:21.746908 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940d10d-d8c2-41fd-b205-56efbda834a1 service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:21.760828 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1370/2714] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 16:01:21.824455 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a11f14-3195-4dc7-9a3f-04ec12d3e40e admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:21.831697 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccae6f-106e-4354-af86-d41d170fd7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:21.832963 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccae6f-106e-4354-af86-d41d170fd7de admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:21.833409 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccae6f-106e-4354-af86-d41d170fd7de admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:21.833903 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccae6f-106e-4354-af86-d41d170fd7de admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:21.835051 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccae6f-106e-4354-af86-d41d170fd7de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:21.838065 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccae6f-106e-4354-af86-d41d170fd7de admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:21.871761 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1345/2715] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:01:21 2022] POST /identity/v3/users => generated 285 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:01:21.875658 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940d10d-d8c2-41fd-b205-56efbda834a1 service cinder] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:21.894228 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940d10d-d8c2-41fd-b205-56efbda834a1 service cinder] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:21.903535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6a12d-6ee2-4a7c-8a6b-fb1522a499c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:21.904558 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6a12d-6ee2-4a7c-8a6b-fb1522a499c8 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:21.905017 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6a12d-6ee2-4a7c-8a6b-fb1522a499c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:21.905479 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6a12d-6ee2-4a7c-8a6b-fb1522a499c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:21.914366 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6a12d-6ee2-4a7c-8a6b-fb1522a499c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:21.916277 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6a12d-6ee2-4a7c-8a6b-fb1522a499c8 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:21.929009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1371/2716] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:01:21.934274 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccae6f-106e-4354-af86-d41d170fd7de admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:21.945911 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccae6f-106e-4354-af86-d41d170fd7de admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:21.952308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53434a4f-6e12-447d-9f81-cf3a0b967ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:21.953439 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53434a4f-6e12-447d-9f81-cf3a0b967ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:21.954643 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53434a4f-6e12-447d-9f81-cf3a0b967ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:21.955054 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53434a4f-6e12-447d-9f81-cf3a0b967ae7 admin admin] PATH_INFO: `/v3/projects/1ce7d21b89b34252acb9be9686521d9b/users/8f2eca9a562f4b7aa9a49133228730da/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:21.977972 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53434a4f-6e12-447d-9f81-cf3a0b967ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ce7d21b89b34252acb9be9686521d9b, user_id=8f2eca9a562f4b7aa9a49133228730da, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:21.981305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53434a4f-6e12-447d-9f81-cf3a0b967ae7 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:21.997361 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1346/2717] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:01:21 2022] PUT /identity/v3/projects/1ce7d21b89b34252acb9be9686521d9b/users/8f2eca9a562f4b7aa9a49133228730da/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:01:22.001822 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6a12d-6ee2-4a7c-8a6b-fb1522a499c8 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:22.017303 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6a12d-6ee2-4a7c-8a6b-fb1522a499c8 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:22.091985 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64cbcf5-79da-4b6d-940b-49366ae3923e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:22.092800 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cbcf5-79da-4b6d-940b-49366ae3923e admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:22.093189 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cbcf5-79da-4b6d-940b-49366ae3923e admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:22.093565 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64cbcf5-79da-4b6d-940b-49366ae3923e admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:22.095010 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64cbcf5-79da-4b6d-940b-49366ae3923e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:22.096929 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64cbcf5-79da-4b6d-940b-49366ae3923e admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:22.111198 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1372/2718] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:01:22.116970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53434a4f-6e12-447d-9f81-cf3a0b967ae7 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:22.131665 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53434a4f-6e12-447d-9f81-cf3a0b967ae7 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:22.137207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21083e22-c678-4aa5-bc36-b862742096ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:22.138201 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21083e22-c678-4aa5-bc36-b862742096ee admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:22.138496 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21083e22-c678-4aa5-bc36-b862742096ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:22.138780 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21083e22-c678-4aa5-bc36-b862742096ee admin admin] PATH_INFO: `/v3/projects/1ce7d21b89b34252acb9be9686521d9b/users/8f2eca9a562f4b7aa9a49133228730da/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:22.141107 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21083e22-c678-4aa5-bc36-b862742096ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ce7d21b89b34252acb9be9686521d9b, user_id=8f2eca9a562f4b7aa9a49133228730da, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:22.144026 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21083e22-c678-4aa5-bc36-b862742096ee admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:22.157651 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1347/2719] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:01:22 2022] PUT /identity/v3/projects/1ce7d21b89b34252acb9be9686521d9b/users/8f2eca9a562f4b7aa9a49133228730da/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:01:22.169397 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c93e07-e502-4a6f-87de-796893aae0d0 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:22.169694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c93e07-e502-4a6f-87de-796893aae0d0 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:22.170034 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c93e07-e502-4a6f-87de-796893aae0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:22.201730 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-a6c93e07-e502-4a6f-87de-796893aae0d0 None None] MFA Rules not processed for user `8f2eca9a562f4b7aa9a49133228730da`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:22.203069 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-a6c93e07-e502-4a6f-87de-796893aae0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:22.282732 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1373/2720] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:22 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:01:22.295768 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21083e22-c678-4aa5-bc36-b862742096ee admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:22.311799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:22.367682 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21083e22-c678-4aa5-bc36-b862742096ee admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:22.372603 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b7b4c-973b-443a-8d23-7ca69839226b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:22.373329 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b7b4c-973b-443a-8d23-7ca69839226b service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:22.373683 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b7b4c-973b-443a-8d23-7ca69839226b service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:22.374104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b7b4c-973b-443a-8d23-7ca69839226b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:22.384953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b7b4c-973b-443a-8d23-7ca69839226b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:22.386639 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b7b4c-973b-443a-8d23-7ca69839226b service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:22.398896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1348/2721] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:22 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:01:22.497328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c93e07-e502-4a6f-87de-796893aae0d0 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:22.499112 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-a6c93e07-e502-4a6f-87de-796893aae0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:22.514310 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c93e07-e502-4a6f-87de-796893aae0d0 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:22.519869 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2861c-12a6-4452-b436-deadee45181d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:22.520724 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2861c-12a6-4452-b436-deadee45181d service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:22.521145 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2861c-12a6-4452-b436-deadee45181d service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:22.521737 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2861c-12a6-4452-b436-deadee45181d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:22.589255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:22.592441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2861c-12a6-4452-b436-deadee45181d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:22.595148 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2861c-12a6-4452-b436-deadee45181d service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:22.606414 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1374/2722] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:22 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:01:25.908459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b7b4c-973b-443a-8d23-7ca69839226b service cinder] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:25.910360 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-c87b7b4c-973b-443a-8d23-7ca69839226b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:26.006789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b7b4c-973b-443a-8d23-7ca69839226b service cinder] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:26.013204 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20626bf1-49db-49cf-a8e8-d8382a374023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:26.015076 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20626bf1-49db-49cf-a8e8-d8382a374023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:26.015677 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20626bf1-49db-49cf-a8e8-d8382a374023 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:26.016987 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20626bf1-49db-49cf-a8e8-d8382a374023 admin admin] PATH_INFO: `/v3/users/c8d4a140f8e04331a7ff8c387833dddd` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:26.019952 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20626bf1-49db-49cf-a8e8-d8382a374023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d4a140f8e04331a7ff8c387833dddd)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:26.024027 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20626bf1-49db-49cf-a8e8-d8382a374023 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:26.102441 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-20626bf1-49db-49cf-a8e8-d8382a374023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d4a140f8e04331a7ff8c387833dddd'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:26.112418 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-20626bf1-49db-49cf-a8e8-d8382a374023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d4a140f8e04331a7ff8c387833dddd'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:26.113552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-20626bf1-49db-49cf-a8e8-d8382a374023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d4a140f8e04331a7ff8c387833dddd'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:26.114384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-20626bf1-49db-49cf-a8e8-d8382a374023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d4a140f8e04331a7ff8c387833dddd'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:26.134700 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-20626bf1-49db-49cf-a8e8-d8382a374023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d4a140f8e04331a7ff8c387833dddd'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:26.157959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1349/2723] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:01:25 2022] DELETE /identity/v3/users/c8d4a140f8e04331a7ff8c387833dddd => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:26.163813 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c4a09-3af1-4966-ae47-34b3d9357c0c None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:26.164635 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c4a09-3af1-4966-ae47-34b3d9357c0c None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:26.164852 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c4a09-3af1-4966-ae47-34b3d9357c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:26.194043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-ec1c4a09-3af1-4966-ae47-34b3d9357c0c None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:26.195331 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ec1c4a09-3af1-4966-ae47-34b3d9357c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:26.278595 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1375/2724] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:26.302808 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20626bf1-49db-49cf-a8e8-d8382a374023 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:26.305230 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-20626bf1-49db-49cf-a8e8-d8382a374023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:26.366098 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:26.399477 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20626bf1-49db-49cf-a8e8-d8382a374023 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:26.405558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9e49d-a16e-450a-9328-75ad5258299b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:26.406310 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9e49d-a16e-450a-9328-75ad5258299b service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:26.406726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9e49d-a16e-450a-9328-75ad5258299b service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:26.406983 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9e49d-a16e-450a-9328-75ad5258299b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:26.418720 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9e49d-a16e-450a-9328-75ad5258299b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:26.420272 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c9e49d-a16e-450a-9328-75ad5258299b service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:26.433544 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1350/2725] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:01:26.836041 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c4a09-3af1-4966-ae47-34b3d9357c0c None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:26.838024 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ec1c4a09-3af1-4966-ae47-34b3d9357c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:26.854632 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c4a09-3af1-4966-ae47-34b3d9357c0c None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:26.861173 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661612a-450a-4631-bf88-5597d9c99130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:26.862268 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661612a-450a-4631-bf88-5597d9c99130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:26.862653 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661612a-450a-4631-bf88-5597d9c99130 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:26.863202 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661612a-450a-4631-bf88-5597d9c99130 admin admin] PATH_INFO: `/v3/projects/7150b5a1917b410f8b5991da7826252b` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:26.864923 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661612a-450a-4631-bf88-5597d9c99130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7150b5a1917b410f8b5991da7826252b)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:26.868086 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661612a-450a-4631-bf88-5597d9c99130 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:26.942451 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d661612a-450a-4631-bf88-5597d9c99130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7150b5a1917b410f8b5991da7826252b', 'request_id': 'req-d661612a-450a-4631-bf88-5597d9c99130'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:26.951651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d661612a-450a-4631-bf88-5597d9c99130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7150b5a1917b410f8b5991da7826252b', 'request_id': 'req-d661612a-450a-4631-bf88-5597d9c99130'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:26.963379 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d661612a-450a-4631-bf88-5597d9c99130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7150b5a1917b410f8b5991da7826252b', 'request_id': 'req-d661612a-450a-4631-bf88-5597d9c99130'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:26.977540 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d661612a-450a-4631-bf88-5597d9c99130 admin admin] The token cache is being invalidate because project 7150b5a1917b410f8b5991da7826252b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:01:26.977941 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d661612a-450a-4631-bf88-5597d9c99130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:26.978680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d661612a-450a-4631-bf88-5597d9c99130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:26.980340 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1376/2726] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:01:26 2022] DELETE /identity/v3/projects/7150b5a1917b410f8b5991da7826252b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:01:26.984512 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9e49d-a16e-450a-9328-75ad5258299b service neutron] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:26.997174 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c9e49d-a16e-450a-9328-75ad5258299b service neutron] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:27.099084 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b958b-d83b-4b02-b679-cfd670871075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:27.099992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b958b-d83b-4b02-b679-cfd670871075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:27.100288 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b958b-d83b-4b02-b679-cfd670871075 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:27.100576 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b958b-d83b-4b02-b679-cfd670871075 admin admin] PATH_INFO: `/v3/users/32da52ac60be4d85b3c7cab9019604b2` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:27.102192 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b958b-d83b-4b02-b679-cfd670871075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32da52ac60be4d85b3c7cab9019604b2)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:27.104244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b958b-d83b-4b02-b679-cfd670871075 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:27.177781 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-450b958b-d83b-4b02-b679-cfd670871075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32da52ac60be4d85b3c7cab9019604b2'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:27.187021 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-450b958b-d83b-4b02-b679-cfd670871075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32da52ac60be4d85b3c7cab9019604b2'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:27.188384 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-450b958b-d83b-4b02-b679-cfd670871075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32da52ac60be4d85b3c7cab9019604b2'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:27.189058 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-450b958b-d83b-4b02-b679-cfd670871075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32da52ac60be4d85b3c7cab9019604b2'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:27.205991 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-450b958b-d83b-4b02-b679-cfd670871075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32da52ac60be4d85b3c7cab9019604b2'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:27.225228 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1351/2727] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:01:26 2022] DELETE /identity/v3/users/32da52ac60be4d85b3c7cab9019604b2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:27.595019 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661612a-450a-4631-bf88-5597d9c99130 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:27.597050 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-d661612a-450a-4631-bf88-5597d9c99130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:27.616901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661612a-450a-4631-bf88-5597d9c99130 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:27.687460 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45649e63-ccf2-4e66-b0ca-823edc0a0818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:27.690988 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45649e63-ccf2-4e66-b0ca-823edc0a0818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:27.691284 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45649e63-ccf2-4e66-b0ca-823edc0a0818 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:27.692745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45649e63-ccf2-4e66-b0ca-823edc0a0818 admin admin] PATH_INFO: `/v3/projects/98befa552888475a8c70080ef56d98db` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:27.693131 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45649e63-ccf2-4e66-b0ca-823edc0a0818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98befa552888475a8c70080ef56d98db)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:27.695046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45649e63-ccf2-4e66-b0ca-823edc0a0818 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:27.722478 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:27.754747 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-45649e63-ccf2-4e66-b0ca-823edc0a0818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98befa552888475a8c70080ef56d98db', 'request_id': 'req-45649e63-ccf2-4e66-b0ca-823edc0a0818'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:27.762458 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-45649e63-ccf2-4e66-b0ca-823edc0a0818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98befa552888475a8c70080ef56d98db', 'request_id': 'req-45649e63-ccf2-4e66-b0ca-823edc0a0818'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:27.773754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-45649e63-ccf2-4e66-b0ca-823edc0a0818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98befa552888475a8c70080ef56d98db', 'request_id': 'req-45649e63-ccf2-4e66-b0ca-823edc0a0818'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:27.791540 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-45649e63-ccf2-4e66-b0ca-823edc0a0818 admin admin] The token cache is being invalidate because project 98befa552888475a8c70080ef56d98db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:01:27.791842 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-45649e63-ccf2-4e66-b0ca-823edc0a0818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:27.792744 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-45649e63-ccf2-4e66-b0ca-823edc0a0818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:27.794956 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1377/2728] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:01:27 2022] DELETE /identity/v3/projects/98befa552888475a8c70080ef56d98db => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:01:27.800000 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b958b-d83b-4b02-b679-cfd670871075 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:27.801617 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-450b958b-d83b-4b02-b679-cfd670871075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:27.817095 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b958b-d83b-4b02-b679-cfd670871075 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:27.877294 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:27.888200 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade7923-adc9-455d-8917-5b83cbb20640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:27.889347 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade7923-adc9-455d-8917-5b83cbb20640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:27.889948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade7923-adc9-455d-8917-5b83cbb20640 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:27.890327 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade7923-adc9-455d-8917-5b83cbb20640 admin admin] PATH_INFO: `/v3/users/f83d9e47318d4d388c961196ff2c0283` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:27.891934 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade7923-adc9-455d-8917-5b83cbb20640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f83d9e47318d4d388c961196ff2c0283)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:27.894358 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade7923-adc9-455d-8917-5b83cbb20640 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:27.957640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-1ade7923-adc9-455d-8917-5b83cbb20640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f83d9e47318d4d388c961196ff2c0283'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:27.971300 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-1ade7923-adc9-455d-8917-5b83cbb20640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f83d9e47318d4d388c961196ff2c0283'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:27.972583 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-1ade7923-adc9-455d-8917-5b83cbb20640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f83d9e47318d4d388c961196ff2c0283'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:27.973518 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-1ade7923-adc9-455d-8917-5b83cbb20640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f83d9e47318d4d388c961196ff2c0283'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:27.996389 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-1ade7923-adc9-455d-8917-5b83cbb20640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f83d9e47318d4d388c961196ff2c0283'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:28.015106 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1352/2729] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:01:27 2022] DELETE /identity/v3/users/f83d9e47318d4d388c961196ff2c0283 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:28.660016 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45649e63-ccf2-4e66-b0ca-823edc0a0818 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:28.662119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-45649e63-ccf2-4e66-b0ca-823edc0a0818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:28.681310 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45649e63-ccf2-4e66-b0ca-823edc0a0818 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:28.775179 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68db9a2-1309-4a36-ad4a-ca10a3b7dc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:28.776088 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68db9a2-1309-4a36-ad4a-ca10a3b7dc88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:28.776381 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68db9a2-1309-4a36-ad4a-ca10a3b7dc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:28.776667 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68db9a2-1309-4a36-ad4a-ca10a3b7dc88 admin admin] PATH_INFO: `/v3/projects/dbc8fa113cbb499e97f67fd69920b823` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:28.778365 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68db9a2-1309-4a36-ad4a-ca10a3b7dc88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbc8fa113cbb499e97f67fd69920b823)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:28.780447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68db9a2-1309-4a36-ad4a-ca10a3b7dc88 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:28.859990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d68db9a2-1309-4a36-ad4a-ca10a3b7dc88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbc8fa113cbb499e97f67fd69920b823', 'request_id': 'req-d68db9a2-1309-4a36-ad4a-ca10a3b7dc88'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:28.869657 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d68db9a2-1309-4a36-ad4a-ca10a3b7dc88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbc8fa113cbb499e97f67fd69920b823', 'request_id': 'req-d68db9a2-1309-4a36-ad4a-ca10a3b7dc88'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:28.880538 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d68db9a2-1309-4a36-ad4a-ca10a3b7dc88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbc8fa113cbb499e97f67fd69920b823', 'request_id': 'req-d68db9a2-1309-4a36-ad4a-ca10a3b7dc88'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:28.898681 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d68db9a2-1309-4a36-ad4a-ca10a3b7dc88 admin admin] The token cache is being invalidate because project dbc8fa113cbb499e97f67fd69920b823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:01:28.899150 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d68db9a2-1309-4a36-ad4a-ca10a3b7dc88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:28.900260 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d68db9a2-1309-4a36-ad4a-ca10a3b7dc88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:28.902644 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1378/2730] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:01:28 2022] DELETE /identity/v3/projects/dbc8fa113cbb499e97f67fd69920b823 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:28.910799 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64d654-cd92-4927-99fc-20d653bcd814 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:28.911216 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64d654-cd92-4927-99fc-20d653bcd814 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:28.911572 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f64d654-cd92-4927-99fc-20d653bcd814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:28.935755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-7f64d654-cd92-4927-99fc-20d653bcd814 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:28.937526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-7f64d654-cd92-4927-99fc-20d653bcd814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:29.027490 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1353/2731] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:29.037562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f3086-de54-470b-ac8d-596ebbbb7af9 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:29.038115 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f3086-de54-470b-ac8d-596ebbbb7af9 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:29.038614 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f3086-de54-470b-ac8d-596ebbbb7af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:29.062178 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-d34f3086-de54-470b-ac8d-596ebbbb7af9 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:29.064213 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-d34f3086-de54-470b-ac8d-596ebbbb7af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:29.076445 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1379/2732] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:29.083060 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64d654-cd92-4927-99fc-20d653bcd814 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:29.098768 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f64d654-cd92-4927-99fc-20d653bcd814 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:29.105485 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf280c-de63-473b-a860-8eb13d05401a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:29.106218 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf280c-de63-473b-a860-8eb13d05401a admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:29.106503 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf280c-de63-473b-a860-8eb13d05401a admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:29.106788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf280c-de63-473b-a860-8eb13d05401a admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:29.107541 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf280c-de63-473b-a860-8eb13d05401a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:01:29.107852 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf280c-de63-473b-a860-8eb13d05401a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:29.109609 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf280c-de63-473b-a860-8eb13d05401a admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:29.130213 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1354/2733] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 16:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:01:29.135225 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f3086-de54-470b-ac8d-596ebbbb7af9 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:29.146062 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f3086-de54-470b-ac8d-596ebbbb7af9 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:29.156478 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac8042-b099-4072-bd59-d70979923997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:29.157528 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac8042-b099-4072-bd59-d70979923997 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:29.157832 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac8042-b099-4072-bd59-d70979923997 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:29.158290 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac8042-b099-4072-bd59-d70979923997 admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:29.159004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac8042-b099-4072-bd59-d70979923997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:29.161240 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac8042-b099-4072-bd59-d70979923997 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:29.195648 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1380/2734] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:01:29 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:01:29.200631 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf280c-de63-473b-a860-8eb13d05401a admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:29.213119 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf280c-de63-473b-a860-8eb13d05401a admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:29.309344 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9a6cb-230d-4553-9db5-194716d7199c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:29.310278 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9a6cb-230d-4553-9db5-194716d7199c admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:29.310625 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9a6cb-230d-4553-9db5-194716d7199c admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:29.310967 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9a6cb-230d-4553-9db5-194716d7199c admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:29.311740 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9a6cb-230d-4553-9db5-194716d7199c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:29.315085 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9a6cb-230d-4553-9db5-194716d7199c admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:29.324438 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:29.358226 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1355/2735] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:01:29 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:01:29.364389 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac8042-b099-4072-bd59-d70979923997 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:29.383140 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac8042-b099-4072-bd59-d70979923997 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:29.391004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153d92c-834b-48b7-bcb1-af70ecd71a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:29.392165 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153d92c-834b-48b7-bcb1-af70ecd71a14 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:29.392667 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153d92c-834b-48b7-bcb1-af70ecd71a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:29.393232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153d92c-834b-48b7-bcb1-af70ecd71a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:29.394941 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153d92c-834b-48b7-bcb1-af70ecd71a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:29.398157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153d92c-834b-48b7-bcb1-af70ecd71a14 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:29.408895 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:29.423659 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1381/2736] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 16:01:29.428672 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9a6cb-230d-4553-9db5-194716d7199c admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:29.440594 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9a6cb-230d-4553-9db5-194716d7199c admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:29.445684 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877513dd-e502-42f8-839f-2bcdda7c092d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:29.446417 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877513dd-e502-42f8-839f-2bcdda7c092d admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:29.446700 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877513dd-e502-42f8-839f-2bcdda7c092d admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:29.446979 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877513dd-e502-42f8-839f-2bcdda7c092d admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:29.447772 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877513dd-e502-42f8-839f-2bcdda7c092d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:29.449385 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877513dd-e502-42f8-839f-2bcdda7c092d admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:29.461756 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1356/2737] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:01:29.467180 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153d92c-834b-48b7-bcb1-af70ecd71a14 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:29.485596 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153d92c-834b-48b7-bcb1-af70ecd71a14 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:29.492371 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b5201-147a-4edd-9c7f-0d8783f187f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:29.493942 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b5201-147a-4edd-9c7f-0d8783f187f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:29.494462 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b5201-147a-4edd-9c7f-0d8783f187f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:29.494967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991b5201-147a-4edd-9c7f-0d8783f187f8 admin admin] PATH_INFO: `/v3/projects/2787068060d14f89bdb977a17e682487/users/c8f9d409702a4c2592c8110480de67a6/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:29.524287 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b5201-147a-4edd-9c7f-0d8783f187f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2787068060d14f89bdb977a17e682487, user_id=c8f9d409702a4c2592c8110480de67a6, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:29.527840 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991b5201-147a-4edd-9c7f-0d8783f187f8 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:29.552765 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1382/2738] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:01:29 2022] PUT /identity/v3/projects/2787068060d14f89bdb977a17e682487/users/c8f9d409702a4c2592c8110480de67a6/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:29.558266 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6565a44-a015-4dc8-817b-abd657234311 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:29.558721 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6565a44-a015-4dc8-817b-abd657234311 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:29.559126 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6565a44-a015-4dc8-817b-abd657234311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:29.590994 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-c6565a44-a015-4dc8-817b-abd657234311 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:29.592374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-c6565a44-a015-4dc8-817b-abd657234311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:29.679525 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1357/2739] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:29.690125 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b5201-147a-4edd-9c7f-0d8783f187f8 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:29.693169 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-991b5201-147a-4edd-9c7f-0d8783f187f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:29.762907 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991b5201-147a-4edd-9c7f-0d8783f187f8 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:29.775247 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14410b81-543b-44a7-928c-bcbddaa7ec68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:29.776075 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14410b81-543b-44a7-928c-bcbddaa7ec68 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:29.776447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14410b81-543b-44a7-928c-bcbddaa7ec68 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:29.776908 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14410b81-543b-44a7-928c-bcbddaa7ec68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:29.794104 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14410b81-543b-44a7-928c-bcbddaa7ec68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:29.795615 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14410b81-543b-44a7-928c-bcbddaa7ec68 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:29.807927 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1383/2740] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 16:01:33.922663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6565a44-a015-4dc8-817b-abd657234311 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:33.924294 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-c6565a44-a015-4dc8-817b-abd657234311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:33.937304 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6565a44-a015-4dc8-817b-abd657234311 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:33.942564 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd79b56-9ab8-4590-8761-638d93438e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:33.944006 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd79b56-9ab8-4590-8761-638d93438e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:33.944290 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd79b56-9ab8-4590-8761-638d93438e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:33.944740 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd79b56-9ab8-4590-8761-638d93438e7c admin admin] PATH_INFO: `/v3/users/7019bd6ed83c4fe8bacd01b17b081ac9` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:33.946179 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd79b56-9ab8-4590-8761-638d93438e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7019bd6ed83c4fe8bacd01b17b081ac9)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:33.948426 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd79b56-9ab8-4590-8761-638d93438e7c admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:34.051294 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-fcd79b56-9ab8-4590-8761-638d93438e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7019bd6ed83c4fe8bacd01b17b081ac9'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:34.067157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-fcd79b56-9ab8-4590-8761-638d93438e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7019bd6ed83c4fe8bacd01b17b081ac9'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:34.069581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-fcd79b56-9ab8-4590-8761-638d93438e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7019bd6ed83c4fe8bacd01b17b081ac9'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:34.071257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-fcd79b56-9ab8-4590-8761-638d93438e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7019bd6ed83c4fe8bacd01b17b081ac9'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:34.097157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-fcd79b56-9ab8-4590-8761-638d93438e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7019bd6ed83c4fe8bacd01b17b081ac9'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:34.122091 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1358/2741] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:01:33 2022] DELETE /identity/v3/users/7019bd6ed83c4fe8bacd01b17b081ac9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:34.123898 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c8387-9f65-4d02-9672-55ba71af199a None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:34.124652 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c8387-9f65-4d02-9672-55ba71af199a None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:34.124652 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c8387-9f65-4d02-9672-55ba71af199a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:34.144521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-e64c8387-9f65-4d02-9672-55ba71af199a None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:34.145812 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e64c8387-9f65-4d02-9672-55ba71af199a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:34.227837 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1384/2742] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:34.242437 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd79b56-9ab8-4590-8761-638d93438e7c admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:34.246168 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-fcd79b56-9ab8-4590-8761-638d93438e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:34.363380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd79b56-9ab8-4590-8761-638d93438e7c admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:34.367834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24d687-e98c-4fde-b215-dd5c2394f16e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:34.368511 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24d687-e98c-4fde-b215-dd5c2394f16e service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:34.368792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24d687-e98c-4fde-b215-dd5c2394f16e service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:34.369438 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24d687-e98c-4fde-b215-dd5c2394f16e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:34.377786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:34.385893 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24d687-e98c-4fde-b215-dd5c2394f16e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:34.388252 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24d687-e98c-4fde-b215-dd5c2394f16e service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:34.399973 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1359/2743] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:01:34.994738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c8387-9f65-4d02-9672-55ba71af199a None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:34.997148 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e64c8387-9f65-4d02-9672-55ba71af199a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:35.069094 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c8387-9f65-4d02-9672-55ba71af199a None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:35.088494 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860a1b5-5e19-44cb-bf0a-5ec1743740fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:35.089909 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860a1b5-5e19-44cb-bf0a-5ec1743740fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:35.092802 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860a1b5-5e19-44cb-bf0a-5ec1743740fb admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:35.093276 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860a1b5-5e19-44cb-bf0a-5ec1743740fb admin admin] PATH_INFO: `/v3/projects/178e54c0c0cb4a68ad0d7ed057bdab18` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:35.098810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860a1b5-5e19-44cb-bf0a-5ec1743740fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=178e54c0c0cb4a68ad0d7ed057bdab18)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:35.102696 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860a1b5-5e19-44cb-bf0a-5ec1743740fb admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:35.206776 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-a860a1b5-5e19-44cb-bf0a-5ec1743740fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '178e54c0c0cb4a68ad0d7ed057bdab18', 'request_id': 'req-a860a1b5-5e19-44cb-bf0a-5ec1743740fb'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:35.222665 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-a860a1b5-5e19-44cb-bf0a-5ec1743740fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '178e54c0c0cb4a68ad0d7ed057bdab18', 'request_id': 'req-a860a1b5-5e19-44cb-bf0a-5ec1743740fb'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:35.233758 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-a860a1b5-5e19-44cb-bf0a-5ec1743740fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '178e54c0c0cb4a68ad0d7ed057bdab18', 'request_id': 'req-a860a1b5-5e19-44cb-bf0a-5ec1743740fb'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:35.254372 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-a860a1b5-5e19-44cb-bf0a-5ec1743740fb admin admin] The token cache is being invalidate because project 178e54c0c0cb4a68ad0d7ed057bdab18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:01:35.254671 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-a860a1b5-5e19-44cb-bf0a-5ec1743740fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:35.255705 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-a860a1b5-5e19-44cb-bf0a-5ec1743740fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:35.257738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1385/2744] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:01:34 2022] DELETE /identity/v3/projects/178e54c0c0cb4a68ad0d7ed057bdab18 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:35.264341 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e18fb-6085-4f9f-ae18-6fd8af5a74f5 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:35.265504 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e18fb-6085-4f9f-ae18-6fd8af5a74f5 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:35.266118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e18fb-6085-4f9f-ae18-6fd8af5a74f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:35.287983 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-362e18fb-6085-4f9f-ae18-6fd8af5a74f5 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:35.289702 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-362e18fb-6085-4f9f-ae18-6fd8af5a74f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:35.410686 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1360/2745] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:35.429039 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce9e2f-8541-4e03-ada1-7f5420e283e0 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:35.429694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce9e2f-8541-4e03-ada1-7f5420e283e0 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:35.430479 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce9e2f-8541-4e03-ada1-7f5420e283e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:35.447360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:35.474389 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-e1ce9e2f-8541-4e03-ada1-7f5420e283e0 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:35.475840 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e1ce9e2f-8541-4e03-ada1-7f5420e283e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:35.488769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1386/2746] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:35.492469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e18fb-6085-4f9f-ae18-6fd8af5a74f5 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:35.505125 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e18fb-6085-4f9f-ae18-6fd8af5a74f5 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:35.514322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8633f3-9be0-4328-b73e-397e0dd7acf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:35.515034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8633f3-9be0-4328-b73e-397e0dd7acf4 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:35.515323 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8633f3-9be0-4328-b73e-397e0dd7acf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:35.515615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8633f3-9be0-4328-b73e-397e0dd7acf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:35.516726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8633f3-9be0-4328-b73e-397e0dd7acf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:01:35.517046 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8633f3-9be0-4328-b73e-397e0dd7acf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:35.518988 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8633f3-9be0-4328-b73e-397e0dd7acf4 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:35.539987 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1361/2747] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 16:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:01:35.540706 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce9e2f-8541-4e03-ada1-7f5420e283e0 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:35.552543 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce9e2f-8541-4e03-ada1-7f5420e283e0 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:35.559095 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c414f11-6883-4dbd-84b3-99ecfbb0c64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:35.560499 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c414f11-6883-4dbd-84b3-99ecfbb0c64d admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:35.561044 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c414f11-6883-4dbd-84b3-99ecfbb0c64d admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:35.561557 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c414f11-6883-4dbd-84b3-99ecfbb0c64d admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:35.563563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c414f11-6883-4dbd-84b3-99ecfbb0c64d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:35.565886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c414f11-6883-4dbd-84b3-99ecfbb0c64d admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:35.614902 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1387/2748] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:01:35 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 16:01:35.618948 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8633f3-9be0-4328-b73e-397e0dd7acf4 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:35.647754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c20164-f7a7-45f3-a7fe-6ee0dc57d630 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:35.648048 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c20164-f7a7-45f3-a7fe-6ee0dc57d630 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:35.648559 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c20164-f7a7-45f3-a7fe-6ee0dc57d630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:35.652891 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8633f3-9be0-4328-b73e-397e0dd7acf4 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:35.695043 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-e0c20164-f7a7-45f3-a7fe-6ee0dc57d630 None None] MFA Rules not processed for user `c8f9d409702a4c2592c8110480de67a6`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:35.696469 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e0c20164-f7a7-45f3-a7fe-6ee0dc57d630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:35.789928 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1388/2749] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:01:35.792289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c20164-f7a7-45f3-a7fe-6ee0dc57d630 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:35.793902 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e0c20164-f7a7-45f3-a7fe-6ee0dc57d630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:35.825059 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dee31a-4632-401c-b348-76e9772f7299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:35.826953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dee31a-4632-401c-b348-76e9772f7299 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:35.828027 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dee31a-4632-401c-b348-76e9772f7299 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:35.828260 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dee31a-4632-401c-b348-76e9772f7299 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:35.829569 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dee31a-4632-401c-b348-76e9772f7299 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:35.852151 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dee31a-4632-401c-b348-76e9772f7299 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:35.892675 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c20164-f7a7-45f3-a7fe-6ee0dc57d630 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:35.900903 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34c494-1fd3-4e93-9fd9-91994649cb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:35.901604 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34c494-1fd3-4e93-9fd9-91994649cb19 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:35.901933 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34c494-1fd3-4e93-9fd9-91994649cb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:35.902261 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34c494-1fd3-4e93-9fd9-91994649cb19 admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:35.905428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34c494-1fd3-4e93-9fd9-91994649cb19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:35.905644 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1362/2750] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:01:35 2022] POST /identity/v3/users => generated 292 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:01:35.910166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34c494-1fd3-4e93-9fd9-91994649cb19 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:35.923156 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dee31a-4632-401c-b348-76e9772f7299 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:35.950510 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1389/2751] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:01:35 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 16:01:35.954947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34c494-1fd3-4e93-9fd9-91994649cb19 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:35.962908 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dee31a-4632-401c-b348-76e9772f7299 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:36.037575 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:36.071845 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34c494-1fd3-4e93-9fd9-91994649cb19 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:36.074723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ecb2d3-d13a-46a0-9d23-0ba2e012d540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:36.075932 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecb2d3-d13a-46a0-9d23-0ba2e012d540 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:36.076411 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecb2d3-d13a-46a0-9d23-0ba2e012d540 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:36.076877 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecb2d3-d13a-46a0-9d23-0ba2e012d540 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:36.077886 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ecb2d3-d13a-46a0-9d23-0ba2e012d540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:36.080392 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ecb2d3-d13a-46a0-9d23-0ba2e012d540 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:36.095316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d211c-c011-47b9-80b0-fb916acec4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:36.095316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d211c-c011-47b9-80b0-fb916acec4ac admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:36.095316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d211c-c011-47b9-80b0-fb916acec4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:36.095316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d211c-c011-47b9-80b0-fb916acec4ac admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:36.095659 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d211c-c011-47b9-80b0-fb916acec4ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:36.103934 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1363/2752] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:01:36.108490 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d211c-c011-47b9-80b0-fb916acec4ac admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:36.112934 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ecb2d3-d13a-46a0-9d23-0ba2e012d540 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:36.135647 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ecb2d3-d13a-46a0-9d23-0ba2e012d540 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:36.143724 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8d5e3-cb73-4de3-8871-277a5bcc3304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:36.144738 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8d5e3-cb73-4de3-8871-277a5bcc3304 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:36.145028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8d5e3-cb73-4de3-8871-277a5bcc3304 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:36.145305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8d5e3-cb73-4de3-8871-277a5bcc3304 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:36.146771 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8d5e3-cb73-4de3-8871-277a5bcc3304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:36.149105 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8d5e3-cb73-4de3-8871-277a5bcc3304 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:36.150361 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1390/2753] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:01:35 2022] POST /identity/v3/users => generated 299 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 16:01:36.156026 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:36.161426 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d211c-c011-47b9-80b0-fb916acec4ac admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:36.163931 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1364/2754] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:01:36.168357 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8d5e3-cb73-4de3-8871-277a5bcc3304 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:36.185833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d211c-c011-47b9-80b0-fb916acec4ac admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:36.193150 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f6377-ea80-4290-be15-a4941e254b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:36.193966 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f6377-ea80-4290-be15-a4941e254b93 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:36.194336 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f6377-ea80-4290-be15-a4941e254b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:36.194714 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f6377-ea80-4290-be15-a4941e254b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:36.195877 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f6377-ea80-4290-be15-a4941e254b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:36.197803 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8d5e3-cb73-4de3-8871-277a5bcc3304 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:36.198227 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f6377-ea80-4290-be15-a4941e254b93 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:36.212876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1391/2755] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 16:01:36.217518 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f6377-ea80-4290-be15-a4941e254b93 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:36.220849 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec40ac5-4eb6-4684-9fca-83a897d2f28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:36.222332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec40ac5-4eb6-4684-9fca-83a897d2f28f admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:36.222895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec40ac5-4eb6-4684-9fca-83a897d2f28f admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:36.223389 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec40ac5-4eb6-4684-9fca-83a897d2f28f admin admin] PATH_INFO: `/v3/projects/20dc30708c2a450485f7374b5d412c8a/users/ecf8b9c7f12444f19eeb5971a7cae4e2/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:36.255698 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec40ac5-4eb6-4684-9fca-83a897d2f28f admin admin] RBAC: Authorizing `identity:create_grant(project_id=20dc30708c2a450485f7374b5d412c8a, user_id=ecf8b9c7f12444f19eeb5971a7cae4e2, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:36.258214 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec40ac5-4eb6-4684-9fca-83a897d2f28f admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:36.261025 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f6377-ea80-4290-be15-a4941e254b93 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:36.268258 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2dd6c-2238-463e-a141-4b3186357fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:36.269223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2dd6c-2238-463e-a141-4b3186357fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:36.269639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2dd6c-2238-463e-a141-4b3186357fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:36.270058 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2dd6c-2238-463e-a141-4b3186357fcc admin admin] PATH_INFO: `/v3/projects/e422f3922dc04477b279c79492d35594/users/758540e026ae463982e93aa006e8e547/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:36.291974 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1365/2756] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:01:36 2022] PUT /identity/v3/projects/20dc30708c2a450485f7374b5d412c8a/users/ecf8b9c7f12444f19eeb5971a7cae4e2/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:01:36.292560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2dd6c-2238-463e-a141-4b3186357fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e422f3922dc04477b279c79492d35594, user_id=758540e026ae463982e93aa006e8e547, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:36.299448 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2dd6c-2238-463e-a141-4b3186357fcc admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:36.299917 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65faed9-0aaa-4cbc-846b-fe554eddc585 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:36.300530 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65faed9-0aaa-4cbc-846b-fe554eddc585 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:36.301107 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65faed9-0aaa-4cbc-846b-fe554eddc585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:36.326730 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1392/2757] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:01:36 2022] PUT /identity/v3/projects/e422f3922dc04477b279c79492d35594/users/758540e026ae463982e93aa006e8e547/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:36.333659 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2dd6c-2238-463e-a141-4b3186357fcc admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:36.339352 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-b65faed9-0aaa-4cbc-846b-fe554eddc585 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:36.340954 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-b65faed9-0aaa-4cbc-846b-fe554eddc585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:36.421607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1366/2758] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:01:36.436039 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65faed9-0aaa-4cbc-846b-fe554eddc585 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:36.443672 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-b65faed9-0aaa-4cbc-846b-fe554eddc585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:36.476574 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2dd6c-2238-463e-a141-4b3186357fcc admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:36.482843 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b05db-98c7-4063-83ac-4f0c3abc382c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:36.483609 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b05db-98c7-4063-83ac-4f0c3abc382c admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:36.485104 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b05db-98c7-4063-83ac-4f0c3abc382c admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:36.485104 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b05db-98c7-4063-83ac-4f0c3abc382c admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:36.485104 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b05db-98c7-4063-83ac-4f0c3abc382c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:36.487525 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b05db-98c7-4063-83ac-4f0c3abc382c admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:36.503598 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1393/2759] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:01:36.511128 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b05db-98c7-4063-83ac-4f0c3abc382c admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:36.514115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65faed9-0aaa-4cbc-846b-fe554eddc585 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:36.518559 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339ce00-6a0e-4fcb-9115-5cd9f3af1ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:36.519400 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339ce00-6a0e-4fcb-9115-5cd9f3af1ccb service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:36.519872 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339ce00-6a0e-4fcb-9115-5cd9f3af1ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:36.520252 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339ce00-6a0e-4fcb-9115-5cd9f3af1ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:36.522336 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b05db-98c7-4063-83ac-4f0c3abc382c admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:36.527662 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297c022-b70b-4cfa-a565-1867a117e1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:36.528589 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297c022-b70b-4cfa-a565-1867a117e1cb admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:36.528880 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297c022-b70b-4cfa-a565-1867a117e1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:36.529160 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297c022-b70b-4cfa-a565-1867a117e1cb admin admin] PATH_INFO: `/v3/projects/e422f3922dc04477b279c79492d35594/users/758540e026ae463982e93aa006e8e547/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:36.531995 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297c022-b70b-4cfa-a565-1867a117e1cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e422f3922dc04477b279c79492d35594, user_id=758540e026ae463982e93aa006e8e547, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:36.533823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339ce00-6a0e-4fcb-9115-5cd9f3af1ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:36.535049 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297c022-b70b-4cfa-a565-1867a117e1cb admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:36.535590 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339ce00-6a0e-4fcb-9115-5cd9f3af1ccb service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:36.549600 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1394/2760] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:01:36 2022] PUT /identity/v3/projects/e422f3922dc04477b279c79492d35594/users/758540e026ae463982e93aa006e8e547/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:01:36.561749 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1367/2761] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 16:01:37.760103 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c96f2-e055-4c4f-bdd0-1a4c8c6d3b9d None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:37.761516 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c96f2-e055-4c4f-bdd0-1a4c8c6d3b9d None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:37.762180 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c96f2-e055-4c4f-bdd0-1a4c8c6d3b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:37.851787 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-9a6c96f2-e055-4c4f-bdd0-1a4c8c6d3b9d None None] MFA Rules not processed for user `ecf8b9c7f12444f19eeb5971a7cae4e2`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:37.853731 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-9a6c96f2-e055-4c4f-bdd0-1a4c8c6d3b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:38.003300 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1395/2762] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:38.003753 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339ce00-6a0e-4fcb-9115-5cd9f3af1ccb service neutron] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:38.005493 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-1339ce00-6a0e-4fcb-9115-5cd9f3af1ccb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:38.089430 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339ce00-6a0e-4fcb-9115-5cd9f3af1ccb service neutron] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:38.152101 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:38.205893 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2d86e-6108-4ffa-b63e-407b2ee62c42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:38.206417 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2d86e-6108-4ffa-b63e-407b2ee62c42 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:38.208055 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2d86e-6108-4ffa-b63e-407b2ee62c42 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:38.208055 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2d86e-6108-4ffa-b63e-407b2ee62c42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:38.224842 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2d86e-6108-4ffa-b63e-407b2ee62c42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:38.227118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2d86e-6108-4ffa-b63e-407b2ee62c42 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:38.240914 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1368/2763] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 16:01:39.629065 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c96f2-e055-4c4f-bdd0-1a4c8c6d3b9d None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:39.631458 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-9a6c96f2-e055-4c4f-bdd0-1a4c8c6d3b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:39.661526 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:39.746881 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c96f2-e055-4c4f-bdd0-1a4c8c6d3b9d None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:39.759447 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14574da5-e4e4-4748-9dd3-7663a1a75e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:39.760932 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14574da5-e4e4-4748-9dd3-7663a1a75e76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:39.761276 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14574da5-e4e4-4748-9dd3-7663a1a75e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:39.761718 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14574da5-e4e4-4748-9dd3-7663a1a75e76 admin admin] PATH_INFO: `/v3/users/2ff77054d0e04dd88c94d6cb510a341d` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:39.763596 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14574da5-e4e4-4748-9dd3-7663a1a75e76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ff77054d0e04dd88c94d6cb510a341d)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:39.766640 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14574da5-e4e4-4748-9dd3-7663a1a75e76 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:39.885649 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-14574da5-e4e4-4748-9dd3-7663a1a75e76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ff77054d0e04dd88c94d6cb510a341d'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:39.922230 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-14574da5-e4e4-4748-9dd3-7663a1a75e76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ff77054d0e04dd88c94d6cb510a341d'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:39.923297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-14574da5-e4e4-4748-9dd3-7663a1a75e76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ff77054d0e04dd88c94d6cb510a341d'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:39.924113 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-14574da5-e4e4-4748-9dd3-7663a1a75e76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ff77054d0e04dd88c94d6cb510a341d'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:39.925339 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56041dd2-8bde-4c55-b615-019dead8869e None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:39.926100 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56041dd2-8bde-4c55-b615-019dead8869e None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:39.927247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56041dd2-8bde-4c55-b615-019dead8869e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:39.958809 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-14574da5-e4e4-4748-9dd3-7663a1a75e76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ff77054d0e04dd88c94d6cb510a341d'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:39.972275 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-56041dd2-8bde-4c55-b615-019dead8869e None None] MFA Rules not processed for user `ecf8b9c7f12444f19eeb5971a7cae4e2`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:39.975917 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-56041dd2-8bde-4c55-b615-019dead8869e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:39.994246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1396/2764] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:01:39 2022] DELETE /identity/v3/users/2ff77054d0e04dd88c94d6cb510a341d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:40.000763 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1369/2765] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:40.004810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db00fca-2fb3-4ee6-a0f0-0557a4aa0a37 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:40.005465 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db00fca-2fb3-4ee6-a0f0-0557a4aa0a37 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:40.006015 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db00fca-2fb3-4ee6-a0f0-0557a4aa0a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:40.041369 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-0db00fca-2fb3-4ee6-a0f0-0557a4aa0a37 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:40.042776 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-0db00fca-2fb3-4ee6-a0f0-0557a4aa0a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:40.077755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56041dd2-8bde-4c55-b615-019dead8869e None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:40.081075 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-56041dd2-8bde-4c55-b615-019dead8869e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:40.202133 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1397/2766] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:40.204407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db00fca-2fb3-4ee6-a0f0-0557a4aa0a37 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:40.209692 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-0db00fca-2fb3-4ee6-a0f0-0557a4aa0a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:40.260672 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56041dd2-8bde-4c55-b615-019dead8869e None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:40.330257 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:40.397185 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db00fca-2fb3-4ee6-a0f0-0557a4aa0a37 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:40.403072 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48398f18-15a2-4c5e-b665-126b32c6fdfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:40.404323 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48398f18-15a2-4c5e-b665-126b32c6fdfe service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:40.404920 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48398f18-15a2-4c5e-b665-126b32c6fdfe service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:40.407003 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48398f18-15a2-4c5e-b665-126b32c6fdfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:40.409166 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504ff23-b680-43ee-974c-b3a0f7af9a09 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79239c95306c43f0a1a0b51715440009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:40.412458 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504ff23-b680-43ee-974c-b3a0f7af9a09 service glance] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:40.414236 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504ff23-b680-43ee-974c-b3a0f7af9a09 service glance] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:40.414566 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504ff23-b680-43ee-974c-b3a0f7af9a09 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:40.421137 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-6504ff23-b680-43ee-974c-b3a0f7af9a09 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:40.423882 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48398f18-15a2-4c5e-b665-126b32c6fdfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:40.425417 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48398f18-15a2-4c5e-b665-126b32c6fdfe service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:40.439974 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1398/2767] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:01:40.702713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504ff23-b680-43ee-974c-b3a0f7af9a09 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:40.714956 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504ff23-b680-43ee-974c-b3a0f7af9a09 service glance] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:40.752955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1370/2768] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 676 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:01:41.364616 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48398f18-15a2-4c5e-b665-126b32c6fdfe service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:41.367088 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-48398f18-15a2-4c5e-b665-126b32c6fdfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:41.415155 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48398f18-15a2-4c5e-b665-126b32c6fdfe service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:41.440389 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b8250-2d27-48f1-b593-e9a43765ae4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:41.442061 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b8250-2d27-48f1-b593-e9a43765ae4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:41.442579 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b8250-2d27-48f1-b593-e9a43765ae4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:41.443071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b8250-2d27-48f1-b593-e9a43765ae4a admin admin] PATH_INFO: `/v3/projects/0e70fc37651d49fc90e66a5de0510e21` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:41.448680 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b8250-2d27-48f1-b593-e9a43765ae4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e70fc37651d49fc90e66a5de0510e21)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:41.452570 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b8250-2d27-48f1-b593-e9a43765ae4a admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:41.656615 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-111b8250-2d27-48f1-b593-e9a43765ae4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e70fc37651d49fc90e66a5de0510e21', 'request_id': 'req-111b8250-2d27-48f1-b593-e9a43765ae4a'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:41.681800 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-111b8250-2d27-48f1-b593-e9a43765ae4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e70fc37651d49fc90e66a5de0510e21', 'request_id': 'req-111b8250-2d27-48f1-b593-e9a43765ae4a'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:41.706235 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-111b8250-2d27-48f1-b593-e9a43765ae4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e70fc37651d49fc90e66a5de0510e21', 'request_id': 'req-111b8250-2d27-48f1-b593-e9a43765ae4a'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:41.750948 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-111b8250-2d27-48f1-b593-e9a43765ae4a admin admin] The token cache is being invalidate because project 0e70fc37651d49fc90e66a5de0510e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:01:41.751414 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-111b8250-2d27-48f1-b593-e9a43765ae4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:41.755993 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-111b8250-2d27-48f1-b593-e9a43765ae4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:41.763599 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1399/2769] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:01:41 2022] DELETE /identity/v3/projects/0e70fc37651d49fc90e66a5de0510e21 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:41.766351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504ff23-b680-43ee-974c-b3a0f7af9a09 service glance] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:41.812063 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504ff23-b680-43ee-974c-b3a0f7af9a09 service glance] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:41.893380 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:42.040992 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780089bd-73ff-43a8-b10f-8b93cac524fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:42.043259 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780089bd-73ff-43a8-b10f-8b93cac524fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:42.045559 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780089bd-73ff-43a8-b10f-8b93cac524fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:42.046689 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780089bd-73ff-43a8-b10f-8b93cac524fd admin admin] PATH_INFO: `/v3/users/8f2eca9a562f4b7aa9a49133228730da` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:42.052565 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780089bd-73ff-43a8-b10f-8b93cac524fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f2eca9a562f4b7aa9a49133228730da)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:42.058876 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780089bd-73ff-43a8-b10f-8b93cac524fd admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:42.252436 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-780089bd-73ff-43a8-b10f-8b93cac524fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f2eca9a562f4b7aa9a49133228730da'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:42.311722 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-780089bd-73ff-43a8-b10f-8b93cac524fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f2eca9a562f4b7aa9a49133228730da'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:42.315750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-780089bd-73ff-43a8-b10f-8b93cac524fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f2eca9a562f4b7aa9a49133228730da'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:42.318447 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-780089bd-73ff-43a8-b10f-8b93cac524fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f2eca9a562f4b7aa9a49133228730da'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:42.388202 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-780089bd-73ff-43a8-b10f-8b93cac524fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f2eca9a562f4b7aa9a49133228730da'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:42.393688 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b8250-2d27-48f1-b593-e9a43765ae4a admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:42.396826 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-111b8250-2d27-48f1-b593-e9a43765ae4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:42.482669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1371/2770] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:01:41 2022] DELETE /identity/v3/users/8f2eca9a562f4b7aa9a49133228730da => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:42.482669 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780089bd-73ff-43a8-b10f-8b93cac524fd admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:42.504855 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-780089bd-73ff-43a8-b10f-8b93cac524fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:42.652072 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b8250-2d27-48f1-b593-e9a43765ae4a admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:42.760716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780089bd-73ff-43a8-b10f-8b93cac524fd admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:42.775218 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88d8db-4bc4-454b-a82c-f3e080a494b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:42.777785 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88d8db-4bc4-454b-a82c-f3e080a494b3 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:42.778482 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88d8db-4bc4-454b-a82c-f3e080a494b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:42.778873 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88d8db-4bc4-454b-a82c-f3e080a494b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:42.785718 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-bc88d8db-4bc4-454b-a82c-f3e080a494b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:42.806262 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82ada4-d526-4f64-81fb-27b65594d38a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9300c3a803e94f9a93442f551fc9646f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:42.807122 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82ada4-d526-4f64-81fb-27b65594d38a service placement] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:42.807496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82ada4-d526-4f64-81fb-27b65594d38a service placement] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:42.807886 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82ada4-d526-4f64-81fb-27b65594d38a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:42.815195 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-4b82ada4-d526-4f64-81fb-27b65594d38a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:42.837675 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:42.856005 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82ada4-d526-4f64-81fb-27b65594d38a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:42.873742 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82ada4-d526-4f64-81fb-27b65594d38a service placement] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:42.926862 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1400/2771] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:01:43.112224 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:43.213427 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88d8db-4bc4-454b-a82c-f3e080a494b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:43.215306 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88d8db-4bc4-454b-a82c-f3e080a494b3 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:43.233685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1372/2772] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 753 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:01:43.724368 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82ada4-d526-4f64-81fb-27b65594d38a service placement] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:43.727088 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-4b82ada4-d526-4f64-81fb-27b65594d38a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:44.050258 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82ada4-d526-4f64-81fb-27b65594d38a service placement] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:44.088081 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e74be64-9695-404b-b6a5-d1485b9058a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:44.091477 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74be64-9695-404b-b6a5-d1485b9058a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:44.092289 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74be64-9695-404b-b6a5-d1485b9058a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:44.092739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74be64-9695-404b-b6a5-d1485b9058a2 admin admin] PATH_INFO: `/v3/projects/1ce7d21b89b34252acb9be9686521d9b` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:44.095590 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74be64-9695-404b-b6a5-d1485b9058a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ce7d21b89b34252acb9be9686521d9b)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:44.098330 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e74be64-9695-404b-b6a5-d1485b9058a2 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:44.232429 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8e74be64-9695-404b-b6a5-d1485b9058a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ce7d21b89b34252acb9be9686521d9b', 'request_id': 'req-8e74be64-9695-404b-b6a5-d1485b9058a2'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:44.251816 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8e74be64-9695-404b-b6a5-d1485b9058a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ce7d21b89b34252acb9be9686521d9b', 'request_id': 'req-8e74be64-9695-404b-b6a5-d1485b9058a2'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:44.269217 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8e74be64-9695-404b-b6a5-d1485b9058a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ce7d21b89b34252acb9be9686521d9b', 'request_id': 'req-8e74be64-9695-404b-b6a5-d1485b9058a2'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:44.334870 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8e74be64-9695-404b-b6a5-d1485b9058a2 admin admin] The token cache is being invalidate because project 1ce7d21b89b34252acb9be9686521d9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:01:44.335549 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8e74be64-9695-404b-b6a5-d1485b9058a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:44.336868 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8e74be64-9695-404b-b6a5-d1485b9058a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:44.345578 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1401/2773] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:01:43 2022] DELETE /identity/v3/projects/1ce7d21b89b34252acb9be9686521d9b => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:44.352769 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43f168-526b-4fd5-a70f-86d7cb786138 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:44.353566 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43f168-526b-4fd5-a70f-86d7cb786138 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:44.353566 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43f168-526b-4fd5-a70f-86d7cb786138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:44.397891 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-7b43f168-526b-4fd5-a70f-86d7cb786138 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:44.399640 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-7b43f168-526b-4fd5-a70f-86d7cb786138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:44.587524 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1373/2774] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:44.594695 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e448746-9e18-43a7-8c47-8927966295b5 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:44.596215 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e448746-9e18-43a7-8c47-8927966295b5 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:44.597229 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e448746-9e18-43a7-8c47-8927966295b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:44.637748 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-5e448746-9e18-43a7-8c47-8927966295b5 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:44.640169 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5e448746-9e18-43a7-8c47-8927966295b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:44.671829 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1402/2775] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:44.672744 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43f168-526b-4fd5-a70f-86d7cb786138 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:44.693080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43f168-526b-4fd5-a70f-86d7cb786138 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:44.718033 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356f296-f9b0-4f8d-baa1-07b803d72884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:44.724492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356f296-f9b0-4f8d-baa1-07b803d72884 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:44.725198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356f296-f9b0-4f8d-baa1-07b803d72884 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:44.725674 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356f296-f9b0-4f8d-baa1-07b803d72884 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:44.728050 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356f296-f9b0-4f8d-baa1-07b803d72884 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:01:44.728602 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356f296-f9b0-4f8d-baa1-07b803d72884 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:44.731887 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356f296-f9b0-4f8d-baa1-07b803d72884 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:44.761896 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1374/2776] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 16:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:01:44.769837 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e448746-9e18-43a7-8c47-8927966295b5 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:44.806426 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e448746-9e18-43a7-8c47-8927966295b5 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:44.833133 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ce4a7-6779-4d2a-883d-2b88e6dc7f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:44.833840 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ce4a7-6779-4d2a-883d-2b88e6dc7f1f admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:44.834161 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ce4a7-6779-4d2a-883d-2b88e6dc7f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:44.834446 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ce4a7-6779-4d2a-883d-2b88e6dc7f1f admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:44.835164 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ce4a7-6779-4d2a-883d-2b88e6dc7f1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:44.837158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185ce4a7-6779-4d2a-883d-2b88e6dc7f1f admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:44.891694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1403/2777] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:01:44 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:01:44.897889 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356f296-f9b0-4f8d-baa1-07b803d72884 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:44.912520 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356f296-f9b0-4f8d-baa1-07b803d72884 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:45.015500 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940966e-886f-43e1-89a4-ac1463a6103f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:45.017141 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940966e-886f-43e1-89a4-ac1463a6103f admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:45.017141 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940966e-886f-43e1-89a4-ac1463a6103f admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:45.017141 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940966e-886f-43e1-89a4-ac1463a6103f admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:45.018173 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940966e-886f-43e1-89a4-ac1463a6103f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:45.023203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940966e-886f-43e1-89a4-ac1463a6103f admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:45.056306 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ad74e-7ddc-4aee-b174-f4dd396325bf None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:45.057044 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ad74e-7ddc-4aee-b174-f4dd396325bf None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:45.057900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ad74e-7ddc-4aee-b174-f4dd396325bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:45.075263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1375/2778] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:01:44 2022] POST /identity/v3/users => generated 283 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 16:01:45.081772 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940966e-886f-43e1-89a4-ac1463a6103f admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:45.103084 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-118ad74e-7ddc-4aee-b174-f4dd396325bf None None] MFA Rules not processed for user `758540e026ae463982e93aa006e8e547`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:45.103560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940966e-886f-43e1-89a4-ac1463a6103f admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:45.105612 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-118ad74e-7ddc-4aee-b174-f4dd396325bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:45.115327 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aec03a-ab5a-43e0-ad9c-503e43be4925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:45.117326 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aec03a-ab5a-43e0-ad9c-503e43be4925 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:45.117492 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aec03a-ab5a-43e0-ad9c-503e43be4925 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:45.117952 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aec03a-ab5a-43e0-ad9c-503e43be4925 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:45.118615 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aec03a-ab5a-43e0-ad9c-503e43be4925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:45.121985 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aec03a-ab5a-43e0-ad9c-503e43be4925 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:45.142274 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1376/2779] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 16:01:45.147851 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aec03a-ab5a-43e0-ad9c-503e43be4925 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:45.171831 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aec03a-ab5a-43e0-ad9c-503e43be4925 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:45.186486 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68282362-1c5c-47b0-82ca-315998d2ffdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:45.188865 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68282362-1c5c-47b0-82ca-315998d2ffdc admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:45.189087 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68282362-1c5c-47b0-82ca-315998d2ffdc admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:45.189181 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68282362-1c5c-47b0-82ca-315998d2ffdc admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:45.190041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68282362-1c5c-47b0-82ca-315998d2ffdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:45.192944 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68282362-1c5c-47b0-82ca-315998d2ffdc admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:45.221906 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1377/2780] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:01:45.226374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68282362-1c5c-47b0-82ca-315998d2ffdc admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:45.228430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:45.240700 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68282362-1c5c-47b0-82ca-315998d2ffdc admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:45.245824 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46d941-4a6f-40ff-a9a3-4c2be81ebf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:45.247028 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46d941-4a6f-40ff-a9a3-4c2be81ebf9b admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:45.247308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46d941-4a6f-40ff-a9a3-4c2be81ebf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:45.247746 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46d941-4a6f-40ff-a9a3-4c2be81ebf9b admin admin] PATH_INFO: `/v3/projects/d82da71de2db4c8b936998f2cd5ee36d/users/7729c93dccfd4483935463fed5249bb1/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:45.268500 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46d941-4a6f-40ff-a9a3-4c2be81ebf9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d82da71de2db4c8b936998f2cd5ee36d, user_id=7729c93dccfd4483935463fed5249bb1, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:45.271436 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46d941-4a6f-40ff-a9a3-4c2be81ebf9b admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:45.284160 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1404/2781] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:45.300338 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1378/2782] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:01:45 2022] PUT /identity/v3/projects/d82da71de2db4c8b936998f2cd5ee36d/users/7729c93dccfd4483935463fed5249bb1/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:45.303150 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ad74e-7ddc-4aee-b174-f4dd396325bf None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:45.305684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-118ad74e-7ddc-4aee-b174-f4dd396325bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:45.316271 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74009f80-10ab-4106-8aff-a543a1a42454 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:45.316599 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74009f80-10ab-4106-8aff-a543a1a42454 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:45.316849 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74009f80-10ab-4106-8aff-a543a1a42454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:45.360716 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-74009f80-10ab-4106-8aff-a543a1a42454 None None] MFA Rules not processed for user `7729c93dccfd4483935463fed5249bb1`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:45.362922 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-74009f80-10ab-4106-8aff-a543a1a42454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:45.374004 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:45.402311 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ad74e-7ddc-4aee-b174-f4dd396325bf None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:45.477576 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1379/2783] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:01:45.478804 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74009f80-10ab-4106-8aff-a543a1a42454 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:45.496354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6deea-178f-4220-b353-16a9c35804f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79239c95306c43f0a1a0b51715440009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:45.497035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6deea-178f-4220-b353-16a9c35804f6 service glance] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:45.497320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6deea-178f-4220-b353-16a9c35804f6 service glance] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:45.497602 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6deea-178f-4220-b353-16a9c35804f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:45.499815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-86a6deea-178f-4220-b353-16a9c35804f6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:45.583231 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6deea-178f-4220-b353-16a9c35804f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:45.584819 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6deea-178f-4220-b353-16a9c35804f6 service glance] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:45.589331 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74009f80-10ab-4106-8aff-a543a1a42454 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:45.598966 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41c303-8e61-4941-a4d5-8f2151052579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:45.600458 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41c303-8e61-4941-a4d5-8f2151052579 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:45.600602 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1405/2784] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 16:01:45.602396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41c303-8e61-4941-a4d5-8f2151052579 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:45.602667 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41c303-8e61-4941-a4d5-8f2151052579 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:45.603536 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41c303-8e61-4941-a4d5-8f2151052579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:45.605935 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41c303-8e61-4941-a4d5-8f2151052579 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:45.644250 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1380/2785] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:01:45 2022] POST /identity/v3/projects => generated 361 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:01:45.647701 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6deea-178f-4220-b353-16a9c35804f6 service glance] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:45.660953 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6deea-178f-4220-b353-16a9c35804f6 service glance] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:45.748320 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:45.769211 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd5c6d-e5bc-4b1f-a404-479de62d8d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:45.769999 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd5c6d-e5bc-4b1f-a404-479de62d8d37 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:45.770624 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd5c6d-e5bc-4b1f-a404-479de62d8d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:45.770860 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd5c6d-e5bc-4b1f-a404-479de62d8d37 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:45.771693 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd5c6d-e5bc-4b1f-a404-479de62d8d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:45.773445 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1f6bf-8dee-42dc-8a17-b0496a9513de None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:45.773987 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd5c6d-e5bc-4b1f-a404-479de62d8d37 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:45.774170 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1f6bf-8dee-42dc-8a17-b0496a9513de None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:45.774655 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1f6bf-8dee-42dc-8a17-b0496a9513de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:45.806331 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-14a1f6bf-8dee-42dc-8a17-b0496a9513de None None] MFA Rules not processed for user `dbf2c12174e94e2db9be178973183ced`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:45.807759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-14a1f6bf-8dee-42dc-8a17-b0496a9513de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:45.816766 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1406/2786] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:01:45 2022] POST /identity/v3/users => generated 287 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 16:01:45.820921 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd5c6d-e5bc-4b1f-a404-479de62d8d37 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:45.838969 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd5c6d-e5bc-4b1f-a404-479de62d8d37 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:45.864771 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a850e7-b9b8-43e3-aee5-8657407d35d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:45.866330 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a850e7-b9b8-43e3-aee5-8657407d35d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:45.866669 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a850e7-b9b8-43e3-aee5-8657407d35d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:45.866949 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a850e7-b9b8-43e3-aee5-8657407d35d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:45.867729 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a850e7-b9b8-43e3-aee5-8657407d35d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:45.869408 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a850e7-b9b8-43e3-aee5-8657407d35d2 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:45.898361 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1407/2787] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 16:01:45.902819 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a850e7-b9b8-43e3-aee5-8657407d35d2 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:45.912496 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1381/2788] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 23 16:01:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:45.918023 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a850e7-b9b8-43e3-aee5-8657407d35d2 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:45.924589 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8dbded-a2ab-4a49-b657-25ae32e573d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:45.924937 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dbded-a2ab-4a49-b657-25ae32e573d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:45.925203 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dbded-a2ab-4a49-b657-25ae32e573d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:45.925484 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dbded-a2ab-4a49-b657-25ae32e573d8 admin admin] PATH_INFO: `/v3/projects/3f0803f6b92c4aceb98224e7d783d1b4/users/5e7ed486b898437482bf8f20b47c8f6b/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:45.951237 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8dbded-a2ab-4a49-b657-25ae32e573d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f0803f6b92c4aceb98224e7d783d1b4, user_id=5e7ed486b898437482bf8f20b47c8f6b, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:45.955260 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8dbded-a2ab-4a49-b657-25ae32e573d8 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:45.968395 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1f6bf-8dee-42dc-8a17-b0496a9513de None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:45.970827 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-14a1f6bf-8dee-42dc-8a17-b0496a9513de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:45.990302 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1408/2789] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:01:45 2022] PUT /identity/v3/projects/3f0803f6b92c4aceb98224e7d783d1b4/users/5e7ed486b898437482bf8f20b47c8f6b/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:01:45.994315 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8dbded-a2ab-4a49-b657-25ae32e573d8 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:46.039543 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:46.098387 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1f6bf-8dee-42dc-8a17-b0496a9513de None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:46.118941 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8dbded-a2ab-4a49-b657-25ae32e573d8 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:46.125777 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f32b4-4d74-46fa-959b-fd44d7a1d955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:46.126815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f32b4-4d74-46fa-959b-fd44d7a1d955 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:46.127201 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f32b4-4d74-46fa-959b-fd44d7a1d955 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:46.127586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f32b4-4d74-46fa-959b-fd44d7a1d955 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:46.128475 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f32b4-4d74-46fa-959b-fd44d7a1d955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:46.130351 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f32b4-4d74-46fa-959b-fd44d7a1d955 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:46.142473 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1409/2790] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:01:46.143566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f32b4-4d74-46fa-959b-fd44d7a1d955 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:46.145647 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-a33f32b4-4d74-46fa-959b-fd44d7a1d955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:46.202552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fbb15-8c39-4db9-9361-c3f260bb9b68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5824ee17e276483faf20db88a93545f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:46.202552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fbb15-8c39-4db9-9361-c3f260bb9b68 service swift] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:46.202552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fbb15-8c39-4db9-9361-c3f260bb9b68 service swift] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:46.202552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fbb15-8c39-4db9-9361-c3f260bb9b68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:46.234097 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f32b4-4d74-46fa-959b-fd44d7a1d955 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:46.238783 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0271d86-f24d-4ac9-8672-0eb98fb51321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:46.239471 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0271d86-f24d-4ac9-8672-0eb98fb51321 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:46.239763 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0271d86-f24d-4ac9-8672-0eb98fb51321 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:46.240046 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0271d86-f24d-4ac9-8672-0eb98fb51321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:46.242583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e0271d86-f24d-4ac9-8672-0eb98fb51321 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:46.255396 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0271d86-f24d-4ac9-8672-0eb98fb51321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:46.257188 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0271d86-f24d-4ac9-8672-0eb98fb51321 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:46.268828 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1410/2791] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:01:46.269520 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0271d86-f24d-4ac9-8672-0eb98fb51321 service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:46.283006 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0271d86-f24d-4ac9-8672-0eb98fb51321 service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:46.288474 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3e578-62fc-4b97-87f0-d88f07d694de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:46.289350 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3e578-62fc-4b97-87f0-d88f07d694de admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:46.289518 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3e578-62fc-4b97-87f0-d88f07d694de admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:46.289772 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3e578-62fc-4b97-87f0-d88f07d694de admin admin] PATH_INFO: `/v3/projects/3f0803f6b92c4aceb98224e7d783d1b4/users/5e7ed486b898437482bf8f20b47c8f6b/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:46.292449 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3e578-62fc-4b97-87f0-d88f07d694de admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f0803f6b92c4aceb98224e7d783d1b4, user_id=5e7ed486b898437482bf8f20b47c8f6b, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:46.296305 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3e578-62fc-4b97-87f0-d88f07d694de admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:46.327412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1411/2792] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:01:46 2022] PUT /identity/v3/projects/3f0803f6b92c4aceb98224e7d783d1b4/users/5e7ed486b898437482bf8f20b47c8f6b/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:46.327608 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2fbb15-8c39-4db9-9361-c3f260bb9b68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:46.327608 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2fbb15-8c39-4db9-9361-c3f260bb9b68 service swift] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:46.329580 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a5cfd-4e1d-447e-ad68-4371eced8d65 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:46.331744 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1382/2793] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 23 16:01:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 16:01:46.334557 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a5cfd-4e1d-447e-ad68-4371eced8d65 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:46.335033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a5cfd-4e1d-447e-ad68-4371eced8d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:46.391518 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-160a5cfd-4e1d-447e-ad68-4371eced8d65 None None] MFA Rules not processed for user `5e7ed486b898437482bf8f20b47c8f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:46.392122 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-160a5cfd-4e1d-447e-ad68-4371eced8d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:46.422885 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:46.625651 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1412/2794] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:46 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:46.645318 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fbb15-8c39-4db9-9361-c3f260bb9b68 service swift] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:46.650228 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-1d2fbb15-8c39-4db9-9361-c3f260bb9b68 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:46.828885 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fbb15-8c39-4db9-9361-c3f260bb9b68 service swift] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:46.901041 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=100 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:46.930694 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23301fba-09ce-4d3a-a30d-6865da6ff3e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:46.931689 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23301fba-09ce-4d3a-a30d-6865da6ff3e3 service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:46.932792 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23301fba-09ce-4d3a-a30d-6865da6ff3e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:46.933260 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23301fba-09ce-4d3a-a30d-6865da6ff3e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:46.966610 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23301fba-09ce-4d3a-a30d-6865da6ff3e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:46.968438 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23301fba-09ce-4d3a-a30d-6865da6ff3e3 service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:47.006067 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1383/2795] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:46 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:01:47.202861 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a5cfd-4e1d-447e-ad68-4371eced8d65 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:47.238116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a5cfd-4e1d-447e-ad68-4371eced8d65 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:47.256563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f95fb3-0918-4136-be69-7648b8a4bf07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:47.257716 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95fb3-0918-4136-be69-7648b8a4bf07 service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:47.258253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95fb3-0918-4136-be69-7648b8a4bf07 service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:47.258748 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f95fb3-0918-4136-be69-7648b8a4bf07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:47.486687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f95fb3-0918-4136-be69-7648b8a4bf07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:47.488714 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f95fb3-0918-4136-be69-7648b8a4bf07 service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:47.520121 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1413/2796] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:01:50.824053 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23301fba-09ce-4d3a-a30d-6865da6ff3e3 service cinder] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:50.957791 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23301fba-09ce-4d3a-a30d-6865da6ff3e3 service cinder] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:50.963759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed001445-00de-4654-ac3a-7539e2ba179c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:50.965124 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed001445-00de-4654-ac3a-7539e2ba179c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:50.965577 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed001445-00de-4654-ac3a-7539e2ba179c admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:50.966073 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed001445-00de-4654-ac3a-7539e2ba179c admin admin] PATH_INFO: `/v3/users/7729c93dccfd4483935463fed5249bb1` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:50.977772 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed001445-00de-4654-ac3a-7539e2ba179c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7729c93dccfd4483935463fed5249bb1)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:50.985928 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed001445-00de-4654-ac3a-7539e2ba179c admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:51.091522 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ed001445-00de-4654-ac3a-7539e2ba179c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7729c93dccfd4483935463fed5249bb1'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:51.105271 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ed001445-00de-4654-ac3a-7539e2ba179c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7729c93dccfd4483935463fed5249bb1'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:51.106195 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ed001445-00de-4654-ac3a-7539e2ba179c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7729c93dccfd4483935463fed5249bb1'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:51.109546 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ed001445-00de-4654-ac3a-7539e2ba179c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7729c93dccfd4483935463fed5249bb1'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:51.150519 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-ed001445-00de-4654-ac3a-7539e2ba179c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7729c93dccfd4483935463fed5249bb1'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:51.177457 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1384/2797] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:01:50 2022] DELETE /identity/v3/users/7729c93dccfd4483935463fed5249bb1 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:51.182616 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c620e6-a563-4bf2-9c4f-a8faa6b3c54a None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:51.183441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c620e6-a563-4bf2-9c4f-a8faa6b3c54a None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:51.183441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c620e6-a563-4bf2-9c4f-a8faa6b3c54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:51.204311 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-27c620e6-a563-4bf2-9c4f-a8faa6b3c54a None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:51.206333 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-27c620e6-a563-4bf2-9c4f-a8faa6b3c54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:51.293610 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1414/2798] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:51.316975 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed001445-00de-4654-ac3a-7539e2ba179c admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:51.319498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-ed001445-00de-4654-ac3a-7539e2ba179c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:51.449031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed001445-00de-4654-ac3a-7539e2ba179c admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:51.453475 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ff50b-67e8-4329-bb6a-fc713c282366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:51.454185 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ff50b-67e8-4329-bb6a-fc713c282366 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:51.454473 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ff50b-67e8-4329-bb6a-fc713c282366 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:51.454751 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ff50b-67e8-4329-bb6a-fc713c282366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:51.466795 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ff50b-67e8-4329-bb6a-fc713c282366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:51.468297 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ff50b-67e8-4329-bb6a-fc713c282366 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:51.497472 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1385/2799] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:01:52.075892 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c620e6-a563-4bf2-9c4f-a8faa6b3c54a None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:52.077561 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-27c620e6-a563-4bf2-9c4f-a8faa6b3c54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:52.127833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c620e6-a563-4bf2-9c4f-a8faa6b3c54a None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:52.138419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15317a-800c-4821-be07-cc12ce7392d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:52.140055 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15317a-800c-4821-be07-cc12ce7392d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:52.140372 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15317a-800c-4821-be07-cc12ce7392d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:52.141984 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea15317a-800c-4821-be07-cc12ce7392d9 admin admin] PATH_INFO: `/v3/projects/d82da71de2db4c8b936998f2cd5ee36d` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:52.144830 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15317a-800c-4821-be07-cc12ce7392d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d82da71de2db4c8b936998f2cd5ee36d)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:52.148265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea15317a-800c-4821-be07-cc12ce7392d9 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:52.230063 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-ea15317a-800c-4821-be07-cc12ce7392d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd82da71de2db4c8b936998f2cd5ee36d', 'request_id': 'req-ea15317a-800c-4821-be07-cc12ce7392d9'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:52.233677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:52.241190 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-ea15317a-800c-4821-be07-cc12ce7392d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd82da71de2db4c8b936998f2cd5ee36d', 'request_id': 'req-ea15317a-800c-4821-be07-cc12ce7392d9'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:52.255332 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-ea15317a-800c-4821-be07-cc12ce7392d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd82da71de2db4c8b936998f2cd5ee36d', 'request_id': 'req-ea15317a-800c-4821-be07-cc12ce7392d9'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:52.272114 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-ea15317a-800c-4821-be07-cc12ce7392d9 admin admin] The token cache is being invalidate because project d82da71de2db4c8b936998f2cd5ee36d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:01:52.272497 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-ea15317a-800c-4821-be07-cc12ce7392d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:52.273099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-ea15317a-800c-4821-be07-cc12ce7392d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:52.275306 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1415/2800] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:01:52 2022] DELETE /identity/v3/projects/d82da71de2db4c8b936998f2cd5ee36d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:01:52.279850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ff50b-67e8-4329-bb6a-fc713c282366 service neutron] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:52.285535 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:52.291744 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ff50b-67e8-4329-bb6a-fc713c282366 service neutron] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:52.384351 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafd7d2-c2c6-41b7-b497-544aa828e4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:52.385313 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafd7d2-c2c6-41b7-b497-544aa828e4c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:52.385698 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafd7d2-c2c6-41b7-b497-544aa828e4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:52.386248 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafd7d2-c2c6-41b7-b497-544aa828e4c4 admin admin] PATH_INFO: `/v3/users/5e7ed486b898437482bf8f20b47c8f6b` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:52.388427 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bafd7d2-c2c6-41b7-b497-544aa828e4c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e7ed486b898437482bf8f20b47c8f6b)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:52.392563 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bafd7d2-c2c6-41b7-b497-544aa828e4c4 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:52.472180 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-4bafd7d2-c2c6-41b7-b497-544aa828e4c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e7ed486b898437482bf8f20b47c8f6b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:52.491144 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-4bafd7d2-c2c6-41b7-b497-544aa828e4c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e7ed486b898437482bf8f20b47c8f6b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:52.492187 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-4bafd7d2-c2c6-41b7-b497-544aa828e4c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e7ed486b898437482bf8f20b47c8f6b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:52.493182 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-4bafd7d2-c2c6-41b7-b497-544aa828e4c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e7ed486b898437482bf8f20b47c8f6b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:52.518999 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-4bafd7d2-c2c6-41b7-b497-544aa828e4c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e7ed486b898437482bf8f20b47c8f6b'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:52.548497 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1386/2801] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:01:52 2022] DELETE /identity/v3/users/5e7ed486b898437482bf8f20b47c8f6b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:01:53.046006 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15317a-800c-4821-be07-cc12ce7392d9 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:53.051472 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ea15317a-800c-4821-be07-cc12ce7392d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:53.088141 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea15317a-800c-4821-be07-cc12ce7392d9 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:53.193237 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e844d7-1e8c-4680-a18f-a8bd8eb527ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:53.194407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e844d7-1e8c-4680-a18f-a8bd8eb527ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:53.194754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e844d7-1e8c-4680-a18f-a8bd8eb527ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:53.195113 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e844d7-1e8c-4680-a18f-a8bd8eb527ba admin admin] PATH_INFO: `/v3/projects/3f0803f6b92c4aceb98224e7d783d1b4` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:53.197799 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e844d7-1e8c-4680-a18f-a8bd8eb527ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f0803f6b92c4aceb98224e7d783d1b4)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:53.200985 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e844d7-1e8c-4680-a18f-a8bd8eb527ba admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:53.282840 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-f0e844d7-1e8c-4680-a18f-a8bd8eb527ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f0803f6b92c4aceb98224e7d783d1b4', 'request_id': 'req-f0e844d7-1e8c-4680-a18f-a8bd8eb527ba'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:53.294521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-f0e844d7-1e8c-4680-a18f-a8bd8eb527ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f0803f6b92c4aceb98224e7d783d1b4', 'request_id': 'req-f0e844d7-1e8c-4680-a18f-a8bd8eb527ba'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:53.309141 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-f0e844d7-1e8c-4680-a18f-a8bd8eb527ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f0803f6b92c4aceb98224e7d783d1b4', 'request_id': 'req-f0e844d7-1e8c-4680-a18f-a8bd8eb527ba'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:53.342179 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-f0e844d7-1e8c-4680-a18f-a8bd8eb527ba admin admin] The token cache is being invalidate because project 3f0803f6b92c4aceb98224e7d783d1b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:01:53.344223 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-f0e844d7-1e8c-4680-a18f-a8bd8eb527ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:53.346901 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-f0e844d7-1e8c-4680-a18f-a8bd8eb527ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:01:53.361548 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1416/2802] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:01:53 2022] DELETE /identity/v3/projects/3f0803f6b92c4aceb98224e7d783d1b4 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:53.363750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5054b-0e01-4755-bfbf-7e8e775cb7a1 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:53.364292 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5054b-0e01-4755-bfbf-7e8e775cb7a1 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:53.364462 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5054b-0e01-4755-bfbf-7e8e775cb7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:53.399685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-e6d5054b-0e01-4755-bfbf-7e8e775cb7a1 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:53.400979 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-e6d5054b-0e01-4755-bfbf-7e8e775cb7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:53.537824 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1387/2803] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:53.542425 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01c6de-600b-45f2-ab54-b94ec96e7700 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:53.542965 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01c6de-600b-45f2-ab54-b94ec96e7700 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:53.543243 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01c6de-600b-45f2-ab54-b94ec96e7700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:53.576250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-af01c6de-600b-45f2-ab54-b94ec96e7700 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:53.578554 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-af01c6de-600b-45f2-ab54-b94ec96e7700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:53.588781 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1417/2804] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:53.596181 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5054b-0e01-4755-bfbf-7e8e775cb7a1 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:53.617089 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5054b-0e01-4755-bfbf-7e8e775cb7a1 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:53.630394 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2c05a-35a6-4ed4-bf14-857561484ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:53.631577 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2c05a-35a6-4ed4-bf14-857561484ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:53.632120 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2c05a-35a6-4ed4-bf14-857561484ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:53.632614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2c05a-35a6-4ed4-bf14-857561484ed9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:53.633723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2c05a-35a6-4ed4-bf14-857561484ed9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:01:53.634145 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2c05a-35a6-4ed4-bf14-857561484ed9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:53.636109 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2c05a-35a6-4ed4-bf14-857561484ed9 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:53.656955 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1388/2805] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 16:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:01:53.661562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01c6de-600b-45f2-ab54-b94ec96e7700 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:53.674140 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01c6de-600b-45f2-ab54-b94ec96e7700 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:53.679026 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2641ef1-8af1-4914-800a-d1f25660d412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:53.679705 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2641ef1-8af1-4914-800a-d1f25660d412 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:53.680005 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2641ef1-8af1-4914-800a-d1f25660d412 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:53.680286 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2641ef1-8af1-4914-800a-d1f25660d412 admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:53.680978 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2641ef1-8af1-4914-800a-d1f25660d412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:53.682993 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2641ef1-8af1-4914-800a-d1f25660d412 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:53.716988 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1418/2806] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:01:53 2022] POST /identity/v3/projects => generated 391 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 16:01:53.722408 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2c05a-35a6-4ed4-bf14-857561484ed9 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:53.740909 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2c05a-35a6-4ed4-bf14-857561484ed9 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:53.751568 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:53.858717 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7404b9-8bf8-4d81-8f54-9e0c9b162623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:53.859818 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7404b9-8bf8-4d81-8f54-9e0c9b162623 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:53.860171 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7404b9-8bf8-4d81-8f54-9e0c9b162623 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:53.860523 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7404b9-8bf8-4d81-8f54-9e0c9b162623 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:53.861304 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7404b9-8bf8-4d81-8f54-9e0c9b162623 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:53.863513 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7404b9-8bf8-4d81-8f54-9e0c9b162623 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:53.894048 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1389/2807] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:01:53 2022] POST /identity/v3/users => generated 296 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:01:53.897816 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2641ef1-8af1-4914-800a-d1f25660d412 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:53.913182 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2641ef1-8af1-4914-800a-d1f25660d412 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:53.922505 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bdaac-d362-4581-95fc-ea99339817f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:53.923657 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bdaac-d362-4581-95fc-ea99339817f8 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:53.924131 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bdaac-d362-4581-95fc-ea99339817f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:53.924428 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bdaac-d362-4581-95fc-ea99339817f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:53.925199 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110bdaac-d362-4581-95fc-ea99339817f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:53.928711 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110bdaac-d362-4581-95fc-ea99339817f8 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:53.950738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1419/2808] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:01:53.956126 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7404b9-8bf8-4d81-8f54-9e0c9b162623 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:53.969581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7404b9-8bf8-4d81-8f54-9e0c9b162623 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:53.979051 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed57892-83b8-42c4-8ff8-c6e6e8529839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:53.979758 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed57892-83b8-42c4-8ff8-c6e6e8529839 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:53.980042 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed57892-83b8-42c4-8ff8-c6e6e8529839 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:53.980483 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed57892-83b8-42c4-8ff8-c6e6e8529839 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:53.981256 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed57892-83b8-42c4-8ff8-c6e6e8529839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:53.983044 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed57892-83b8-42c4-8ff8-c6e6e8529839 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:54.012045 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bdaac-d362-4581-95fc-ea99339817f8 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:54.014493 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1390/2809] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:01:54.027371 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bdaac-d362-4581-95fc-ea99339817f8 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:54.034866 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca546e-2bd8-46e5-a5c2-e7dfdcee887b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:54.036490 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca546e-2bd8-46e5-a5c2-e7dfdcee887b admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:54.036990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca546e-2bd8-46e5-a5c2-e7dfdcee887b admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:54.037378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca546e-2bd8-46e5-a5c2-e7dfdcee887b admin admin] PATH_INFO: `/v3/projects/4cf0f81e1371492293ba0c40062f56a6/users/a0930230610849f7b0d4f9642a235dba/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:54.063894 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca546e-2bd8-46e5-a5c2-e7dfdcee887b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cf0f81e1371492293ba0c40062f56a6, user_id=a0930230610849f7b0d4f9642a235dba, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:54.067496 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca546e-2bd8-46e5-a5c2-e7dfdcee887b admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:54.142405 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1420/2810] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:01:54 2022] PUT /identity/v3/projects/4cf0f81e1371492293ba0c40062f56a6/users/a0930230610849f7b0d4f9642a235dba/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:54.144122 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ed7a9-357a-41dd-ae0e-41db06761e56 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:54.144506 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ed7a9-357a-41dd-ae0e-41db06761e56 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:54.144809 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ed7a9-357a-41dd-ae0e-41db06761e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:54.178752 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-8d2ed7a9-357a-41dd-ae0e-41db06761e56 None None] MFA Rules not processed for user `a0930230610849f7b0d4f9642a235dba`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:54.180201 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-8d2ed7a9-357a-41dd-ae0e-41db06761e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:54.282088 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1391/2811] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:54.288018 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca546e-2bd8-46e5-a5c2-e7dfdcee887b admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:54.299317 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:54.428134 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca546e-2bd8-46e5-a5c2-e7dfdcee887b admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:54.435892 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12471da-0fa4-4098-87ba-e7c795dded1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:54.436585 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12471da-0fa4-4098-87ba-e7c795dded1b admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:54.436876 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12471da-0fa4-4098-87ba-e7c795dded1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:54.437192 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12471da-0fa4-4098-87ba-e7c795dded1b admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:54.437959 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12471da-0fa4-4098-87ba-e7c795dded1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:54.439925 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12471da-0fa4-4098-87ba-e7c795dded1b admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:54.477641 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1421/2812] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:01:54 2022] POST /identity/v3/projects => generated 393 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:01:54.479401 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ed7a9-357a-41dd-ae0e-41db06761e56 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:54.493175 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ed7a9-357a-41dd-ae0e-41db06761e56 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:54.636326 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5dcc07-35df-445b-b95a-7bd53ff0c4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:54.638119 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dcc07-35df-445b-b95a-7bd53ff0c4a5 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:54.639003 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dcc07-35df-445b-b95a-7bd53ff0c4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:54.639294 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dcc07-35df-445b-b95a-7bd53ff0c4a5 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:54.640039 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5dcc07-35df-445b-b95a-7bd53ff0c4a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:54.642726 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5dcc07-35df-445b-b95a-7bd53ff0c4a5 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:54.674670 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1392/2813] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:01:54 2022] POST /identity/v3/users => generated 303 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:01:54.680299 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12471da-0fa4-4098-87ba-e7c795dded1b admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:54.709919 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12471da-0fa4-4098-87ba-e7c795dded1b admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:54.719941 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f0762-a2b0-4d43-a3f9-cdd948bb0e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:54.721439 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f0762-a2b0-4d43-a3f9-cdd948bb0e1f admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:54.722552 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f0762-a2b0-4d43-a3f9-cdd948bb0e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:54.723149 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f0762-a2b0-4d43-a3f9-cdd948bb0e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:54.724681 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f0762-a2b0-4d43-a3f9-cdd948bb0e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:54.728675 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f0762-a2b0-4d43-a3f9-cdd948bb0e1f admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:54.760781 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1422/2814] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:01:54.768186 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5dcc07-35df-445b-b95a-7bd53ff0c4a5 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:54.786423 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5dcc07-35df-445b-b95a-7bd53ff0c4a5 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:54.793220 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eba1d1-326c-4376-8dcb-40ef6b874a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:54.794780 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eba1d1-326c-4376-8dcb-40ef6b874a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:54.795312 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eba1d1-326c-4376-8dcb-40ef6b874a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:54.795765 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eba1d1-326c-4376-8dcb-40ef6b874a5f admin admin] PATH_INFO: `/v3/projects/eb690315532645609c0977ad5e60fe95/users/ef8b6d4f8b6d48b68a95e1b304d88218/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:54.799345 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:54.822904 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eba1d1-326c-4376-8dcb-40ef6b874a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb690315532645609c0977ad5e60fe95, user_id=ef8b6d4f8b6d48b68a95e1b304d88218, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:54.826670 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eba1d1-326c-4376-8dcb-40ef6b874a5f admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:54.852385 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1393/2815] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:01:54 2022] PUT /identity/v3/projects/eb690315532645609c0977ad5e60fe95/users/ef8b6d4f8b6d48b68a95e1b304d88218/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:54.854488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f0762-a2b0-4d43-a3f9-cdd948bb0e1f admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:54.887679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f0762-a2b0-4d43-a3f9-cdd948bb0e1f admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:55.011738 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029da82a-c9f2-4a73-be33-6cfd1d5f0d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:55.012921 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029da82a-c9f2-4a73-be33-6cfd1d5f0d21 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:55.013412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029da82a-c9f2-4a73-be33-6cfd1d5f0d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:55.013811 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029da82a-c9f2-4a73-be33-6cfd1d5f0d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:55.014633 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029da82a-c9f2-4a73-be33-6cfd1d5f0d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:55.017119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029da82a-c9f2-4a73-be33-6cfd1d5f0d21 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:55.050760 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1423/2816] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:01:55.055505 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eba1d1-326c-4376-8dcb-40ef6b874a5f admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:55.082223 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eba1d1-326c-4376-8dcb-40ef6b874a5f admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:55.096614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462ae99-7eeb-4507-87e9-05089d2d8d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:55.098247 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462ae99-7eeb-4507-87e9-05089d2d8d4d admin admin] REQUEST_METHOD: `PUT` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:55.098773 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462ae99-7eeb-4507-87e9-05089d2d8d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:55.099287 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462ae99-7eeb-4507-87e9-05089d2d8d4d admin admin] PATH_INFO: `/v3/projects/eb690315532645609c0977ad5e60fe95/users/ef8b6d4f8b6d48b68a95e1b304d88218/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:55.103328 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462ae99-7eeb-4507-87e9-05089d2d8d4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb690315532645609c0977ad5e60fe95, user_id=ef8b6d4f8b6d48b68a95e1b304d88218, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:55.109526 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462ae99-7eeb-4507-87e9-05089d2d8d4d admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:55.134283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1394/2817] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:01:55 2022] PUT /identity/v3/projects/eb690315532645609c0977ad5e60fe95/users/ef8b6d4f8b6d48b68a95e1b304d88218/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:01:55.145673 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bce88-6724-44da-87a7-aa74ae9e18d0 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:55.146330 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bce88-6724-44da-87a7-aa74ae9e18d0 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:55.146739 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bce88-6724-44da-87a7-aa74ae9e18d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:55.205717 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-ca1bce88-6724-44da-87a7-aa74ae9e18d0 None None] MFA Rules not processed for user `ef8b6d4f8b6d48b68a95e1b304d88218`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:55.208260 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ca1bce88-6724-44da-87a7-aa74ae9e18d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:55.310246 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:55.325644 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1424/2818] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:01:55.336375 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462ae99-7eeb-4507-87e9-05089d2d8d4d admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:55.338206 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-5462ae99-7eeb-4507-87e9-05089d2d8d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:55.427037 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462ae99-7eeb-4507-87e9-05089d2d8d4d admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:55.431511 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba61a3-b5c1-4171-95f2-a2adc10434aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:55.432283 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba61a3-b5c1-4171-95f2-a2adc10434aa service cinder] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:55.432574 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba61a3-b5c1-4171-95f2-a2adc10434aa service cinder] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:55.433043 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba61a3-b5c1-4171-95f2-a2adc10434aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:55.446970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba61a3-b5c1-4171-95f2-a2adc10434aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:55.448564 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba61a3-b5c1-4171-95f2-a2adc10434aa service cinder] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:55.461168 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1395/2819] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:55 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:01:55.527288 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1bce88-6724-44da-87a7-aa74ae9e18d0 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:55.530389 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ca1bce88-6724-44da-87a7-aa74ae9e18d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:55.569895 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1bce88-6724-44da-87a7-aa74ae9e18d0 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:55.580328 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463da9a8-4ac9-475e-b9a1-a3fc8cab65b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:55.581397 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463da9a8-4ac9-475e-b9a1-a3fc8cab65b7 service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:55.581836 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463da9a8-4ac9-475e-b9a1-a3fc8cab65b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:55.582376 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463da9a8-4ac9-475e-b9a1-a3fc8cab65b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:55.683373 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463da9a8-4ac9-475e-b9a1-a3fc8cab65b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:55.685670 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463da9a8-4ac9-475e-b9a1-a3fc8cab65b7 service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:55.705090 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1425/2820] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:01:58.376312 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d11855-b5a8-4855-b361-e54b35f29d96 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:58.377126 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d11855-b5a8-4855-b361-e54b35f29d96 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:58.377126 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d11855-b5a8-4855-b361-e54b35f29d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:58.399814 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-39d11855-b5a8-4855-b361-e54b35f29d96 None None] MFA Rules not processed for user `c8f9d409702a4c2592c8110480de67a6`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:01:58.401237 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-39d11855-b5a8-4855-b361-e54b35f29d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:58.470848 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1396/2821] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:01:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:01:58.828855 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463da9a8-4ac9-475e-b9a1-a3fc8cab65b7 service cinder] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:01:58.830439 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-463da9a8-4ac9-475e-b9a1-a3fc8cab65b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:58.914052 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463da9a8-4ac9-475e-b9a1-a3fc8cab65b7 service cinder] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:01:58.918017 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76097b99-35c2-4e66-94e4-f0a028f4df22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:01:58.918679 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76097b99-35c2-4e66-94e4-f0a028f4df22 service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:01:58.918962 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76097b99-35c2-4e66-94e4-f0a028f4df22 service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:01:58.919240 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76097b99-35c2-4e66-94e4-f0a028f4df22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:01:58.921201 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-76097b99-35c2-4e66-94e4-f0a028f4df22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:01:58.933157 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76097b99-35c2-4e66-94e4-f0a028f4df22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:01:58.934806 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76097b99-35c2-4e66-94e4-f0a028f4df22 service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:01:58.944669 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1426/2822] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:01:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 16:01:59.995006 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d11855-b5a8-4855-b361-e54b35f29d96 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:00.078623 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d11855-b5a8-4855-b361-e54b35f29d96 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:00.086436 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c38434-305c-4fbd-9682-f23eec430ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:00.088325 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c38434-305c-4fbd-9682-f23eec430ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:00.088679 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c38434-305c-4fbd-9682-f23eec430ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:00.089322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c38434-305c-4fbd-9682-f23eec430ec9 admin admin] PATH_INFO: `/v3/users/a0930230610849f7b0d4f9642a235dba` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:00.091961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c38434-305c-4fbd-9682-f23eec430ec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0930230610849f7b0d4f9642a235dba)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:00.095276 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c38434-305c-4fbd-9682-f23eec430ec9 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:00.135596 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:00.178132 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-34c38434-305c-4fbd-9682-f23eec430ec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0930230610849f7b0d4f9642a235dba'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:00.185344 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-34c38434-305c-4fbd-9682-f23eec430ec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0930230610849f7b0d4f9642a235dba'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:00.186115 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-34c38434-305c-4fbd-9682-f23eec430ec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0930230610849f7b0d4f9642a235dba'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:00.186741 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-34c38434-305c-4fbd-9682-f23eec430ec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0930230610849f7b0d4f9642a235dba'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:00.200466 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-34c38434-305c-4fbd-9682-f23eec430ec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0930230610849f7b0d4f9642a235dba'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:00.215627 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1397/2823] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:01:59 2022] DELETE /identity/v3/users/a0930230610849f7b0d4f9642a235dba => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:02:00.221444 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6e552-d928-4ac5-a702-711ebb9028d5 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:00.222427 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6e552-d928-4ac5-a702-711ebb9028d5 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:00.222787 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6e552-d928-4ac5-a702-711ebb9028d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:00.241504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-1ab6e552-d928-4ac5-a702-711ebb9028d5 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:02:00.242786 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-1ab6e552-d928-4ac5-a702-711ebb9028d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:00.330401 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1427/2824] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:02:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:02:00.340710 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c38434-305c-4fbd-9682-f23eec430ec9 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:00.342575 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-34c38434-305c-4fbd-9682-f23eec430ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:00.429163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c38434-305c-4fbd-9682-f23eec430ec9 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:00.434546 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b24197-ba0b-4330-a874-18bbf5a7c493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:00.434546 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b24197-ba0b-4330-a874-18bbf5a7c493 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:00.434546 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b24197-ba0b-4330-a874-18bbf5a7c493 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:00.434546 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b24197-ba0b-4330-a874-18bbf5a7c493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:00.449051 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b24197-ba0b-4330-a874-18bbf5a7c493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:00.450697 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b24197-ba0b-4330-a874-18bbf5a7c493 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:00.462765 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1398/2825] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:02:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:02:00.852700 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6e552-d928-4ac5-a702-711ebb9028d5 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:00.857415 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-1ab6e552-d928-4ac5-a702-711ebb9028d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:00.880832 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6e552-d928-4ac5-a702-711ebb9028d5 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:00.891164 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80b236-780f-4d7a-852a-5f7c767d9632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:00.893632 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80b236-780f-4d7a-852a-5f7c767d9632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:00.893632 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80b236-780f-4d7a-852a-5f7c767d9632 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:00.893632 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80b236-780f-4d7a-852a-5f7c767d9632 admin admin] PATH_INFO: `/v3/projects/4cf0f81e1371492293ba0c40062f56a6` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:00.895237 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80b236-780f-4d7a-852a-5f7c767d9632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cf0f81e1371492293ba0c40062f56a6)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:00.897440 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80b236-780f-4d7a-852a-5f7c767d9632 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:00.947396 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e161e1-dd1b-440e-a8ae-81f54cefc258 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:00.947680 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e161e1-dd1b-440e-a8ae-81f54cefc258 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:00.947963 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e161e1-dd1b-440e-a8ae-81f54cefc258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:00.967143 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:00.973441 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-29e161e1-dd1b-440e-a8ae-81f54cefc258 None None] MFA Rules not processed for user `dbf2c12174e94e2db9be178973183ced`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:02:00.975797 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-29e161e1-dd1b-440e-a8ae-81f54cefc258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:00.983689 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-fd80b236-780f-4d7a-852a-5f7c767d9632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cf0f81e1371492293ba0c40062f56a6', 'request_id': 'req-fd80b236-780f-4d7a-852a-5f7c767d9632'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:00.994559 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-fd80b236-780f-4d7a-852a-5f7c767d9632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cf0f81e1371492293ba0c40062f56a6', 'request_id': 'req-fd80b236-780f-4d7a-852a-5f7c767d9632'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:01.016412 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-fd80b236-780f-4d7a-852a-5f7c767d9632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cf0f81e1371492293ba0c40062f56a6', 'request_id': 'req-fd80b236-780f-4d7a-852a-5f7c767d9632'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:01.049421 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-fd80b236-780f-4d7a-852a-5f7c767d9632 admin admin] The token cache is being invalidate because project 4cf0f81e1371492293ba0c40062f56a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:02:01.056323 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-fd80b236-780f-4d7a-852a-5f7c767d9632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:01.062449 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-fd80b236-780f-4d7a-852a-5f7c767d9632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:01.065534 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1399/2826] 10.222.0.15 () {58 vars in 1009 bytes} [Thu Jun 23 16:02:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:02:01.087755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1428/2827] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:02:00 2022] DELETE /identity/v3/projects/4cf0f81e1371492293ba0c40062f56a6 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:02:01.092465 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e161e1-dd1b-440e-a8ae-81f54cefc258 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:01.094259 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80b236-780f-4d7a-852a-5f7c767d9632 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:01.095769 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-fd80b236-780f-4d7a-852a-5f7c767d9632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:01.095923 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-29e161e1-dd1b-440e-a8ae-81f54cefc258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:01.172558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:01.201837 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80b236-780f-4d7a-852a-5f7c767d9632 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:01.207796 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7c7acf-5fd5-44e6-b254-561eea383578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:01.209138 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c7acf-5fd5-44e6-b254-561eea383578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:01.209674 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c7acf-5fd5-44e6-b254-561eea383578 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:01.210127 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7c7acf-5fd5-44e6-b254-561eea383578 admin admin] PATH_INFO: `/v3/users/ef8b6d4f8b6d48b68a95e1b304d88218` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:01.219128 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c7acf-5fd5-44e6-b254-561eea383578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef8b6d4f8b6d48b68a95e1b304d88218)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:01.222198 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7c7acf-5fd5-44e6-b254-561eea383578 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:01.229921 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e161e1-dd1b-440e-a8ae-81f54cefc258 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:01.247003 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3680af0-b989-4c52-a08c-30d1209ee1d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5824ee17e276483faf20db88a93545f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:01.248459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3680af0-b989-4c52-a08c-30d1209ee1d4 service swift] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:01.249315 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3680af0-b989-4c52-a08c-30d1209ee1d4 service swift] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:01.250333 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3680af0-b989-4c52-a08c-30d1209ee1d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:01.276473 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3680af0-b989-4c52-a08c-30d1209ee1d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:01.280407 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3680af0-b989-4c52-a08c-30d1209ee1d4 service swift] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:01.304374 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-0d7c7acf-5fd5-44e6-b254-561eea383578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef8b6d4f8b6d48b68a95e1b304d88218'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:01.310326 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1400/2828] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 23 16:02:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 16:02:01.314494 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-0d7c7acf-5fd5-44e6-b254-561eea383578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef8b6d4f8b6d48b68a95e1b304d88218'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:01.315431 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-0d7c7acf-5fd5-44e6-b254-561eea383578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef8b6d4f8b6d48b68a95e1b304d88218'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:01.316934 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-0d7c7acf-5fd5-44e6-b254-561eea383578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef8b6d4f8b6d48b68a95e1b304d88218'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:01.336807 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-0d7c7acf-5fd5-44e6-b254-561eea383578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef8b6d4f8b6d48b68a95e1b304d88218'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:01.362857 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1429/2829] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:02:01 2022] DELETE /identity/v3/users/ef8b6d4f8b6d48b68a95e1b304d88218 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:02:02.163023 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3680af0-b989-4c52-a08c-30d1209ee1d4 service swift] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:02.188439 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3680af0-b989-4c52-a08c-30d1209ee1d4 service swift] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:02.372244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba0273-eac8-4a25-93a3-9d8e005c1282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:02.376735 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba0273-eac8-4a25-93a3-9d8e005c1282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:02.377653 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba0273-eac8-4a25-93a3-9d8e005c1282 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:02.378612 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba0273-eac8-4a25-93a3-9d8e005c1282 admin admin] PATH_INFO: `/v3/projects/eb690315532645609c0977ad5e60fe95` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:02.380738 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba0273-eac8-4a25-93a3-9d8e005c1282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb690315532645609c0977ad5e60fe95)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:02.387038 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba0273-eac8-4a25-93a3-9d8e005c1282 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:02.542790 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-52ba0273-eac8-4a25-93a3-9d8e005c1282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb690315532645609c0977ad5e60fe95', 'request_id': 'req-52ba0273-eac8-4a25-93a3-9d8e005c1282'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:02.575459 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-52ba0273-eac8-4a25-93a3-9d8e005c1282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb690315532645609c0977ad5e60fe95', 'request_id': 'req-52ba0273-eac8-4a25-93a3-9d8e005c1282'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:02.588976 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-52ba0273-eac8-4a25-93a3-9d8e005c1282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb690315532645609c0977ad5e60fe95', 'request_id': 'req-52ba0273-eac8-4a25-93a3-9d8e005c1282'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:02.620520 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-52ba0273-eac8-4a25-93a3-9d8e005c1282 admin admin] The token cache is being invalidate because project eb690315532645609c0977ad5e60fe95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:02:02.620973 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-52ba0273-eac8-4a25-93a3-9d8e005c1282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:02.622495 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-52ba0273-eac8-4a25-93a3-9d8e005c1282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:02.625185 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1401/2830] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:02:02 2022] DELETE /identity/v3/projects/eb690315532645609c0977ad5e60fe95 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:02:02.630934 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5293c-e431-4fd8-8dc1-26611403479f None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:02.631497 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5293c-e431-4fd8-8dc1-26611403479f None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:02.631731 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b5293c-e431-4fd8-8dc1-26611403479f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:02.669777 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-20b5293c-e431-4fd8-8dc1-26611403479f None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:02:02.672812 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-20b5293c-e431-4fd8-8dc1-26611403479f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:02.786723 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:02.843116 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1430/2831] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:02:02.850303 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085107f0-87cc-4b49-9d23-dfd4d604b4e4 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:02.850611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085107f0-87cc-4b49-9d23-dfd4d604b4e4 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:02.850959 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085107f0-87cc-4b49-9d23-dfd4d604b4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:02.888309 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-085107f0-87cc-4b49-9d23-dfd4d604b4e4 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:02:02.889943 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-085107f0-87cc-4b49-9d23-dfd4d604b4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:02.915560 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1402/2832] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:02:02.919942 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5293c-e431-4fd8-8dc1-26611403479f None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:02.943854 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b5293c-e431-4fd8-8dc1-26611403479f None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:02.968999 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e112618-5b24-4208-b48e-de2e85205118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:02.969933 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e112618-5b24-4208-b48e-de2e85205118 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:02.970488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e112618-5b24-4208-b48e-de2e85205118 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:02.970775 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e112618-5b24-4208-b48e-de2e85205118 admin admin] PATH_INFO: `/v3/domains` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:02.971553 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e112618-5b24-4208-b48e-de2e85205118 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91828) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:02:02.971975 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e112618-5b24-4208-b48e-de2e85205118 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:02.973894 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e112618-5b24-4208-b48e-de2e85205118 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:03.020833 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1431/2833] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 16:02:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:02:03.021700 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085107f0-87cc-4b49-9d23-dfd4d604b4e4 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:03.045518 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085107f0-87cc-4b49-9d23-dfd4d604b4e4 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:03.078608 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615ebc3-62f1-444d-ad9c-6ee34390da83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:03.079781 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615ebc3-62f1-444d-ad9c-6ee34390da83 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:03.080295 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615ebc3-62f1-444d-ad9c-6ee34390da83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:03.090604 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615ebc3-62f1-444d-ad9c-6ee34390da83 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:03.092761 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615ebc3-62f1-444d-ad9c-6ee34390da83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:03.098458 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3615ebc3-62f1-444d-ad9c-6ee34390da83 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:03.223271 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1403/2834] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:02:03 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:02:03.224276 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e112618-5b24-4208-b48e-de2e85205118 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:03.241498 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e112618-5b24-4208-b48e-de2e85205118 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:03.462417 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c5c16-aa83-4be9-8863-c5fd009eebf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:03.463915 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c5c16-aa83-4be9-8863-c5fd009eebf9 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:03.466392 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c5c16-aa83-4be9-8863-c5fd009eebf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:03.467180 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c5c16-aa83-4be9-8863-c5fd009eebf9 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:03.469321 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c5c16-aa83-4be9-8863-c5fd009eebf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:03.475175 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c5c16-aa83-4be9-8863-c5fd009eebf9 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:03.510053 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615ebc3-62f1-444d-ad9c-6ee34390da83 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:03.514975 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-3615ebc3-62f1-444d-ad9c-6ee34390da83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:03.560968 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1432/2835] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:02:03 2022] POST /identity/v3/users => generated 294 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:02:03.563033 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c5c16-aa83-4be9-8863-c5fd009eebf9 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:03.597753 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c5c16-aa83-4be9-8863-c5fd009eebf9 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:03.610360 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa137d0e-73d7-41cb-a29c-4c15dfd59104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:03.611417 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa137d0e-73d7-41cb-a29c-4c15dfd59104 admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:03.611918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa137d0e-73d7-41cb-a29c-4c15dfd59104 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:03.612562 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa137d0e-73d7-41cb-a29c-4c15dfd59104 admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:03.614071 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa137d0e-73d7-41cb-a29c-4c15dfd59104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:03.618604 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa137d0e-73d7-41cb-a29c-4c15dfd59104 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:03.670627 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1433/2836] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 16:02:03.677357 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa137d0e-73d7-41cb-a29c-4c15dfd59104 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:03.735110 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:03.740184 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa137d0e-73d7-41cb-a29c-4c15dfd59104 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:03.764321 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b7b40-5a1c-4a5e-bb5f-f43e8973570a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:03.765103 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b7b40-5a1c-4a5e-bb5f-f43e8973570a admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:03.765586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b7b40-5a1c-4a5e-bb5f-f43e8973570a admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:03.765978 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b7b40-5a1c-4a5e-bb5f-f43e8973570a admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:03.767255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b7b40-5a1c-4a5e-bb5f-f43e8973570a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:03.769509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b7b40-5a1c-4a5e-bb5f-f43e8973570a admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:03.837842 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1434/2837] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:02:03.855362 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b7b40-5a1c-4a5e-bb5f-f43e8973570a admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:03.862566 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3615ebc3-62f1-444d-ad9c-6ee34390da83 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:03.881413 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317f2eb-1912-4815-9b7f-3479cc747077 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:03.885522 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317f2eb-1912-4815-9b7f-3479cc747077 service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:03.886181 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317f2eb-1912-4815-9b7f-3479cc747077 service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:03.886744 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2317f2eb-1912-4815-9b7f-3479cc747077 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:03.892507 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-2317f2eb-1912-4815-9b7f-3479cc747077 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:03.901798 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b7b40-5a1c-4a5e-bb5f-f43e8973570a admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:03.928243 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71bdc2-bdcc-4bbc-bcfb-8eb28e60f2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:03.929232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71bdc2-bdcc-4bbc-bcfb-8eb28e60f2cd admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:03.929513 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71bdc2-bdcc-4bbc-bcfb-8eb28e60f2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:03.929967 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71bdc2-bdcc-4bbc-bcfb-8eb28e60f2cd admin admin] PATH_INFO: `/v3/projects/d07782c085d74ce48a9bd9575bd41b7e/users/80494d0a832347358bcbafe3a79e1642/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:03.963401 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317f2eb-1912-4815-9b7f-3479cc747077 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:03.967866 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2317f2eb-1912-4815-9b7f-3479cc747077 service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:03.972760 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71bdc2-bdcc-4bbc-bcfb-8eb28e60f2cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d07782c085d74ce48a9bd9575bd41b7e, user_id=80494d0a832347358bcbafe3a79e1642, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:03.977233 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71bdc2-bdcc-4bbc-bcfb-8eb28e60f2cd admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:04.013693 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1435/2838] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:02:03 2022] PUT /identity/v3/projects/d07782c085d74ce48a9bd9575bd41b7e/users/80494d0a832347358bcbafe3a79e1642/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:02:04.024736 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1404/2839] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:02:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:02:04.033030 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bd888-4afe-43f2-9ff5-c4957922ef5c None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:04.033377 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bd888-4afe-43f2-9ff5-c4957922ef5c None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:04.033550 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bd888-4afe-43f2-9ff5-c4957922ef5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:04.113591 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-f57bd888-4afe-43f2-9ff5-c4957922ef5c None None] MFA Rules not processed for user `80494d0a832347358bcbafe3a79e1642`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:02:04.116470 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-f57bd888-4afe-43f2-9ff5-c4957922ef5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:04.278275 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1436/2840] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:02:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:02:04.285192 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317f2eb-1912-4815-9b7f-3479cc747077 service nova] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:04.306179 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2317f2eb-1912-4815-9b7f-3479cc747077 service nova] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:04.457054 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc72054-c863-4949-a2e4-d617e89a1864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:04.457054 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc72054-c863-4949-a2e4-d617e89a1864 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:04.457054 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc72054-c863-4949-a2e4-d617e89a1864 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:04.457693 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc72054-c863-4949-a2e4-d617e89a1864 admin admin] PATH_INFO: `/v3/projects` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:04.459420 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc72054-c863-4949-a2e4-d617e89a1864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:04.463912 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc72054-c863-4949-a2e4-d617e89a1864 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:04.548648 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1405/2841] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:02:04 2022] POST /identity/v3/projects => generated 385 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:02:04.552060 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bd888-4afe-43f2-9ff5-c4957922ef5c None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:04.568035 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:04.577430 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bd888-4afe-43f2-9ff5-c4957922ef5c None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:04.746325 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769fd91-ddf7-4df0-a8b9-1abd30acad73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:04.750810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769fd91-ddf7-4df0-a8b9-1abd30acad73 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:04.751613 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769fd91-ddf7-4df0-a8b9-1abd30acad73 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:04.753156 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769fd91-ddf7-4df0-a8b9-1abd30acad73 admin admin] PATH_INFO: `/v3/users` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:04.757279 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769fd91-ddf7-4df0-a8b9-1abd30acad73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:04.770415 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769fd91-ddf7-4df0-a8b9-1abd30acad73 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:04.831476 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1437/2842] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:02:04 2022] POST /identity/v3/users => generated 299 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:02:04.839998 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc72054-c863-4949-a2e4-d617e89a1864 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:04.872250 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc72054-c863-4949-a2e4-d617e89a1864 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:04.892483 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927f2dc-5143-4e32-acbd-c3c9ba803ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:04.893234 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927f2dc-5143-4e32-acbd-c3c9ba803ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:04.893553 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927f2dc-5143-4e32-acbd-c3c9ba803ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:04.893907 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d927f2dc-5143-4e32-acbd-c3c9ba803ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:04.894759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927f2dc-5143-4e32-acbd-c3c9ba803ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:04.896833 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d927f2dc-5143-4e32-acbd-c3c9ba803ea3 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:04.945759 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1406/2843] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:02:04.949300 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769fd91-ddf7-4df0-a8b9-1abd30acad73 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:04.993233 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769fd91-ddf7-4df0-a8b9-1abd30acad73 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:05.005031 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637275fc-b3f5-4ba0-9594-8a0ff6caa9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:05.006004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637275fc-b3f5-4ba0-9594-8a0ff6caa9d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:05.006274 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637275fc-b3f5-4ba0-9594-8a0ff6caa9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:05.006556 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637275fc-b3f5-4ba0-9594-8a0ff6caa9d4 admin admin] PATH_INFO: `/v3/projects/666ff3a6d03f4113881c2d35a5925347/users/3779f40775624fff99aad20027b42d40/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:05.025488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637275fc-b3f5-4ba0-9594-8a0ff6caa9d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=666ff3a6d03f4113881c2d35a5925347, user_id=3779f40775624fff99aad20027b42d40, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:05.034836 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637275fc-b3f5-4ba0-9594-8a0ff6caa9d4 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:05.066119 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1438/2844] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:02:04 2022] PUT /identity/v3/projects/666ff3a6d03f4113881c2d35a5925347/users/3779f40775624fff99aad20027b42d40/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:02:05.071599 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927f2dc-5143-4e32-acbd-c3c9ba803ea3 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:05.090175 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d927f2dc-5143-4e32-acbd-c3c9ba803ea3 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:05.186152 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fd198-a61e-4f69-9adb-77696d76b053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:05.186846 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fd198-a61e-4f69-9adb-77696d76b053 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:05.187163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fd198-a61e-4f69-9adb-77696d76b053 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:05.187454 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fd198-a61e-4f69-9adb-77696d76b053 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:05.188208 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3fd198-a61e-4f69-9adb-77696d76b053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:05.189876 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3fd198-a61e-4f69-9adb-77696d76b053 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:05.207052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1407/2845] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:02:05.211555 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637275fc-b3f5-4ba0-9594-8a0ff6caa9d4 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:05.229452 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637275fc-b3f5-4ba0-9594-8a0ff6caa9d4 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:05.236191 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b553dad-cad7-405a-8768-f8ecce2a7a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:05.237179 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b553dad-cad7-405a-8768-f8ecce2a7a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:05.237439 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b553dad-cad7-405a-8768-f8ecce2a7a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:05.237677 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b553dad-cad7-405a-8768-f8ecce2a7a91 admin admin] PATH_INFO: `/v3/projects/666ff3a6d03f4113881c2d35a5925347/users/3779f40775624fff99aad20027b42d40/roles/abdc0e0957534149b3653eaa33cbd054` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:05.239875 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b553dad-cad7-405a-8768-f8ecce2a7a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=666ff3a6d03f4113881c2d35a5925347, user_id=3779f40775624fff99aad20027b42d40, role_id=abdc0e0957534149b3653eaa33cbd054)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:05.242710 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b553dad-cad7-405a-8768-f8ecce2a7a91 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:05.261050 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1439/2846] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:02:05 2022] PUT /identity/v3/projects/666ff3a6d03f4113881c2d35a5925347/users/3779f40775624fff99aad20027b42d40/roles/abdc0e0957534149b3653eaa33cbd054 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:02:05.272545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bff58b-17e9-41eb-b097-e3f8c03793f9 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:05.272867 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bff58b-17e9-41eb-b097-e3f8c03793f9 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:05.273100 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bff58b-17e9-41eb-b097-e3f8c03793f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:05.328536 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-e9bff58b-17e9-41eb-b097-e3f8c03793f9 None None] MFA Rules not processed for user `3779f40775624fff99aad20027b42d40`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:02:05.331784 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-e9bff58b-17e9-41eb-b097-e3f8c03793f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:05.368259 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:05.465027 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1408/2847] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:02:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:02:05.473099 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b553dad-cad7-405a-8768-f8ecce2a7a91 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:05.475229 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-9b553dad-cad7-405a-8768-f8ecce2a7a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:05.588918 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b553dad-cad7-405a-8768-f8ecce2a7a91 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:05.595639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf944a4-f918-4119-a48b-f769bcb64d1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:05.596566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf944a4-f918-4119-a48b-f769bcb64d1a service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:05.597068 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf944a4-f918-4119-a48b-f769bcb64d1a service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:05.597441 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf944a4-f918-4119-a48b-f769bcb64d1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:05.634168 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf944a4-f918-4119-a48b-f769bcb64d1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:05.637213 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf944a4-f918-4119-a48b-f769bcb64d1a service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:05.661097 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1440/2848] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:02:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:02:06.613342 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bff58b-17e9-41eb-b097-e3f8c03793f9 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:06.739469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bff58b-17e9-41eb-b097-e3f8c03793f9 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:06.747857 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc385554-ad56-4d43-bc0e-9dbbef9e171e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:06.748975 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc385554-ad56-4d43-bc0e-9dbbef9e171e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:06.749432 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc385554-ad56-4d43-bc0e-9dbbef9e171e admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:06.750755 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc385554-ad56-4d43-bc0e-9dbbef9e171e admin admin] PATH_INFO: `/v3/users/80494d0a832347358bcbafe3a79e1642` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:06.752815 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc385554-ad56-4d43-bc0e-9dbbef9e171e admin admin] RBAC: Authorizing `identity:delete_user(user_id=80494d0a832347358bcbafe3a79e1642)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:06.755489 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc385554-ad56-4d43-bc0e-9dbbef9e171e admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:06.865374 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-bc385554-ad56-4d43-bc0e-9dbbef9e171e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80494d0a832347358bcbafe3a79e1642'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:06.874482 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-bc385554-ad56-4d43-bc0e-9dbbef9e171e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80494d0a832347358bcbafe3a79e1642'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:06.875262 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-bc385554-ad56-4d43-bc0e-9dbbef9e171e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80494d0a832347358bcbafe3a79e1642'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:06.875945 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-bc385554-ad56-4d43-bc0e-9dbbef9e171e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80494d0a832347358bcbafe3a79e1642'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:06.910271 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-bc385554-ad56-4d43-bc0e-9dbbef9e171e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80494d0a832347358bcbafe3a79e1642'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:06.937734 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1409/2849] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:02:06 2022] DELETE /identity/v3/users/80494d0a832347358bcbafe3a79e1642 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:02:06.944945 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541fa39-cc65-4461-9994-ed360f02dc46 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:06.945586 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541fa39-cc65-4461-9994-ed360f02dc46 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:06.946005 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541fa39-cc65-4461-9994-ed360f02dc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:06.975718 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-e541fa39-cc65-4461-9994-ed360f02dc46 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:02:06.976950 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e541fa39-cc65-4461-9994-ed360f02dc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:07.114534 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:07.132909 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1441/2850] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:02:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:02:07.155111 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc385554-ad56-4d43-bc0e-9dbbef9e171e admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:07.161895 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-bc385554-ad56-4d43-bc0e-9dbbef9e171e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:07.247078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:07.273581 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc385554-ad56-4d43-bc0e-9dbbef9e171e admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:07.278323 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf83f7e-0b57-40a4-a926-22a133139838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:07.279256 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf83f7e-0b57-40a4-a926-22a133139838 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:07.279611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf83f7e-0b57-40a4-a926-22a133139838 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:07.279964 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf83f7e-0b57-40a4-a926-22a133139838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:07.291292 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf83f7e-0b57-40a4-a926-22a133139838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:07.293269 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf83f7e-0b57-40a4-a926-22a133139838 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:07.318690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1410/2851] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:02:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:02:07.884012 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541fa39-cc65-4461-9994-ed360f02dc46 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:07.885668 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e541fa39-cc65-4461-9994-ed360f02dc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:07.898220 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541fa39-cc65-4461-9994-ed360f02dc46 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:07.913682 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36732bc-77aa-49b7-b1a9-74fbe31c6e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:07.914751 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36732bc-77aa-49b7-b1a9-74fbe31c6e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:07.915285 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36732bc-77aa-49b7-b1a9-74fbe31c6e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:07.915671 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36732bc-77aa-49b7-b1a9-74fbe31c6e77 admin admin] PATH_INFO: `/v3/projects/d07782c085d74ce48a9bd9575bd41b7e` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:07.917922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36732bc-77aa-49b7-b1a9-74fbe31c6e77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d07782c085d74ce48a9bd9575bd41b7e)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:07.920314 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36732bc-77aa-49b7-b1a9-74fbe31c6e77 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:08.005669 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-f36732bc-77aa-49b7-b1a9-74fbe31c6e77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd07782c085d74ce48a9bd9575bd41b7e', 'request_id': 'req-f36732bc-77aa-49b7-b1a9-74fbe31c6e77'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:08.015216 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-f36732bc-77aa-49b7-b1a9-74fbe31c6e77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd07782c085d74ce48a9bd9575bd41b7e', 'request_id': 'req-f36732bc-77aa-49b7-b1a9-74fbe31c6e77'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:08.025749 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-f36732bc-77aa-49b7-b1a9-74fbe31c6e77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd07782c085d74ce48a9bd9575bd41b7e', 'request_id': 'req-f36732bc-77aa-49b7-b1a9-74fbe31c6e77'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:08.039678 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-f36732bc-77aa-49b7-b1a9-74fbe31c6e77 admin admin] The token cache is being invalidate because project d07782c085d74ce48a9bd9575bd41b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:02:08.040066 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-f36732bc-77aa-49b7-b1a9-74fbe31c6e77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:08.040829 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-f36732bc-77aa-49b7-b1a9-74fbe31c6e77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:08.042949 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1442/2852] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:02:07 2022] DELETE /identity/v3/projects/d07782c085d74ce48a9bd9575bd41b7e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:02:08.047399 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf83f7e-0b57-40a4-a926-22a133139838 service neutron] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:08.057936 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf83f7e-0b57-40a4-a926-22a133139838 service neutron] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:08.122846 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8095b6b-df19-4260-abe5-87185a6aa652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:08.124776 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8095b6b-df19-4260-abe5-87185a6aa652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:08.125552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8095b6b-df19-4260-abe5-87185a6aa652 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:08.126187 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8095b6b-df19-4260-abe5-87185a6aa652 admin admin] PATH_INFO: `/v3/users/3779f40775624fff99aad20027b42d40` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:08.128789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8095b6b-df19-4260-abe5-87185a6aa652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3779f40775624fff99aad20027b42d40)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:08.132636 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8095b6b-df19-4260-abe5-87185a6aa652 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:08.206316 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a8095b6b-df19-4260-abe5-87185a6aa652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3779f40775624fff99aad20027b42d40'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:08.220580 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a8095b6b-df19-4260-abe5-87185a6aa652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3779f40775624fff99aad20027b42d40'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:08.222151 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a8095b6b-df19-4260-abe5-87185a6aa652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3779f40775624fff99aad20027b42d40'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:08.223417 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a8095b6b-df19-4260-abe5-87185a6aa652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3779f40775624fff99aad20027b42d40'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:08.239511 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-a8095b6b-df19-4260-abe5-87185a6aa652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3779f40775624fff99aad20027b42d40'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:08.255860 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1411/2853] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:02:08 2022] DELETE /identity/v3/users/3779f40775624fff99aad20027b42d40 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:02:08.634541 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36732bc-77aa-49b7-b1a9-74fbe31c6e77 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:08.636247 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-f36732bc-77aa-49b7-b1a9-74fbe31c6e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:08.653567 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36732bc-77aa-49b7-b1a9-74fbe31c6e77 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:08.745191 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8b44f-5234-4716-b081-a4118c0c2adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:08.746361 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8b44f-5234-4716-b081-a4118c0c2adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:08.746639 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8b44f-5234-4716-b081-a4118c0c2adc admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:08.746916 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8b44f-5234-4716-b081-a4118c0c2adc admin admin] PATH_INFO: `/v3/projects/666ff3a6d03f4113881c2d35a5925347` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:08.748904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8b44f-5234-4716-b081-a4118c0c2adc admin admin] RBAC: Authorizing `identity:delete_project(project_id=666ff3a6d03f4113881c2d35a5925347)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:08.752840 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8b44f-5234-4716-b081-a4118c0c2adc admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:08.836434 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-ada8b44f-5234-4716-b081-a4118c0c2adc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '666ff3a6d03f4113881c2d35a5925347', 'request_id': 'req-ada8b44f-5234-4716-b081-a4118c0c2adc'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:08.844816 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-ada8b44f-5234-4716-b081-a4118c0c2adc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '666ff3a6d03f4113881c2d35a5925347', 'request_id': 'req-ada8b44f-5234-4716-b081-a4118c0c2adc'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:08.868884 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-ada8b44f-5234-4716-b081-a4118c0c2adc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '666ff3a6d03f4113881c2d35a5925347', 'request_id': 'req-ada8b44f-5234-4716-b081-a4118c0c2adc'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:08.887325 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-ada8b44f-5234-4716-b081-a4118c0c2adc admin admin] The token cache is being invalidate because project 666ff3a6d03f4113881c2d35a5925347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:02:08.887755 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-ada8b44f-5234-4716-b081-a4118c0c2adc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:08.888518 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-ada8b44f-5234-4716-b081-a4118c0c2adc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:08.893939 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1443/2854] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:02:08 2022] DELETE /identity/v3/projects/666ff3a6d03f4113881c2d35a5925347 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:02:08.896185 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba44b8c-6afe-487c-afe7-43d513f09a7b None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:08.896481 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba44b8c-6afe-487c-afe7-43d513f09a7b None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:08.896827 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba44b8c-6afe-487c-afe7-43d513f09a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:08.921393 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-bba44b8c-6afe-487c-afe7-43d513f09a7b None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:02:08.924022 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-bba44b8c-6afe-487c-afe7-43d513f09a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:09.022529 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:09.042863 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1412/2855] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:02:09.050457 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86e82a-7292-4a96-916f-7829563d8caa None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:09.051316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86e82a-7292-4a96-916f-7829563d8caa None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:09.051316 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86e82a-7292-4a96-916f-7829563d8caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:09.088815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-dc86e82a-7292-4a96-916f-7829563d8caa None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:02:09.091900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-dc86e82a-7292-4a96-916f-7829563d8caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:09.123575 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1444/2856] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:02:09.124360 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba44b8c-6afe-487c-afe7-43d513f09a7b None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:09.137547 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba44b8c-6afe-487c-afe7-43d513f09a7b None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:09.142737 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741b663-4907-430d-a062-4cce26545f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:09.143505 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741b663-4907-430d-a062-4cce26545f70 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:09.143890 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741b663-4907-430d-a062-4cce26545f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:09.144273 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741b663-4907-430d-a062-4cce26545f70 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:09.145119 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741b663-4907-430d-a062-4cce26545f70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:02:09.145723 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741b663-4907-430d-a062-4cce26545f70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:09.147611 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741b663-4907-430d-a062-4cce26545f70 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:09.162186 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1413/2857] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 16:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 16:02:09.168303 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86e82a-7292-4a96-916f-7829563d8caa None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:09.179132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86e82a-7292-4a96-916f-7829563d8caa None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:09.184795 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91f13c-503f-456f-bf47-6cecc05e3f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:09.185473 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91f13c-503f-456f-bf47-6cecc05e3f0b admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:09.185782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91f13c-503f-456f-bf47-6cecc05e3f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:09.186111 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91f13c-503f-456f-bf47-6cecc05e3f0b admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:09.187557 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91f13c-503f-456f-bf47-6cecc05e3f0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:09.189462 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91f13c-503f-456f-bf47-6cecc05e3f0b admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:09.193219 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:09.228196 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1445/2858] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:02:09 2022] POST /identity/v3/projects => generated 359 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:02:09.232532 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741b663-4907-430d-a062-4cce26545f70 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:09.243817 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741b663-4907-430d-a062-4cce26545f70 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:09.323622 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8101f7-f1b4-4f99-8fca-077d7af2a87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:09.324466 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8101f7-f1b4-4f99-8fca-077d7af2a87e admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:09.325023 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8101f7-f1b4-4f99-8fca-077d7af2a87e admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:09.325415 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8101f7-f1b4-4f99-8fca-077d7af2a87e admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:09.326263 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8101f7-f1b4-4f99-8fca-077d7af2a87e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:09.328422 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8101f7-f1b4-4f99-8fca-077d7af2a87e admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:09.369614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1414/2859] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:02:09 2022] POST /identity/v3/users => generated 280 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:02:09.373789 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91f13c-503f-456f-bf47-6cecc05e3f0b admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:09.386284 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91f13c-503f-456f-bf47-6cecc05e3f0b admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:09.391323 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef8b21-0859-4a9b-ab56-edf993e46c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:09.391994 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef8b21-0859-4a9b-ab56-edf993e46c7f admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:09.392370 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef8b21-0859-4a9b-ab56-edf993e46c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:09.392591 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef8b21-0859-4a9b-ab56-edf993e46c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:09.393336 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef8b21-0859-4a9b-ab56-edf993e46c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:09.394971 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef8b21-0859-4a9b-ab56-edf993e46c7f admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:09.406535 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1446/2860] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:02:09.410970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8101f7-f1b4-4f99-8fca-077d7af2a87e admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:09.422057 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8101f7-f1b4-4f99-8fca-077d7af2a87e admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:09.426997 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644cd01-ac70-4062-8694-bd612fb3d89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:09.427825 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644cd01-ac70-4062-8694-bd612fb3d89f admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:09.428250 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644cd01-ac70-4062-8694-bd612fb3d89f admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:09.428398 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644cd01-ac70-4062-8694-bd612fb3d89f admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:09.429469 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644cd01-ac70-4062-8694-bd612fb3d89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:09.432878 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644cd01-ac70-4062-8694-bd612fb3d89f admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:09.448193 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1415/2861] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 16:02:09.453840 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef8b21-0859-4a9b-ab56-edf993e46c7f admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:09.465245 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef8b21-0859-4a9b-ab56-edf993e46c7f admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:09.477795 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe0b9c-d571-4d3c-a5a9-1435a32e884e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:09.478875 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe0b9c-d571-4d3c-a5a9-1435a32e884e admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:09.479234 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe0b9c-d571-4d3c-a5a9-1435a32e884e admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:09.486015 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe0b9c-d571-4d3c-a5a9-1435a32e884e admin admin] PATH_INFO: `/v3/projects/f57c67626fab4f5aa95be6263dfb7ccf/users/9fc4d64ad99a4e4da5b3d469c2016651/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:09.523788 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe0b9c-d571-4d3c-a5a9-1435a32e884e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f57c67626fab4f5aa95be6263dfb7ccf, user_id=9fc4d64ad99a4e4da5b3d469c2016651, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:09.527466 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fe0b9c-d571-4d3c-a5a9-1435a32e884e admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:09.544519 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1447/2862] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:02:09 2022] PUT /identity/v3/projects/f57c67626fab4f5aa95be6263dfb7ccf/users/9fc4d64ad99a4e4da5b3d469c2016651/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:02:09.563697 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0668578-f132-485f-a298-1cf876ba0486 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:09.564229 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0668578-f132-485f-a298-1cf876ba0486 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:09.564663 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0668578-f132-485f-a298-1cf876ba0486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:09.601298 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-f0668578-f132-485f-a298-1cf876ba0486 None None] MFA Rules not processed for user `9fc4d64ad99a4e4da5b3d469c2016651`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:02:09.602569 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-f0668578-f132-485f-a298-1cf876ba0486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:09.687659 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1416/2863] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:02:09 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:02:09.745232 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe0b9c-d571-4d3c-a5a9-1435a32e884e admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:09.748335 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-c6fe0b9c-d571-4d3c-a5a9-1435a32e884e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:09.856122 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe0b9c-d571-4d3c-a5a9-1435a32e884e admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:09.861567 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01342f6b-654b-408b-81cf-e053297fdf7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b524afb3b4b24025ad8bef85aa64bd91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:09.862358 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01342f6b-654b-408b-81cf-e053297fdf7d service cinder] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:09.862795 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01342f6b-654b-408b-81cf-e053297fdf7d service cinder] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:09.863435 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01342f6b-654b-408b-81cf-e053297fdf7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:09.881583 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01342f6b-654b-408b-81cf-e053297fdf7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:09.888675 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01342f6b-654b-408b-81cf-e053297fdf7d service cinder] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:09.910015 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1448/2864] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:02:09 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:02:09.934018 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0668578-f132-485f-a298-1cf876ba0486 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:10.012144 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:10.029376 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0668578-f132-485f-a298-1cf876ba0486 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:10.035202 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664b07f-5cc1-4937-bc54-9987458fa9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:10.036097 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664b07f-5cc1-4937-bc54-9987458fa9a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:10.036382 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664b07f-5cc1-4937-bc54-9987458fa9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:10.036665 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664b07f-5cc1-4937-bc54-9987458fa9a7 admin admin] PATH_INFO: `/v3/users/9fc4d64ad99a4e4da5b3d469c2016651` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:10.037958 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664b07f-5cc1-4937-bc54-9987458fa9a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fc4d64ad99a4e4da5b3d469c2016651)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:10.039975 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664b07f-5cc1-4937-bc54-9987458fa9a7 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:10.104765 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c664b07f-5cc1-4937-bc54-9987458fa9a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fc4d64ad99a4e4da5b3d469c2016651'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:10.114480 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c664b07f-5cc1-4937-bc54-9987458fa9a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fc4d64ad99a4e4da5b3d469c2016651'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:10.115229 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c664b07f-5cc1-4937-bc54-9987458fa9a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fc4d64ad99a4e4da5b3d469c2016651'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:10.115854 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c664b07f-5cc1-4937-bc54-9987458fa9a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fc4d64ad99a4e4da5b3d469c2016651'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:10.130042 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-c664b07f-5cc1-4937-bc54-9987458fa9a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fc4d64ad99a4e4da5b3d469c2016651'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:10.146644 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1417/2865] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:02:09 2022] DELETE /identity/v3/users/9fc4d64ad99a4e4da5b3d469c2016651 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:02:10.151617 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edc3a6-0cf7-4c1b-8d35-b08e587ef9c9 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:10.152536 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edc3a6-0cf7-4c1b-8d35-b08e587ef9c9 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:10.152536 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86edc3a6-0cf7-4c1b-8d35-b08e587ef9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:10.173487 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-86edc3a6-0cf7-4c1b-8d35-b08e587ef9c9 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:02:10.175117 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-86edc3a6-0cf7-4c1b-8d35-b08e587ef9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:10.273926 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1449/2866] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:02:10.283402 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664b07f-5cc1-4937-bc54-9987458fa9a7 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:10.284366 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-c664b07f-5cc1-4937-bc54-9987458fa9a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:10.366271 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664b07f-5cc1-4937-bc54-9987458fa9a7 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:10.372607 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7884f6e2-4f6f-4ae9-a827-32873bf5b499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:10.373708 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884f6e2-4f6f-4ae9-a827-32873bf5b499 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:10.375104 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884f6e2-4f6f-4ae9-a827-32873bf5b499 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:10.375620 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884f6e2-4f6f-4ae9-a827-32873bf5b499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:10.392874 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884f6e2-4f6f-4ae9-a827-32873bf5b499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:10.394559 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7884f6e2-4f6f-4ae9-a827-32873bf5b499 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:10.406913 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1418/2867] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:02:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:02:10.708022 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86edc3a6-0cf7-4c1b-8d35-b08e587ef9c9 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:10.710004 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-86edc3a6-0cf7-4c1b-8d35-b08e587ef9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:10.723407 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86edc3a6-0cf7-4c1b-8d35-b08e587ef9c9 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:10.728501 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d63031-d9f0-4d76-b272-bf84dfd10c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:10.729526 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d63031-d9f0-4d76-b272-bf84dfd10c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:10.730168 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d63031-d9f0-4d76-b272-bf84dfd10c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:10.730393 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d63031-d9f0-4d76-b272-bf84dfd10c45 admin admin] PATH_INFO: `/v3/projects/f57c67626fab4f5aa95be6263dfb7ccf` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:10.732703 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d63031-d9f0-4d76-b272-bf84dfd10c45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f57c67626fab4f5aa95be6263dfb7ccf)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:10.735532 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d63031-d9f0-4d76-b272-bf84dfd10c45 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:10.785073 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:10.786657 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-91d63031-d9f0-4d76-b272-bf84dfd10c45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f57c67626fab4f5aa95be6263dfb7ccf', 'request_id': 'req-91d63031-d9f0-4d76-b272-bf84dfd10c45'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:10.794273 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-91d63031-d9f0-4d76-b272-bf84dfd10c45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f57c67626fab4f5aa95be6263dfb7ccf', 'request_id': 'req-91d63031-d9f0-4d76-b272-bf84dfd10c45'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:10.804817 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-91d63031-d9f0-4d76-b272-bf84dfd10c45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f57c67626fab4f5aa95be6263dfb7ccf', 'request_id': 'req-91d63031-d9f0-4d76-b272-bf84dfd10c45'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:10.817797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-91d63031-d9f0-4d76-b272-bf84dfd10c45 admin admin] The token cache is being invalidate because project f57c67626fab4f5aa95be6263dfb7ccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:02:10.818125 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-91d63031-d9f0-4d76-b272-bf84dfd10c45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:10.818797 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-91d63031-d9f0-4d76-b272-bf84dfd10c45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:10.820354 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1450/2868] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:02:10 2022] DELETE /identity/v3/projects/f57c67626fab4f5aa95be6263dfb7ccf => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:02:10.825424 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9ba62-b5f3-4234-8880-c25da1f777f9 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:10.825718 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9ba62-b5f3-4234-8880-c25da1f777f9 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:10.826042 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9ba62-b5f3-4234-8880-c25da1f777f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:10.845986 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-88c9ba62-b5f3-4234-8880-c25da1f777f9 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:02:10.847250 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-88c9ba62-b5f3-4234-8880-c25da1f777f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:10.922249 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1419/2869] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:02:10.930761 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36d354-31a2-4153-a4e6-b3e54b0cbf79 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:10.931144 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36d354-31a2-4153-a4e6-b3e54b0cbf79 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:10.931673 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36d354-31a2-4153-a4e6-b3e54b0cbf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:10.951445 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-0a36d354-31a2-4153-a4e6-b3e54b0cbf79 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:02:10.953291 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-0a36d354-31a2-4153-a4e6-b3e54b0cbf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:10.961949 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1451/2870] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:02:10.966685 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9ba62-b5f3-4234-8880-c25da1f777f9 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:10.977227 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9ba62-b5f3-4234-8880-c25da1f777f9 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:10.982397 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae96b7-9b47-4cd6-9e99-0cf7d72abc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:10.983080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae96b7-9b47-4cd6-9e99-0cf7d72abc60 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:10.984048 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae96b7-9b47-4cd6-9e99-0cf7d72abc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:10.984048 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae96b7-9b47-4cd6-9e99-0cf7d72abc60 admin admin] PATH_INFO: `/v3/domains` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:10.984843 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae96b7-9b47-4cd6-9e99-0cf7d72abc60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91827) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 16:02:10.985158 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae96b7-9b47-4cd6-9e99-0cf7d72abc60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:10.986880 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae96b7-9b47-4cd6-9e99-0cf7d72abc60 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:11.004243 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1420/2871] 10.222.0.15 () {58 vars in 1152 bytes} [Thu Jun 23 16:02:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 16:02:11.011056 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36d354-31a2-4153-a4e6-b3e54b0cbf79 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:11.027073 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36d354-31a2-4153-a4e6-b3e54b0cbf79 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:11.035285 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb975b-e577-40e3-bd76-1fea19c98fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:11.036000 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb975b-e577-40e3-bd76-1fea19c98fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:11.036288 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb975b-e577-40e3-bd76-1fea19c98fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:11.036563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb975b-e577-40e3-bd76-1fea19c98fe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:11.037265 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb975b-e577-40e3-bd76-1fea19c98fe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:11.039376 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb975b-e577-40e3-bd76-1fea19c98fe2 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:11.068694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1452/2872] 10.222.0.15 () {60 vars in 1152 bytes} [Thu Jun 23 16:02:11 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:02:11.073545 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae96b7-9b47-4cd6-9e99-0cf7d72abc60 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:11.079983 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:11.087012 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae96b7-9b47-4cd6-9e99-0cf7d72abc60 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:11.163938 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef96af0-db9e-4e4d-9812-3091d1d6ef72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:11.164797 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef96af0-db9e-4e4d-9812-3091d1d6ef72 admin admin] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:11.164979 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef96af0-db9e-4e4d-9812-3091d1d6ef72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:11.165304 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef96af0-db9e-4e4d-9812-3091d1d6ef72 admin admin] PATH_INFO: `/v3/users` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:11.166241 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef96af0-db9e-4e4d-9812-3091d1d6ef72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:11.168339 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef96af0-db9e-4e4d-9812-3091d1d6ef72 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:11.197780 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1421/2873] 10.222.0.15 () {60 vars in 1143 bytes} [Thu Jun 23 16:02:11 2022] POST /identity/v3/users => generated 285 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 16:02:11.202226 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb975b-e577-40e3-bd76-1fea19c98fe2 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:11.215198 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb975b-e577-40e3-bd76-1fea19c98fe2 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:11.220440 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75264f96-21b1-4cdd-a6a9-ca4f33c43e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:11.221191 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75264f96-21b1-4cdd-a6a9-ca4f33c43e9b admin admin] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:11.221566 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75264f96-21b1-4cdd-a6a9-ca4f33c43e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:11.222009 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75264f96-21b1-4cdd-a6a9-ca4f33c43e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:11.222877 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75264f96-21b1-4cdd-a6a9-ca4f33c43e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:11.224599 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75264f96-21b1-4cdd-a6a9-ca4f33c43e9b admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:11.237435 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1453/2874] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:02:11.241569 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef96af0-db9e-4e4d-9812-3091d1d6ef72 admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:11.253078 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef96af0-db9e-4e4d-9812-3091d1d6ef72 admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:11.258586 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e6f27-c17f-4d16-aae4-245db34f4393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:11.259286 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e6f27-c17f-4d16-aae4-245db34f4393 admin admin] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:11.259573 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e6f27-c17f-4d16-aae4-245db34f4393 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:11.259850 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e6f27-c17f-4d16-aae4-245db34f4393 admin admin] PATH_INFO: `/v3/roles` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:11.260701 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e6f27-c17f-4d16-aae4-245db34f4393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:11.262452 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e6f27-c17f-4d16-aae4-245db34f4393 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:11.273786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1422/2875] 10.222.0.15 () {58 vars in 1121 bytes} [Thu Jun 23 16:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 16:02:11.278158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75264f96-21b1-4cdd-a6a9-ca4f33c43e9b admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:11.289007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75264f96-21b1-4cdd-a6a9-ca4f33c43e9b admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:11.293877 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586d684-4d8b-4a41-8f68-8adcd18829ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:11.294792 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586d684-4d8b-4a41-8f68-8adcd18829ae admin admin] REQUEST_METHOD: `PUT` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:11.295082 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586d684-4d8b-4a41-8f68-8adcd18829ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:11.295364 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586d684-4d8b-4a41-8f68-8adcd18829ae admin admin] PATH_INFO: `/v3/projects/a3613c75d66f40eb9da3e36df1aba13b/users/24fb00119fba4b9f993c4392dc3b1b36/roles/2362b672eb7b474dbd341608f3993123` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:11.314297 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586d684-4d8b-4a41-8f68-8adcd18829ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3613c75d66f40eb9da3e36df1aba13b, user_id=24fb00119fba4b9f993c4392dc3b1b36, role_id=2362b672eb7b474dbd341608f3993123)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:11.316962 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586d684-4d8b-4a41-8f68-8adcd18829ae admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:11.334177 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1454/2876] 10.222.0.15 () {60 vars in 1482 bytes} [Thu Jun 23 16:02:11 2022] PUT /identity/v3/projects/a3613c75d66f40eb9da3e36df1aba13b/users/24fb00119fba4b9f993c4392dc3b1b36/roles/2362b672eb7b474dbd341608f3993123 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:02:11.346552 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e66de1-9bf4-41ff-a0e7-67bd79068d46 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:11.346751 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e66de1-9bf4-41ff-a0e7-67bd79068d46 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:11.347031 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e66de1-9bf4-41ff-a0e7-67bd79068d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:11.378970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-31e66de1-9bf4-41ff-a0e7-67bd79068d46 None None] MFA Rules not processed for user `24fb00119fba4b9f993c4392dc3b1b36`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:02:11.380823 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-31e66de1-9bf4-41ff-a0e7-67bd79068d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:11.461156 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1423/2877] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:02:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:02:11.473560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586d684-4d8b-4a41-8f68-8adcd18829ae admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:11.476273 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-1586d684-4d8b-4a41-8f68-8adcd18829ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:11.559546 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586d684-4d8b-4a41-8f68-8adcd18829ae admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:11.563988 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23066245-cdef-420e-9974-40bcb7499ce7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79239c95306c43f0a1a0b51715440009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:11.564655 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23066245-cdef-420e-9974-40bcb7499ce7 service glance] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:11.564991 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23066245-cdef-420e-9974-40bcb7499ce7 service glance] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:11.565347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23066245-cdef-420e-9974-40bcb7499ce7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:11.574810 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23066245-cdef-420e-9974-40bcb7499ce7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:11.576264 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23066245-cdef-420e-9974-40bcb7499ce7 service glance] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:11.586098 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1455/2878] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:02:11 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:02:21.457503 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=65,keystone:INSERT=3 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:21.581579 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=60,keystone:INSERT=3,keystone:DELETE=3 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:31.838909 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818b163-bd43-4c5d-8bc8-1d2123307e45 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:31.839648 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818b163-bd43-4c5d-8bc8-1d2123307e45 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:31.839648 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818b163-bd43-4c5d-8bc8-1d2123307e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:31.860234 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-8818b163-bd43-4c5d-8bc8-1d2123307e45 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:02:31.861476 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-8818b163-bd43-4c5d-8bc8-1d2123307e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:31.934834 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1424/2879] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jun 23 16:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:02:31.959968 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23066245-cdef-420e-9974-40bcb7499ce7 service glance] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:31.962815 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-23066245-cdef-420e-9974-40bcb7499ce7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:32.071256 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23066245-cdef-420e-9974-40bcb7499ce7 service glance] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:32.076998 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99547d-6d7c-4103-a5ce-09019c3ad0ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:32.077674 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99547d-6d7c-4103-a5ce-09019c3ad0ef service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:32.078005 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99547d-6d7c-4103-a5ce-09019c3ad0ef service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:32.078329 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99547d-6d7c-4103-a5ce-09019c3ad0ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:32.087969 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99547d-6d7c-4103-a5ce-09019c3ad0ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:32.089582 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99547d-6d7c-4103-a5ce-09019c3ad0ef service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:32.101238 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1456/2880] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:02:32.931044 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818b163-bd43-4c5d-8bc8-1d2123307e45 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:32.946879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818b163-bd43-4c5d-8bc8-1d2123307e45 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:32.953304 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbc0d2-41ba-4bae-9c5b-e9306e85abe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:32.954614 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbc0d2-41ba-4bae-9c5b-e9306e85abe9 service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:32.954934 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbc0d2-41ba-4bae-9c5b-e9306e85abe9 service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:32.955217 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbc0d2-41ba-4bae-9c5b-e9306e85abe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:32.957143 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-76fbc0d2-41ba-4bae-9c5b-e9306e85abe9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:32.970905 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbc0d2-41ba-4bae-9c5b-e9306e85abe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:32.972771 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbc0d2-41ba-4bae-9c5b-e9306e85abe9 service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:32.987169 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1425/2881] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:02:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:02:37.010549 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726677c-2e7d-4e01-b2c3-a1ccf7d9698d None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:37.015476 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726677c-2e7d-4e01-b2c3-a1ccf7d9698d None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:37.017521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726677c-2e7d-4e01-b2c3-a1ccf7d9698d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:37.048209 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-9726677c-2e7d-4e01-b2c3-a1ccf7d9698d None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:02:37.049509 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-9726677c-2e7d-4e01-b2c3-a1ccf7d9698d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:37.057982 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1457/2882] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jun 23 16:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:02:37.079472 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbc0d2-41ba-4bae-9c5b-e9306e85abe9 service nova] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:37.081130 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-76fbc0d2-41ba-4bae-9c5b-e9306e85abe9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:37.095965 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbc0d2-41ba-4bae-9c5b-e9306e85abe9 service nova] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:37.101529 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb3819-b340-4cfa-b44d-52c7c224817a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:37.102204 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb3819-b340-4cfa-b44d-52c7c224817a service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:37.102498 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb3819-b340-4cfa-b44d-52c7c224817a service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:37.102771 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb3819-b340-4cfa-b44d-52c7c224817a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:37.114052 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb3819-b340-4cfa-b44d-52c7c224817a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:37.115623 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb3819-b340-4cfa-b44d-52c7c224817a service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:37.125619 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1426/2883] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:02:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:02:41.294819 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f2e37-ee71-4df7-856a-4273d5a68e97 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:41.295643 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f2e37-ee71-4df7-856a-4273d5a68e97 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:41.295953 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f2e37-ee71-4df7-856a-4273d5a68e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:41.331003 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-cc0f2e37-ee71-4df7-856a-4273d5a68e97 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:02:41.333095 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-cc0f2e37-ee71-4df7-856a-4273d5a68e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:41.346490 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1458/2884] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jun 23 16:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:02:41.431758 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb3819-b340-4cfa-b44d-52c7c224817a service nova] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:41.453066 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb3819-b340-4cfa-b44d-52c7c224817a service nova] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:41.462472 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d4203-1f85-47fc-83ca-6a367995d403 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:41.463595 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d4203-1f85-47fc-83ca-6a367995d403 service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:41.464099 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d4203-1f85-47fc-83ca-6a367995d403 service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:41.464587 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d4203-1f85-47fc-83ca-6a367995d403 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:41.481322 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d4203-1f85-47fc-83ca-6a367995d403 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:41.484434 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d4203-1f85-47fc-83ca-6a367995d403 service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:41.503257 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1427/2885] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:02:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:02:42.651868 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f2e37-ee71-4df7-856a-4273d5a68e97 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:42.653325 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-cc0f2e37-ee71-4df7-856a-4273d5a68e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:42.724236 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f2e37-ee71-4df7-856a-4273d5a68e97 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:42.729657 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d57287-042e-4748-a81b-2811c6c7cbad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:42.730359 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d57287-042e-4748-a81b-2811c6c7cbad service neutron] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:42.730759 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d57287-042e-4748-a81b-2811c6c7cbad service neutron] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:42.731044 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d57287-042e-4748-a81b-2811c6c7cbad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:42.733452 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-01d57287-042e-4748-a81b-2811c6c7cbad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:42.800133 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d57287-042e-4748-a81b-2811c6c7cbad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:42.801977 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d57287-042e-4748-a81b-2811c6c7cbad service neutron] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:42.813638 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1459/2886] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:02:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:02:45.571118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ebd1e-d8aa-4aaa-8839-8ab2ca3f98f9 None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:45.571713 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ebd1e-d8aa-4aaa-8839-8ab2ca3f98f9 None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:45.571888 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ebd1e-d8aa-4aaa-8839-8ab2ca3f98f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:45.612819 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-469ebd1e-d8aa-4aaa-8839-8ab2ca3f98f9 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:02:45.614557 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-469ebd1e-d8aa-4aaa-8839-8ab2ca3f98f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:45.626903 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1428/2887] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jun 23 16:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:02:45.654094 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d57287-042e-4748-a81b-2811c6c7cbad service neutron] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:45.671124 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d57287-042e-4748-a81b-2811c6c7cbad service neutron] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:45.678947 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57598bac-cb07-49fb-96ce-7d17200a7525 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:45.680001 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57598bac-cb07-49fb-96ce-7d17200a7525 service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:45.680527 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57598bac-cb07-49fb-96ce-7d17200a7525 service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:45.680845 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57598bac-cb07-49fb-96ce-7d17200a7525 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:45.694972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57598bac-cb07-49fb-96ce-7d17200a7525 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:45.697418 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57598bac-cb07-49fb-96ce-7d17200a7525 service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:45.716548 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1460/2888] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:02:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:02:46.423278 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ebd1e-d8aa-4aaa-8839-8ab2ca3f98f9 None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:46.434160 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ebd1e-d8aa-4aaa-8839-8ab2ca3f98f9 None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:46.440776 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776ac80-e2fd-451c-9d20-182df981629d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:46.441781 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776ac80-e2fd-451c-9d20-182df981629d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:46.441781 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776ac80-e2fd-451c-9d20-182df981629d admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:46.441781 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3776ac80-e2fd-451c-9d20-182df981629d admin admin] PATH_INFO: `/v3/users/24fb00119fba4b9f993c4392dc3b1b36` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:46.444034 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776ac80-e2fd-451c-9d20-182df981629d admin admin] RBAC: Authorizing `identity:delete_user(user_id=24fb00119fba4b9f993c4392dc3b1b36)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:46.445979 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3776ac80-e2fd-451c-9d20-182df981629d admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:46.496742 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-3776ac80-e2fd-451c-9d20-182df981629d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24fb00119fba4b9f993c4392dc3b1b36'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:46.504750 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-3776ac80-e2fd-451c-9d20-182df981629d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24fb00119fba4b9f993c4392dc3b1b36'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:46.505508 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-3776ac80-e2fd-451c-9d20-182df981629d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24fb00119fba4b9f993c4392dc3b1b36'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:46.506145 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-3776ac80-e2fd-451c-9d20-182df981629d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24fb00119fba4b9f993c4392dc3b1b36'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:46.519262 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-3776ac80-e2fd-451c-9d20-182df981629d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24fb00119fba4b9f993c4392dc3b1b36'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:46.538524 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1429/2889] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:02:46 2022] DELETE /identity/v3/users/24fb00119fba4b9f993c4392dc3b1b36 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:02:46.542847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2ba7d-5ab7-4a3d-9806-b1ce5c39fd69 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:46.543137 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2ba7d-5ab7-4a3d-9806-b1ce5c39fd69 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:46.543414 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2ba7d-5ab7-4a3d-9806-b1ce5c39fd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:46.569622 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-aaa2ba7d-5ab7-4a3d-9806-b1ce5c39fd69 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:02:46.570199 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-aaa2ba7d-5ab7-4a3d-9806-b1ce5c39fd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:46.574594 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=100 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:46.654222 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1461/2890] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:02:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:02:46.666377 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776ac80-e2fd-451c-9d20-182df981629d admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:46.667942 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-3776ac80-e2fd-451c-9d20-182df981629d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:46.703271 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:46.737355 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3776ac80-e2fd-451c-9d20-182df981629d admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:46.741194 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b491a2-cfdf-4afa-a3d6-abbd81e4f968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:46.741989 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b491a2-cfdf-4afa-a3d6-abbd81e4f968 service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:46.742280 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b491a2-cfdf-4afa-a3d6-abbd81e4f968 service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:46.742562 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b491a2-cfdf-4afa-a3d6-abbd81e4f968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:46.753841 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b491a2-cfdf-4afa-a3d6-abbd81e4f968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:46.755395 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b491a2-cfdf-4afa-a3d6-abbd81e4f968 service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:46.767135 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1430/2891] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:02:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:02:47.251285 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2ba7d-5ab7-4a3d-9806-b1ce5c39fd69 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:47.253880 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-aaa2ba7d-5ab7-4a3d-9806-b1ce5c39fd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:47.272709 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2ba7d-5ab7-4a3d-9806-b1ce5c39fd69 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:47.277610 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106e793-c1ce-4451-833d-29ea6e0121e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:47.278521 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106e793-c1ce-4451-833d-29ea6e0121e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:47.278794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106e793-c1ce-4451-833d-29ea6e0121e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:47.279066 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106e793-c1ce-4451-833d-29ea6e0121e7 admin admin] PATH_INFO: `/v3/projects/a3613c75d66f40eb9da3e36df1aba13b` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:47.280293 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106e793-c1ce-4451-833d-29ea6e0121e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3613c75d66f40eb9da3e36df1aba13b)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:47.282319 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106e793-c1ce-4451-833d-29ea6e0121e7 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:47.338746 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-2106e793-c1ce-4451-833d-29ea6e0121e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3613c75d66f40eb9da3e36df1aba13b', 'request_id': 'req-2106e793-c1ce-4451-833d-29ea6e0121e7'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:47.346221 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-2106e793-c1ce-4451-833d-29ea6e0121e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3613c75d66f40eb9da3e36df1aba13b', 'request_id': 'req-2106e793-c1ce-4451-833d-29ea6e0121e7'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:47.355015 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-2106e793-c1ce-4451-833d-29ea6e0121e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3613c75d66f40eb9da3e36df1aba13b', 'request_id': 'req-2106e793-c1ce-4451-833d-29ea6e0121e7'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:47.367393 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-2106e793-c1ce-4451-833d-29ea6e0121e7 admin admin] The token cache is being invalidate because project a3613c75d66f40eb9da3e36df1aba13b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91828) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:02:47.367690 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-2106e793-c1ce-4451-833d-29ea6e0121e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:47.368467 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-2106e793-c1ce-4451-833d-29ea6e0121e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:02:47.370105 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1462/2892] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:02:47 2022] DELETE /identity/v3/projects/a3613c75d66f40eb9da3e36df1aba13b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:02:49.649332 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4e5a3-040f-4fba-8784-b51c5552c61b None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:49.650121 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4e5a3-040f-4fba-8784-b51c5552c61b None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:49.650121 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da4e5a3-040f-4fba-8784-b51c5552c61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:49.671316 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-1da4e5a3-040f-4fba-8784-b51c5552c61b None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:02:49.672636 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-1da4e5a3-040f-4fba-8784-b51c5552c61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:49.737128 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1431/2893] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jun 23 16:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:02:49.759731 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106e793-c1ce-4451-833d-29ea6e0121e7 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:49.761278 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-2106e793-c1ce-4451-833d-29ea6e0121e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:49.858920 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106e793-c1ce-4451-833d-29ea6e0121e7 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:49.865140 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31e434-fc3d-4844-ac13-5025f77b83dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:49.865817 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31e434-fc3d-4844-ac13-5025f77b83dc service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:49.866144 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31e434-fc3d-4844-ac13-5025f77b83dc service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:49.866422 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31e434-fc3d-4844-ac13-5025f77b83dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:49.876960 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31e434-fc3d-4844-ac13-5025f77b83dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:49.878627 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31e434-fc3d-4844-ac13-5025f77b83dc service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:49.889542 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1463/2894] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:02:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:02:53.854190 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b73c01-c40f-413b-91c5-0d886f8ff5df None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:53.854778 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b73c01-c40f-413b-91c5-0d886f8ff5df None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:53.855218 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b73c01-c40f-413b-91c5-0d886f8ff5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:53.886949 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-45b73c01-c40f-413b-91c5-0d886f8ff5df None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:02:53.889074 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-45b73c01-c40f-413b-91c5-0d886f8ff5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:53.904253 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1432/2895] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jun 23 16:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:02:53.927990 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31e434-fc3d-4844-ac13-5025f77b83dc service nova] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:02:53.929900 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ad31e434-fc3d-4844-ac13-5025f77b83dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:02:53.946563 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31e434-fc3d-4844-ac13-5025f77b83dc service nova] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:02:53.952620 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea551f-10db-4a19-94ae-a9e62d975b9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:02:53.953303 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea551f-10db-4a19-94ae-a9e62d975b9e service nova] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:02:53.954166 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea551f-10db-4a19-94ae-a9e62d975b9e service nova] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:02:53.954456 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea551f-10db-4a19-94ae-a9e62d975b9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:02:53.964057 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea551f-10db-4a19-94ae-a9e62d975b9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:02:53.965720 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea551f-10db-4a19-94ae-a9e62d975b9e service nova] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:02:53.976732 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1464/2896] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:02:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:03:03.877691 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=44 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:03:03.971847 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:03:05.429113 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b73c01-c40f-413b-91c5-0d886f8ff5df None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:03:05.445635 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b73c01-c40f-413b-91c5-0d886f8ff5df None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:03:05.451820 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85091b8-33a2-468f-b036-3e2c3536fef4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:03:05.452511 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85091b8-33a2-468f-b036-3e2c3536fef4 service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:03:05.452788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85091b8-33a2-468f-b036-3e2c3536fef4 service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:03:05.453786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85091b8-33a2-468f-b036-3e2c3536fef4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:03:05.455977 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-a85091b8-33a2-468f-b036-3e2c3536fef4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:03:05.471111 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85091b8-33a2-468f-b036-3e2c3536fef4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:03:05.472985 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85091b8-33a2-468f-b036-3e2c3536fef4 service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:03:05.485118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1433/2897] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:03:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 16:03:10.668989 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9610b-c4d2-482a-867b-b2ab5f91e0b2 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:03:10.669704 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9610b-c4d2-482a-867b-b2ab5f91e0b2 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:03:10.669704 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9610b-c4d2-482a-867b-b2ab5f91e0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:03:10.700070 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-65c9610b-c4d2-482a-867b-b2ab5f91e0b2 None None] MFA Rules not processed for user `ecf8b9c7f12444f19eeb5971a7cae4e2`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:03:10.701308 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-65c9610b-c4d2-482a-867b-b2ab5f91e0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:03:10.787771 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1465/2898] 10.222.0.15 () {58 vars in 957 bytes} [Thu Jun 23 16:03:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:03:11.060558 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85091b8-33a2-468f-b036-3e2c3536fef4 service nova] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:03:11.062296 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-a85091b8-33a2-468f-b036-3e2c3536fef4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:03:11.175080 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85091b8-33a2-468f-b036-3e2c3536fef4 service nova] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:03:11.181577 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a9b12-c1fc-46de-9ac6-d0d933c35f9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44e9fc6def5341a589221350067bb0fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:03:11.182773 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a9b12-c1fc-46de-9ac6-d0d933c35f9b service neutron] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:03:11.183291 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a9b12-c1fc-46de-9ac6-d0d933c35f9b service neutron] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:03:11.183801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a9b12-c1fc-46de-9ac6-d0d933c35f9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:03:11.187113 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-036a9b12-c1fc-46de-9ac6-d0d933c35f9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:03:11.207033 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a9b12-c1fc-46de-9ac6-d0d933c35f9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:03:11.209826 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a9b12-c1fc-46de-9ac6-d0d933c35f9b service neutron] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:03:11.226212 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1434/2899] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:03:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:03:20.785147 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=37 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:03:21.219573 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=45 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:03:26.584324 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cc54b-71ff-4777-91c9-5843ae3164d5 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:03:26.584896 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cc54b-71ff-4777-91c9-5843ae3164d5 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:03:26.584896 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8cc54b-71ff-4777-91c9-5843ae3164d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:03:26.651132 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-2a8cc54b-71ff-4777-91c9-5843ae3164d5 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:03:26.652368 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-2a8cc54b-71ff-4777-91c9-5843ae3164d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:03:26.692282 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1466/2900] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jun 23 16:03:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:03:26.713122 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a9b12-c1fc-46de-9ac6-d0d933c35f9b service neutron] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:03:26.727450 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a9b12-c1fc-46de-9ac6-d0d933c35f9b service neutron] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:03:26.733220 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c22f5-4dfe-4a95-898b-7cdd8c523cbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:03:26.733961 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c22f5-4dfe-4a95-898b-7cdd8c523cbd service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:03:26.734884 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c22f5-4dfe-4a95-898b-7cdd8c523cbd service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:03:26.735166 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c22f5-4dfe-4a95-898b-7cdd8c523cbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:03:26.744207 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c22f5-4dfe-4a95-898b-7cdd8c523cbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:03:26.745801 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c22f5-4dfe-4a95-898b-7cdd8c523cbd service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:03:26.756117 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1435/2901] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:03:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:03:30.880729 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd387b-e546-47da-b417-bea2f492c380 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:03:30.881286 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd387b-e546-47da-b417-bea2f492c380 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:03:30.881286 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd387b-e546-47da-b417-bea2f492c380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:03:30.901103 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-5ffd387b-e546-47da-b417-bea2f492c380 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:03:30.902347 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5ffd387b-e546-47da-b417-bea2f492c380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:03:30.911805 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1467/2902] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jun 23 16:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:03:30.932610 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c22f5-4dfe-4a95-898b-7cdd8c523cbd service nova] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:03:30.945295 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c22f5-4dfe-4a95-898b-7cdd8c523cbd service nova] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:03:30.950983 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82aac9c-b8ce-4ac0-91c8-1034cc1faeb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:03:30.951634 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82aac9c-b8ce-4ac0-91c8-1034cc1faeb4 service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:03:30.951942 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82aac9c-b8ce-4ac0-91c8-1034cc1faeb4 service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:03:30.952220 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82aac9c-b8ce-4ac0-91c8-1034cc1faeb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:03:30.961539 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82aac9c-b8ce-4ac0-91c8-1034cc1faeb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:03:30.963148 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82aac9c-b8ce-4ac0-91c8-1034cc1faeb4 service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:03:30.973883 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1436/2903] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:03:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:03:35.031250 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607cf0d-ab04-4e49-84ab-f92037655ac0 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:03:35.031913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607cf0d-ab04-4e49-84ab-f92037655ac0 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:03:35.031913 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607cf0d-ab04-4e49-84ab-f92037655ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:03:35.055771 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-f607cf0d-ab04-4e49-84ab-f92037655ac0 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:03:35.057066 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-f607cf0d-ab04-4e49-84ab-f92037655ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:03:35.066351 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1468/2904] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jun 23 16:03:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:03:35.090203 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82aac9c-b8ce-4ac0-91c8-1034cc1faeb4 service nova] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:03:35.102244 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82aac9c-b8ce-4ac0-91c8-1034cc1faeb4 service nova] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:03:35.108192 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31156d-85d5-4b42-b7b7-a587cf4da0e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:03:35.108842 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31156d-85d5-4b42-b7b7-a587cf4da0e4 service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:03:35.109126 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31156d-85d5-4b42-b7b7-a587cf4da0e4 service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:03:35.109415 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31156d-85d5-4b42-b7b7-a587cf4da0e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:03:35.119436 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31156d-85d5-4b42-b7b7-a587cf4da0e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:03:35.121047 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e31156d-85d5-4b42-b7b7-a587cf4da0e4 service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:03:35.132847 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1437/2905] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:03:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:03:39.232276 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759842f-9c86-4ead-b3c9-40e1d48bba12 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:03:39.232779 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759842f-9c86-4ead-b3c9-40e1d48bba12 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:03:39.232894 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759842f-9c86-4ead-b3c9-40e1d48bba12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:03:39.251676 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-5759842f-9c86-4ead-b3c9-40e1d48bba12 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:03:39.252889 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-5759842f-9c86-4ead-b3c9-40e1d48bba12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:03:39.261195 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1469/2906] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jun 23 16:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:03:39.285842 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31156d-85d5-4b42-b7b7-a587cf4da0e4 service nova] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:03:39.304642 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31156d-85d5-4b42-b7b7-a587cf4da0e4 service nova] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:03:39.310157 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2fa46-5f4b-4de8-8d56-16e01cdfa76c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:03:39.310879 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2fa46-5f4b-4de8-8d56-16e01cdfa76c service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:03:39.311262 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2fa46-5f4b-4de8-8d56-16e01cdfa76c service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:03:39.311536 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2fa46-5f4b-4de8-8d56-16e01cdfa76c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:03:39.320875 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2fa46-5f4b-4de8-8d56-16e01cdfa76c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:03:39.322513 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd2fa46-5f4b-4de8-8d56-16e01cdfa76c service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:03:39.332946 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1438/2907] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:03:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:03:43.441402 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582338ce-d9dd-4091-b7af-d415dff6bcd5 None None] REQUEST_METHOD: `POST` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:03:43.442053 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582338ce-d9dd-4091-b7af-d415dff6bcd5 None None] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:03:43.442302 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582338ce-d9dd-4091-b7af-d415dff6bcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:03:43.475253 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.auth.core [None req-582338ce-d9dd-4091-b7af-d415dff6bcd5 None None] MFA Rules not processed for user `25bea438d9bc4701a8ff368969074002`. Rule list: `[]` (Enabled: `True`). {{(pid=91828) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:03:43.476690 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-582338ce-d9dd-4091-b7af-d415dff6bcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:03:43.486239 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1470/2908] 10.222.0.33 () {58 vars in 1016 bytes} [Thu Jun 23 16:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 16:03:43.509354 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2fa46-5f4b-4de8-8d56-16e01cdfa76c service nova] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:03:43.522118 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2fa46-5f4b-4de8-8d56-16e01cdfa76c service nova] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:03:43.528184 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e9fa3-9463-4ae6-bec4-5f38e659bd90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd54521ea1dca44c98d6723d0b9fd6468', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:03:43.528840 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e9fa3-9463-4ae6-bec4-5f38e659bd90 service nova] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:03:43.529132 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e9fa3-9463-4ae6-bec4-5f38e659bd90 service nova] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:03:43.529419 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e9fa3-9463-4ae6-bec4-5f38e659bd90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:03:43.539183 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e9fa3-9463-4ae6-bec4-5f38e659bd90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:03:43.540780 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e9fa3-9463-4ae6-bec4-5f38e659bd90 service nova] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:03:43.552308 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1439/2909] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:03:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:03:53.468694 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=45 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:03:53.546991 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=33 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:04:15.238754 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582338ce-d9dd-4091-b7af-d415dff6bcd5 None None] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:04:15.246553 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-582338ce-d9dd-4091-b7af-d415dff6bcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:04:15.274321 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582338ce-d9dd-4091-b7af-d415dff6bcd5 None None] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:04:15.284554 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa38798-dd5d-449c-91a7-da76f5376a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:04:15.286044 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa38798-dd5d-449c-91a7-da76f5376a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:04:15.286504 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa38798-dd5d-449c-91a7-da76f5376a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:04:15.287681 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa38798-dd5d-449c-91a7-da76f5376a19 admin admin] PATH_INFO: `/v3/users/ecf8b9c7f12444f19eeb5971a7cae4e2` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:04:15.289106 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa38798-dd5d-449c-91a7-da76f5376a19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecf8b9c7f12444f19eeb5971a7cae4e2)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:04:15.291627 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa38798-dd5d-449c-91a7-da76f5376a19 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:04:15.365029 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8fa38798-dd5d-449c-91a7-da76f5376a19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecf8b9c7f12444f19eeb5971a7cae4e2'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:04:15.381255 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8fa38798-dd5d-449c-91a7-da76f5376a19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecf8b9c7f12444f19eeb5971a7cae4e2'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:04:15.382600 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8fa38798-dd5d-449c-91a7-da76f5376a19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecf8b9c7f12444f19eeb5971a7cae4e2'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:04:15.383645 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8fa38798-dd5d-449c-91a7-da76f5376a19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecf8b9c7f12444f19eeb5971a7cae4e2'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:04:15.407158 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8fa38798-dd5d-449c-91a7-da76f5376a19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecf8b9c7f12444f19eeb5971a7cae4e2'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:04:15.424007 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1471/2910] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:04:15 2022] DELETE /identity/v3/users/ecf8b9c7f12444f19eeb5971a7cae4e2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:04:15.654216 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e9fa3-9463-4ae6-bec4-5f38e659bd90 service nova] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:04:15.669839 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e9fa3-9463-4ae6-bec4-5f38e659bd90 service nova] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:04:15.761633 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87d8c9-16c5-476e-a2ec-554a6f16fc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:04:15.762537 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87d8c9-16c5-476e-a2ec-554a6f16fc55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:04:15.762835 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87d8c9-16c5-476e-a2ec-554a6f16fc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:04:15.763117 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87d8c9-16c5-476e-a2ec-554a6f16fc55 admin admin] PATH_INFO: `/v3/projects/20dc30708c2a450485f7374b5d412c8a` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:04:15.764433 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87d8c9-16c5-476e-a2ec-554a6f16fc55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20dc30708c2a450485f7374b5d412c8a)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:04:15.766438 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87d8c9-16c5-476e-a2ec-554a6f16fc55 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:04:15.841453 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-8d87d8c9-16c5-476e-a2ec-554a6f16fc55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20dc30708c2a450485f7374b5d412c8a', 'request_id': 'req-8d87d8c9-16c5-476e-a2ec-554a6f16fc55'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:04:15.853767 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-8d87d8c9-16c5-476e-a2ec-554a6f16fc55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20dc30708c2a450485f7374b5d412c8a', 'request_id': 'req-8d87d8c9-16c5-476e-a2ec-554a6f16fc55'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:04:15.867953 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-8d87d8c9-16c5-476e-a2ec-554a6f16fc55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20dc30708c2a450485f7374b5d412c8a', 'request_id': 'req-8d87d8c9-16c5-476e-a2ec-554a6f16fc55'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:04:15.887738 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-8d87d8c9-16c5-476e-a2ec-554a6f16fc55 admin admin] The token cache is being invalidate because project 20dc30708c2a450485f7374b5d412c8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:04:15.888198 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-8d87d8c9-16c5-476e-a2ec-554a6f16fc55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:04:15.889305 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-8d87d8c9-16c5-476e-a2ec-554a6f16fc55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:04:15.891771 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1440/2911] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:04:15 2022] DELETE /identity/v3/projects/20dc30708c2a450485f7374b5d412c8a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:04:25.419508 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:04:25.882000 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:05:14.391327 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa38798-dd5d-449c-91a7-da76f5376a19 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:05:14.392745 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-8fa38798-dd5d-449c-91a7-da76f5376a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:05:14.481803 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa38798-dd5d-449c-91a7-da76f5376a19 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:05:14.551295 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221341c-e2ed-483a-8850-058d9a1aaf1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9300c3a803e94f9a93442f551fc9646f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:05:14.552591 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221341c-e2ed-483a-8850-058d9a1aaf1e service placement] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:05:14.552872 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221341c-e2ed-483a-8850-058d9a1aaf1e service placement] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:05:14.553149 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221341c-e2ed-483a-8850-058d9a1aaf1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:05:14.554991 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e221341c-e2ed-483a-8850-058d9a1aaf1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:05:14.569171 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e221341c-e2ed-483a-8850-058d9a1aaf1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:05:14.569171 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e221341c-e2ed-483a-8850-058d9a1aaf1e service placement] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:05:14.579782 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1472/2912] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:05:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:05:24.575206 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=67 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:05:52.289662 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf1abc-3f1d-4a4a-aef3-a396d949bd1e None None] REQUEST_METHOD: `POST` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:05:52.290181 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf1abc-3f1d-4a4a-aef3-a396d949bd1e None None] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:05:52.290285 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf1abc-3f1d-4a4a-aef3-a396d949bd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:05:52.351224 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.auth.core [None req-bbaf1abc-3f1d-4a4a-aef3-a396d949bd1e None None] MFA Rules not processed for user `dbf2c12174e94e2db9be178973183ced`. Rule list: `[]` (Enabled: `True`). {{(pid=91827) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 16:05:52.352462 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-bbaf1abc-3f1d-4a4a-aef3-a396d949bd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:05:52.420690 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1441/2913] 10.222.0.15 () {58 vars in 967 bytes} [Thu Jun 23 16:05:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 16:05:52.464972 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221341c-e2ed-483a-8850-058d9a1aaf1e service placement] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:05:52.466435 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-e221341c-e2ed-483a-8850-058d9a1aaf1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:05:52.568463 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221341c-e2ed-483a-8850-058d9a1aaf1e service placement] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:05:52.574614 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2cc88-8e14-48f3-9e93-060ac5ce7766 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5824ee17e276483faf20db88a93545f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:05:52.575419 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2cc88-8e14-48f3-9e93-060ac5ce7766 service swift] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:05:52.575702 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2cc88-8e14-48f3-9e93-060ac5ce7766 service swift] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:05:52.575981 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2cc88-8e14-48f3-9e93-060ac5ce7766 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:05:52.585378 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2cc88-8e14-48f3-9e93-060ac5ce7766 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:05:52.591630 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2cc88-8e14-48f3-9e93-060ac5ce7766 service swift] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:05:52.595687 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1473/2914] 10.222.0.15 () {60 vars in 1384 bytes} [Thu Jun 23 16:05:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 16:05:55.963970 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf1abc-3f1d-4a4a-aef3-a396d949bd1e None None] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:05:55.966126 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-bbaf1abc-3f1d-4a4a-aef3-a396d949bd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:05:56.004286 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf1abc-3f1d-4a4a-aef3-a396d949bd1e None None] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:05:56.010514 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445c64c-24a1-4d9f-9415-efbd0e155584 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9300c3a803e94f9a93442f551fc9646f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:05:56.011187 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445c64c-24a1-4d9f-9415-efbd0e155584 service placement] REQUEST_METHOD: `GET` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:05:56.011471 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445c64c-24a1-4d9f-9415-efbd0e155584 service placement] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:05:56.011751 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445c64c-24a1-4d9f-9415-efbd0e155584 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:05:56.017446 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-8445c64c-24a1-4d9f-9415-efbd0e155584 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:05:56.035811 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445c64c-24a1-4d9f-9415-efbd0e155584 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:05:56.037777 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445c64c-24a1-4d9f-9415-efbd0e155584 service placement] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:05:56.052455 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1442/2915] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:05:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 16:05:59.284756 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2cc88-8e14-48f3-9e93-060ac5ce7766 service swift] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:05:59.286279 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-8dd2cc88-8e14-48f3-9e93-060ac5ce7766 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:05:59.366922 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2cc88-8e14-48f3-9e93-060ac5ce7766 service swift] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:05:59.373406 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf7c35-2d06-42aa-882f-fa46f44962d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:05:59.375067 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf7c35-2d06-42aa-882f-fa46f44962d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:05:59.375693 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf7c35-2d06-42aa-882f-fa46f44962d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:05:59.376073 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf7c35-2d06-42aa-882f-fa46f44962d7 admin admin] PATH_INFO: `/v3/users/c8f9d409702a4c2592c8110480de67a6` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:05:59.377488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf7c35-2d06-42aa-882f-fa46f44962d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8f9d409702a4c2592c8110480de67a6)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:05:59.379464 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf7c35-2d06-42aa-882f-fa46f44962d7 admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:05:59.427952 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d3cf7c35-2d06-42aa-882f-fa46f44962d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8f9d409702a4c2592c8110480de67a6'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:05:59.434673 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d3cf7c35-2d06-42aa-882f-fa46f44962d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8f9d409702a4c2592c8110480de67a6'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:05:59.435338 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d3cf7c35-2d06-42aa-882f-fa46f44962d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8f9d409702a4c2592c8110480de67a6'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:05:59.435937 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d3cf7c35-2d06-42aa-882f-fa46f44962d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8f9d409702a4c2592c8110480de67a6'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:05:59.447344 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:05:59.448714 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-d3cf7c35-2d06-42aa-882f-fa46f44962d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8f9d409702a4c2592c8110480de67a6'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:05:59.461684 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1474/2916] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:05:59 2022] DELETE /identity/v3/users/c8f9d409702a4c2592c8110480de67a6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:05:59.635715 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445c64c-24a1-4d9f-9415-efbd0e155584 service placement] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:05:59.648747 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445c64c-24a1-4d9f-9415-efbd0e155584 service placement] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:05:59.706642 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d59d34-568c-4c3e-aff1-3c155b0f719c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:05:59.707503 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d59d34-568c-4c3e-aff1-3c155b0f719c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:05:59.707788 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d59d34-568c-4c3e-aff1-3c155b0f719c admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:05:59.708066 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d59d34-568c-4c3e-aff1-3c155b0f719c admin admin] PATH_INFO: `/v3/projects/2787068060d14f89bdb977a17e682487` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:05:59.709261 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d59d34-568c-4c3e-aff1-3c155b0f719c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2787068060d14f89bdb977a17e682487)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:05:59.711206 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d59d34-568c-4c3e-aff1-3c155b0f719c admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:05:59.761239 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-b4d59d34-568c-4c3e-aff1-3c155b0f719c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2787068060d14f89bdb977a17e682487', 'request_id': 'req-b4d59d34-568c-4c3e-aff1-3c155b0f719c'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:05:59.764202 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:05:59.770997 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-b4d59d34-568c-4c3e-aff1-3c155b0f719c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2787068060d14f89bdb977a17e682487', 'request_id': 'req-b4d59d34-568c-4c3e-aff1-3c155b0f719c'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:05:59.778524 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-b4d59d34-568c-4c3e-aff1-3c155b0f719c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2787068060d14f89bdb977a17e682487', 'request_id': 'req-b4d59d34-568c-4c3e-aff1-3c155b0f719c'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:05:59.790786 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-b4d59d34-568c-4c3e-aff1-3c155b0f719c admin admin] The token cache is being invalidate because project 2787068060d14f89bdb977a17e682487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:05:59.791428 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-b4d59d34-568c-4c3e-aff1-3c155b0f719c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:05:59.792147 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-b4d59d34-568c-4c3e-aff1-3c155b0f719c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:05:59.794456 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1443/2917] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:05:59 2022] DELETE /identity/v3/projects/2787068060d14f89bdb977a17e682487 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:05:59.798093 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf7c35-2d06-42aa-882f-fa46f44962d7 admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:05:59.799530 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-d3cf7c35-2d06-42aa-882f-fa46f44962d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:05:59.813999 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf7c35-2d06-42aa-882f-fa46f44962d7 admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:05:59.870283 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74d4cf-00b5-48a2-95f5-14af9209bb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:05:59.871155 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74d4cf-00b5-48a2-95f5-14af9209bb9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:05:59.871442 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74d4cf-00b5-48a2-95f5-14af9209bb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:05:59.871723 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74d4cf-00b5-48a2-95f5-14af9209bb9d admin admin] PATH_INFO: `/v3/users/758540e026ae463982e93aa006e8e547` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:05:59.872912 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74d4cf-00b5-48a2-95f5-14af9209bb9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=758540e026ae463982e93aa006e8e547)` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:05:59.874861 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74d4cf-00b5-48a2-95f5-14af9209bb9d admin admin] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:05:59.924257 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8f74d4cf-00b5-48a2-95f5-14af9209bb9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '758540e026ae463982e93aa006e8e547'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:05:59.931248 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8f74d4cf-00b5-48a2-95f5-14af9209bb9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '758540e026ae463982e93aa006e8e547'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:05:59.931904 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8f74d4cf-00b5-48a2-95f5-14af9209bb9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '758540e026ae463982e93aa006e8e547'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:05:59.932525 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8f74d4cf-00b5-48a2-95f5-14af9209bb9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '758540e026ae463982e93aa006e8e547'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:05:59.944615 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.notifications [None req-8f74d4cf-00b5-48a2-95f5-14af9209bb9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '758540e026ae463982e93aa006e8e547'} {{(pid=91828) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:05:59.956856 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1475/2918] 10.222.0.15 () {58 vars in 1223 bytes} [Thu Jun 23 16:05:59 2022] DELETE /identity/v3/users/758540e026ae463982e93aa006e8e547 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 16:06:00.125528 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d59d34-568c-4c3e-aff1-3c155b0f719c admin admin] Authenticating user token {{(pid=91827) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:06:00.127008 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.fernet_utils [None req-b4d59d34-568c-4c3e-aff1-3c155b0f719c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91827) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:06:00.140471 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d59d34-568c-4c3e-aff1-3c155b0f719c admin admin] Validating token access rules against request {{(pid=91827) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:06:00.197538 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb2f09-a9cc-49db-8005-77ccfbc14953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25bea438d9bc4701a8ff368969074002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a90cb52bb0ee4522ac438c1991f3a531', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91827) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:06:00.198431 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb2f09-a9cc-49db-8005-77ccfbc14953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:06:00.198715 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb2f09-a9cc-49db-8005-77ccfbc14953 admin admin] SCRIPT_NAME: `/identity` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:06:00.198996 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb2f09-a9cc-49db-8005-77ccfbc14953 admin admin] PATH_INFO: `/v3/projects/e422f3922dc04477b279c79492d35594` {{(pid=91827) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:06:00.200163 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb2f09-a9cc-49db-8005-77ccfbc14953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e422f3922dc04477b279c79492d35594)` {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:06:00.202073 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb2f09-a9cc-49db-8005-77ccfbc14953 admin admin] RBAC: Authorization granted {{(pid=91827) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:06:00.251472 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-b4eb2f09-a9cc-49db-8005-77ccfbc14953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e422f3922dc04477b279c79492d35594', 'request_id': 'req-b4eb2f09-a9cc-49db-8005-77ccfbc14953'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:06:00.259929 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-b4eb2f09-a9cc-49db-8005-77ccfbc14953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e422f3922dc04477b279c79492d35594', 'request_id': 'req-b4eb2f09-a9cc-49db-8005-77ccfbc14953'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:06:00.266295 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-b4eb2f09-a9cc-49db-8005-77ccfbc14953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e422f3922dc04477b279c79492d35594', 'request_id': 'req-b4eb2f09-a9cc-49db-8005-77ccfbc14953'} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:06:00.277789 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-b4eb2f09-a9cc-49db-8005-77ccfbc14953 admin admin] The token cache is being invalidate because project e422f3922dc04477b279c79492d35594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91827) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 16:06:00.278048 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-b4eb2f09-a9cc-49db-8005-77ccfbc14953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:06:00.278810 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG keystone.notifications [None req-b4eb2f09-a9cc-49db-8005-77ccfbc14953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91827) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 16:06:00.280362 dv-cinder-835384-9-smb devstack@keystone.service[91827]: [pid: 91827|app: 0|req: 1444/2919] 10.222.0.15 () {58 vars in 1232 bytes} [Thu Jun 23 16:06:00 2022] DELETE /identity/v3/projects/e422f3922dc04477b279c79492d35594 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 16:06:09.953362 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=56,keystone:INSERT=2,keystone:DELETE=11 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:06:10.274820 dv-cinder-835384-9-smb devstack@keystone.service[91827]: DEBUG dbcounter [-] [91827] Writing DB stats keystone:DELETE=10,keystone:SELECT=57,keystone:INSERT=1 {{(pid=91827) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:10:18.367560 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74d4cf-00b5-48a2-95f5-14af9209bb9d admin admin] Authenticating user token {{(pid=91828) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 16:10:18.369309 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-8f74d4cf-00b5-48a2-95f5-14af9209bb9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:10:18.458915 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74d4cf-00b5-48a2-95f5-14af9209bb9d admin admin] Validating token access rules against request {{(pid=91828) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 16:10:18.555362 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a04f1-4d0f-4e43-9e20-2b095415c41a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9300c3a803e94f9a93442f551fc9646f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff90b874f5b84d28a2752bc95419ad95', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91828) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 16:10:18.556488 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a04f1-4d0f-4e43-9e20-2b095415c41a service placement] REQUEST_METHOD: `GET` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 16:10:18.556975 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a04f1-4d0f-4e43-9e20-2b095415c41a service placement] SCRIPT_NAME: `/identity` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 16:10:18.557473 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a04f1-4d0f-4e43-9e20-2b095415c41a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91828) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 16:10:18.560786 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.fernet_utils [None req-ef5a04f1-4d0f-4e43-9e20-2b095415c41a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91828) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 16:10:18.583554 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a04f1-4d0f-4e43-9e20-2b095415c41a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 16:10:18.586794 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a04f1-4d0f-4e43-9e20-2b095415c41a service placement] RBAC: Authorization granted {{(pid=91828) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 16:10:18.608145 dv-cinder-835384-9-smb devstack@keystone.service[91828]: [pid: 91828|app: 0|req: 1476/2920] 10.222.0.15 () {60 vars in 1365 bytes} [Thu Jun 23 16:10:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 16:10:28.598809 dv-cinder-835384-9-smb devstack@keystone.service[91828]: DEBUG dbcounter [-] [91828] Writing DB stats keystone:SELECT=58 {{(pid=91828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}